[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:46:52 dist-test-slave-lgr5 krb5kdc[25712](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:46:52 dist-test-slave-lgr5 krb5kdc[25712](info): set up 2 sockets
Aug 11 18:46:52 dist-test-slave-lgr5 krb5kdc[25712](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 18:46:54.089679 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.266s user 0.002s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:46:54 dist-test-slave-lgr5 krb5kdc[25712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474014, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:46:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:46:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:46:54.293088 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:40319
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:40989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:40319
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:46:54.685567 25735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:46:54.686046 25735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:46:54.686220 25735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:46:54.694222 25735 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:46:54.694370 25735 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:46:54.694440 25735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:46:54.694530 25735 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:46:54.694597 25735 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:46:54.705673 25735 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:40319
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:40319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:46:54.707577 25735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:46:54.709237 25735 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:46:54.725098 25744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:46:54.725925 25749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:46:54.726176 25745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:46:54.726965 25735 server_base.cc:1034] running on GCE node
I20260811 18:46:54.728019 25735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:46:54.730104 25735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:46:54.731608 25735 hybrid_clock.cc:648] HybridClock initialized: now 1786474014731521 us; error 113 us; skew 500 ppm
I20260811 18:46:54.732074 25735 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:46:54 dist-test-slave-lgr5 krb5kdc[25712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474014, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:46:54.735947 25735 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:46:54.737789 25735 webserver.cc:460] Webserver started at http://127.25.25.62:40499/ using document root <none> and password file <none>
I20260811 18:46:54.738832 25735 fs_manager.cc:359] Metadata directory not provided
I20260811 18:46:54.738982 25735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:46:54.739300 25735 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:46:54.742916 25735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "5d9155f145774081b30fffe34720a568"
format_stamp: "Formatted at 2026-08-11 18:46:54 on dist-test-slave-lgr5"
server_key: "d1a2ddd7e2fc69165da1857db51267f7"
server_key_iv: "71e0ddb76860406123bf90619d42bc18"
server_key_version: "encryptionkey@0"
I20260811 18:46:54.743743 25735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "5d9155f145774081b30fffe34720a568"
format_stamp: "Formatted at 2026-08-11 18:46:54 on dist-test-slave-lgr5"
server_key: "d1a2ddd7e2fc69165da1857db51267f7"
server_key_iv: "71e0ddb76860406123bf90619d42bc18"
server_key_version: "encryptionkey@0"
I20260811 18:46:54.750345 25735 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 18:46:54.754542 25766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:46:54.756247 25735 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 18:46:54.756449 25735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "5d9155f145774081b30fffe34720a568"
format_stamp: "Formatted at 2026-08-11 18:46:54 on dist-test-slave-lgr5"
server_key: "d1a2ddd7e2fc69165da1857db51267f7"
server_key_iv: "71e0ddb76860406123bf90619d42bc18"
server_key_version: "encryptionkey@0"
I20260811 18:46:54.756671 25735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:46:54.776678 25735 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:46:54.781296 25735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:46:54.781595 25735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:46:54.800592 25735 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:40319
I20260811 18:46:54.800627 25845 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:40319 every 8 connection(s)
I20260811 18:46:54.802271 25735 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:46:54.807276 25849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:46:54.807770 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 25735
I20260811 18:46:54.808247 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:46:54.810899 25700 external_mini_cluster.cc:1428] Setting key fb88f7fdc8d6433c778baf579f384ddd
I20260811 18:46:54.821476 25849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d9155f145774081b30fffe34720a568: Bootstrap starting.
I20260811 18:46:54.825722 25849 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d9155f145774081b30fffe34720a568: Neither blocks nor log segments found. Creating new log.
I20260811 18:46:54.827042 25849 log.cc:824] T 00000000000000000000000000000000 P 5d9155f145774081b30fffe34720a568: Log is configured to *not* fsync() on all Append() calls
I20260811 18:46:54.831322 25849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d9155f145774081b30fffe34720a568: No bootstrap required, opened a new log
I20260811 18:46:54.840868 25849 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d9155f145774081b30fffe34720a568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d9155f145774081b30fffe34720a568" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40319 } }
I20260811 18:46:54.841410 25849 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5d9155f145774081b30fffe34720a568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:46:54.841540 25849 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d9155f145774081b30fffe34720a568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d9155f145774081b30fffe34720a568, State: Initialized, Role: FOLLOWER
I20260811 18:46:54.842233 25849 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d9155f145774081b30fffe34720a568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d9155f145774081b30fffe34720a568" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40319 } }
I20260811 18:46:54.842475 25849 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5d9155f145774081b30fffe34720a568 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:46:54.842617 25849 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d9155f145774081b30fffe34720a568 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:46:54.842787 25849 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d9155f145774081b30fffe34720a568 [term 0 FOLLOWER]: Advancing to term 1
Aug 11 18:46:54 dist-test-slave-lgr5 krb5kdc[25712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474014, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:46:54.845903 25849 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d9155f145774081b30fffe34720a568 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d9155f145774081b30fffe34720a568" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40319 } }
I20260811 18:46:54.847909 25849 leader_election.cc:302] T 00000000000000000000000000000000 P 5d9155f145774081b30fffe34720a568 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5d9155f145774081b30fffe34720a568; no voters:
I20260811 18:46:54.848871 25849 leader_election.cc:288] T 00000000000000000000000000000000 P 5d9155f145774081b30fffe34720a568 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:46:54.849018 25856 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5d9155f145774081b30fffe34720a568 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:46:54.850214 25856 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5d9155f145774081b30fffe34720a568 [term 1 LEADER]: Becoming Leader. State: Replica: 5d9155f145774081b30fffe34720a568, State: Running, Role: LEADER
I20260811 18:46:54.850929 25856 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d9155f145774081b30fffe34720a568 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d9155f145774081b30fffe34720a568" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40319 } }
I20260811 18:46:54.851622 25849 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d9155f145774081b30fffe34720a568 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:46:54.854420 25859 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d9155f145774081b30fffe34720a568 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d9155f145774081b30fffe34720a568. Latest consensus state: current_term: 1 leader_uuid: "5d9155f145774081b30fffe34720a568" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d9155f145774081b30fffe34720a568" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40319 } } }
I20260811 18:46:54.854839 25859 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d9155f145774081b30fffe34720a568 [sys.catalog]: This master's current role is: LEADER
I20260811 18:46:54.855403 25858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d9155f145774081b30fffe34720a568 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5d9155f145774081b30fffe34720a568" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d9155f145774081b30fffe34720a568" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40319 } } }
I20260811 18:46:54.855685 25858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d9155f145774081b30fffe34720a568 [sys.catalog]: This master's current role is: LEADER
I20260811 18:46:54.861217 25853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:46:54.816409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43790 (local address 127.25.25.62:40319)
0811 18:46:54.817484 (+ 1075us) server_negotiation.cc:206] Beginning negotiation
0811 18:46:54.817501 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 18:46:54.818883 (+ 1382us) server_negotiation.cc:407] Connection header received
0811 18:46:54.829610 (+ 10727us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:46:54.829642 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:46:54.830295 (+ 653us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:46:54.830784 (+ 489us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:46:54.833937 (+ 3153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:46:54.836060 (+ 2123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:46:54.838006 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:46:54.839171 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:46:54.839400 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:46:54.846475 (+ 7075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:46:54.846487 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:46:54.846505 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:46:54.846576 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:46:54.850535 (+ 3959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:46:54.851645 (+ 1110us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:46:54.851653 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:46:54.851659 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:46:54.851898 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:46:54.852461 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:46:54.852467 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:46:54.852471 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:46:54.853779 (+ 1308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:46:54.857999 (+ 4220us) server_negotiation.cc:1035] Waiting for connection context
0811 18:46:54.858352 (+ 353us) server_negotiation.cc:299] Negotiation successful
0811 18:46:54.858904 (+ 552us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":787,"thread_start_us":475,"threads_started":1}
I20260811 18:46:54.867871 25862 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:46:54.874190 25862 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:46:54.885571 25862 catalog_manager.cc:1347] Generated new cluster ID: 7a64a77a4eaf439bb3165828b5d57829
I20260811 18:46:54.885728 25862 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:46:54.907074 25862 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:46:54.908936 25862 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:46:54.917624 25862 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5d9155f145774081b30fffe34720a568: Generated new TSK 0
I20260811 18:46:54.918792 25862 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.25.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
I20260811 18:46:54.981665 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:0
--local_ip_for_outbound_sockets=127.25.25.1
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:40319
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:40989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:46:55.345705 25892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:46:55.346040 25892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:46:55.346149 25892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:46:55.354065 25892 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:46:55.354205 25892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:46:55.354327 25892 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:46:55.365026 25892 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:40319
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:46:55.366366 25892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:46:55.367992 25892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:46:55.382392 25907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:46:55.382517 25903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:46:55.382426 25904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:46:55.385646 25892 server_base.cc:1034] running on GCE node
I20260811 18:46:55.386345 25892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:46:55.387377 25892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:46:55.388588 25892 hybrid_clock.cc:648] HybridClock initialized: now 1786474015388532 us; error 48 us; skew 500 ppm
I20260811 18:46:55.388948 25892 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:46:55 dist-test-slave-lgr5 krb5kdc[25712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474015, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:46:55.392274 25892 init.cc:377] Logged in from keytab as kudu/127.25.25.1@KRBTEST.COM (short username kudu)
I20260811 18:46:55.393965 25892 webserver.cc:460] Webserver started at http://127.25.25.1:44589/ using document root <none> and password file <none>
I20260811 18:46:55.394698 25892 fs_manager.cc:359] Metadata directory not provided
I20260811 18:46:55.394805 25892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:46:55.395123 25892 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:46:55.398437 25892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-0/data/instance:
uuid: "4dc390cdc5724988bd991ede566d2cbe"
format_stamp: "Formatted at 2026-08-11 18:46:55 on dist-test-slave-lgr5"
server_key: "5f55d46c93115ebe9edc2d75fe2295e1"
server_key_iv: "7eb59d879c68f640333091c8b012d5a8"
server_key_version: "encryptionkey@0"
I20260811 18:46:55.399276 25892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance:
uuid: "4dc390cdc5724988bd991ede566d2cbe"
format_stamp: "Formatted at 2026-08-11 18:46:55 on dist-test-slave-lgr5"
server_key: "5f55d46c93115ebe9edc2d75fe2295e1"
server_key_iv: "7eb59d879c68f640333091c8b012d5a8"
server_key_version: "encryptionkey@0"
I20260811 18:46:55.405344 25892 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260811 18:46:55.409709 25918 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:46:55.411509 25892 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 18:46:55.411716 25892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "4dc390cdc5724988bd991ede566d2cbe"
format_stamp: "Formatted at 2026-08-11 18:46:55 on dist-test-slave-lgr5"
server_key: "5f55d46c93115ebe9edc2d75fe2295e1"
server_key_iv: "7eb59d879c68f640333091c8b012d5a8"
server_key_version: "encryptionkey@0"
I20260811 18:46:55.411988 25892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:46:55.426736 25892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:46:55.431509 25892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:46:55.431834 25892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:46:55.432986 25892 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:46:55.434561 25892 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:46:55.434666 25892 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:46:55.434795 25892 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:46:55.434864 25892 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:46:55.473462 25892 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:33893
I20260811 18:46:55.473462 26105 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:33893 every 8 connection(s)
I20260811 18:46:55.475147 25892 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:46:55.482594 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 25892
I20260811 18:46:55.482851 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance
I20260811 18:46:55.483471 25700 external_mini_cluster.cc:1428] Setting key 757ffe46b93b7494b4f6075fd408bfcb
Aug 11 18:46:55 dist-test-slave-lgr5 krb5kdc[25712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474015, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:46:55.500712 26112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:46:55.478482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:53531 (local address 127.25.25.62:40319)
0811 18:46:55.479017 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0811 18:46:55.479024 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:46:55.480145 (+ 1121us) server_negotiation.cc:407] Connection header received
0811 18:46:55.482213 (+ 2068us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:46:55.482220 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:46:55.482323 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:46:55.482466 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:46:55.484443 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:46:55.485336 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:46:55.487555 (+ 2219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:46:55.488305 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:46:55.488502 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:46:55.492883 (+ 4381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:46:55.492891 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:46:55.492896 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:46:55.492947 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:46:55.495941 (+ 2994us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:46:55.497470 (+ 1529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:46:55.497476 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:46:55.497479 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:46:55.497640 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:46:55.498355 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:46:55.498361 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:46:55.498363 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:46:55.498734 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:46:55.498895 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 18:46:55.500049 (+ 1154us) server_negotiation.cc:299] Negotiation successful
0811 18:46:55.500395 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":245,"threads_started":1}
I20260811 18:46:55.502132 26113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:46:55.479046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40319 (local address 127.25.25.1:53531)
0811 18:46:55.479932 (+ 886us) negotiation.cc:107] Waiting for socket to connect
0811 18:46:55.479984 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 18:46:55.481860 (+ 1876us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:46:55.482701 (+ 841us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:46:55.482713 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:46:55.483412 (+ 699us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:46:55.484163 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:46:55.484198 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:46:55.485613 (+ 1415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:46:55.485619 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:46:55.487310 (+ 1691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:46:55.487334 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:46:55.488627 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:46:55.488633 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:46:55.488879 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:46:55.489631 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:46:55.489658 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:46:55.492549 (+ 2891us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:46:55.496213 (+ 3664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:46:55.496227 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:46:55.496250 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:46:55.497248 (+ 998us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:46:55.497783 (+ 535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:46:55.497788 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:46:55.497792 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:46:55.498156 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:46:55.498902 (+ 746us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:46:55.498911 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:46:55.499479 (+ 568us) client_negotiation.cc:769] Sending connection context
0811 18:46:55.499858 (+ 379us) client_negotiation.cc:240] Negotiation successful
0811 18:46:55.500529 (+ 671us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":375,"threads_started":1}
I20260811 18:46:55.504199 26108 heartbeater.cc:347] Connected to a master server at 127.25.25.62:40319
I20260811 18:46:55.504623 26108 heartbeater.cc:464] Registering TS with master...
I20260811 18:46:55.505826 26108 heartbeater.cc:511] Master 127.25.25.62:40319 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.25.25.2@KRBTEST.COM; defaulting to no policy
I20260811 18:46:55.508718 25792 ts_manager.cc:194] Registered new tserver with Master: 4dc390cdc5724988bd991ede566d2cbe (127.25.25.1:33893)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.2@KRBTEST.COM" created.
I20260811 18:46:55.510581 25792 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.1@KRBTEST.COM'} at 127.25.25.1:53531
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
I20260811 18:46:55.536247 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:0
--local_ip_for_outbound_sockets=127.25.25.2
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:40319
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:40989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:46:55.899974 26123 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:46:55.900373 26123 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:46:55.900538 26123 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:46:55.908844 26123 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:46:55.909014 26123 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:46:55.909214 26123 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:46:55.920063 26123 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:40319
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:46:55.921514 26123 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:46:55.923007 26123 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:46:55.937194 26131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:46:55.937170 26134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:46:55.937091 26130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:46:55.938120 26123 server_base.cc:1034] running on GCE node
I20260811 18:46:55.938841 26123 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:46:55.939944 26123 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:46:55.941169 26123 hybrid_clock.cc:648] HybridClock initialized: now 1786474015941122 us; error 64 us; skew 500 ppm
I20260811 18:46:55.941525 26123 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:46:55 dist-test-slave-lgr5 krb5kdc[25712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474015, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:46:55.945041 26123 init.cc:377] Logged in from keytab as kudu/127.25.25.2@KRBTEST.COM (short username kudu)
I20260811 18:46:55.946859 26123 webserver.cc:460] Webserver started at http://127.25.25.2:42473/ using document root <none> and password file <none>
I20260811 18:46:55.947639 26123 fs_manager.cc:359] Metadata directory not provided
I20260811 18:46:55.947781 26123 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:46:55.948186 26123 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:46:55.951540 26123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-1/data/instance:
uuid: "4203f2740cd74c84a21f1e4d58897e83"
format_stamp: "Formatted at 2026-08-11 18:46:55 on dist-test-slave-lgr5"
server_key: "0353b8751e4bfb3c41df4d9662a39fc8"
server_key_iv: "0a0a841d9a6fdfa3fb2a8376d38f2f99"
server_key_version: "encryptionkey@0"
I20260811 18:46:55.952491 26123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance:
uuid: "4203f2740cd74c84a21f1e4d58897e83"
format_stamp: "Formatted at 2026-08-11 18:46:55 on dist-test-slave-lgr5"
server_key: "0353b8751e4bfb3c41df4d9662a39fc8"
server_key_iv: "0a0a841d9a6fdfa3fb2a8376d38f2f99"
server_key_version: "encryptionkey@0"
I20260811 18:46:55.958457 26123 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.005s
I20260811 18:46:55.962657 26144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:46:55.964238 26123 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 18:46:55.964452 26123 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "4203f2740cd74c84a21f1e4d58897e83"
format_stamp: "Formatted at 2026-08-11 18:46:55 on dist-test-slave-lgr5"
server_key: "0353b8751e4bfb3c41df4d9662a39fc8"
server_key_iv: "0a0a841d9a6fdfa3fb2a8376d38f2f99"
server_key_version: "encryptionkey@0"
I20260811 18:46:55.964673 26123 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:46:55.977607 26123 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:46:55.982959 26123 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:46:55.983276 26123 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:46:55.984465 26123 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:46:55.986137 26123 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:46:55.986227 26123 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:46:55.986353 26123 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:46:55.986407 26123 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:46:56.020753 26123 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:38703
I20260811 18:46:56.020812 26327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:38703 every 8 connection(s)
I20260811 18:46:56.022135 26123 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:46:56.027664 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 26123
I20260811 18:46:56.027878 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance
I20260811 18:46:56.028352 25700 external_mini_cluster.cc:1428] Setting key 2979925f3461d1166bf567bc4889b5e2
Aug 11 18:46:56 dist-test-slave-lgr5 krb5kdc[25712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474015, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:46:56.044059 26330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:46:56.024921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:36355 (local address 127.25.25.62:40319)
0811 18:46:56.025375 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0811 18:46:56.025379 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:46:56.026375 (+ 996us) server_negotiation.cc:407] Connection header received
0811 18:46:56.028373 (+ 1998us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:46:56.028379 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:46:56.028625 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:46:56.028722 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:46:56.030579 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:46:56.031342 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:46:56.033084 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:46:56.033539 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:46:56.033654 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:46:56.037450 (+ 3796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:46:56.037455 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:46:56.037459 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:46:56.037496 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:46:56.040343 (+ 2847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:46:56.041436 (+ 1093us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:46:56.041444 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:46:56.041447 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:46:56.041596 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:46:56.042133 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:46:56.042137 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:46:56.042140 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:46:56.042473 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:46:56.042605 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 18:46:56.043576 (+ 971us) server_negotiation.cc:299] Negotiation successful
0811 18:46:56.043775 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":240,"threads_started":1}
I20260811 18:46:56.045662 26332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:46:56.025401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40319 (local address 127.25.25.2:36355)
0811 18:46:56.026162 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0811 18:46:56.026216 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 18:46:56.028034 (+ 1818us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:46:56.029048 (+ 1014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:46:56.029061 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:46:56.029664 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:46:56.030393 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:46:56.030423 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:46:56.031496 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:46:56.031502 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:46:56.032924 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:46:56.032944 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:46:56.033783 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:46:56.033791 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:46:56.034043 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:46:56.034744 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:46:56.034769 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:46:56.037194 (+ 2425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:46:56.040536 (+ 3342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:46:56.040548 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:46:56.040569 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:46:56.041243 (+ 674us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:46:56.041722 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:46:56.041727 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:46:56.041729 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:46:56.042001 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:46:56.042602 (+ 601us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:46:56.042610 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:46:56.043139 (+ 529us) client_negotiation.cc:769] Sending connection context
0811 18:46:56.043478 (+ 339us) client_negotiation.cc:240] Negotiation successful
0811 18:46:56.044075 (+ 597us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":310,"threads_started":1}
I20260811 18:46:56.047629 26328 heartbeater.cc:347] Connected to a master server at 127.25.25.62:40319
I20260811 18:46:56.048019 26328 heartbeater.cc:464] Registering TS with master...
I20260811 18:46:56.048873 26328 heartbeater.cc:511] Master 127.25.25.62:40319 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.25.25.3@KRBTEST.COM; defaulting to no policy
I20260811 18:46:56.050724 25792 ts_manager.cc:194] Registered new tserver with Master: 4203f2740cd74c84a21f1e4d58897e83 (127.25.25.2:38703)
I20260811 18:46:56.051577 25792 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.2@KRBTEST.COM'} at 127.25.25.2:36355
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
I20260811 18:46:56.079566 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:0
--local_ip_for_outbound_sockets=127.25.25.3
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:40319
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:40989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:46:56.455720 26335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:46:56.456064 26335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:46:56.456233 26335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:46:56.464268 26335 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:46:56.464408 26335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:46:56.464586 26335 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:46:56.475378 26335 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:40319
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:46:56.476877 26335 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:46:56.478240 26335 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:46:56.492632 26342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:46:56.492656 26349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:46:56.492601 26355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:46:56.493177 26335 server_base.cc:1034] running on GCE node
I20260811 18:46:56.494069 26335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:46:56.495151 26335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:46:56.496358 26335 hybrid_clock.cc:648] HybridClock initialized: now 1786474016496272 us; error 73 us; skew 500 ppm
I20260811 18:46:56.496683 26335 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:46:56 dist-test-slave-lgr5 krb5kdc[25712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474016, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:46:56.500012 26335 init.cc:377] Logged in from keytab as kudu/127.25.25.3@KRBTEST.COM (short username kudu)
I20260811 18:46:56.501717 26335 webserver.cc:460] Webserver started at http://127.25.25.3:43481/ using document root <none> and password file <none>
I20260811 18:46:56.502460 26335 fs_manager.cc:359] Metadata directory not provided
I20260811 18:46:56.502605 26335 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:46:56.502942 26335 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:46:56.506275 26335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-2/data/instance:
uuid: "0b5139d294104624ae17d6056f3824f0"
format_stamp: "Formatted at 2026-08-11 18:46:56 on dist-test-slave-lgr5"
server_key: "43287f41cc2d212682eb0a906c7b538a"
server_key_iv: "d4c3f75716bb7149f74eb3f6b6a9be8d"
server_key_version: "encryptionkey@0"
I20260811 18:46:56.507123 26335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance:
uuid: "0b5139d294104624ae17d6056f3824f0"
format_stamp: "Formatted at 2026-08-11 18:46:56 on dist-test-slave-lgr5"
server_key: "43287f41cc2d212682eb0a906c7b538a"
server_key_iv: "d4c3f75716bb7149f74eb3f6b6a9be8d"
server_key_version: "encryptionkey@0"
I20260811 18:46:56.512876 26335 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 18:46:56.513875 26108 heartbeater.cc:503] Master 127.25.25.62:40319 was elected leader, sending a full tablet report...
I20260811 18:46:56.517302 26370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:46:56.518939 26335 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260811 18:46:56.519162 26335 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "0b5139d294104624ae17d6056f3824f0"
format_stamp: "Formatted at 2026-08-11 18:46:56 on dist-test-slave-lgr5"
server_key: "43287f41cc2d212682eb0a906c7b538a"
server_key_iv: "d4c3f75716bb7149f74eb3f6b6a9be8d"
server_key_version: "encryptionkey@0"
I20260811 18:46:56.519414 26335 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:46:56.539222 26335 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:46:56.543766 26335 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:46:56.544142 26335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:46:56.545361 26335 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:46:56.547087 26335 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:46:56.547189 26335 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:46:56.547343 26335 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:46:56.547407 26335 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:46:56.588014 26335 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:40493
I20260811 18:46:56.588047 26559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:40493 every 8 connection(s)
I20260811 18:46:56.589605 26335 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:46:56.596539 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 26335
I20260811 18:46:56.596722 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance
I20260811 18:46:56.597143 25700 external_mini_cluster.cc:1428] Setting key 6902556be6070b0ca8c120ba465179a0
Aug 11 18:46:56 dist-test-slave-lgr5 krb5kdc[25712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474016, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:46:56.612314 26562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:46:56.592405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:50187 (local address 127.25.25.62:40319)
0811 18:46:56.592855 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0811 18:46:56.592860 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:46:56.594082 (+ 1222us) server_negotiation.cc:407] Connection header received
0811 18:46:56.596002 (+ 1920us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:46:56.596009 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:46:56.596126 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:46:56.596236 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:46:56.598295 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:46:56.599342 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:46:56.601816 (+ 2474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:46:56.602252 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:46:56.602352 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:46:56.606224 (+ 3872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:46:56.606229 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:46:56.606233 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:46:56.606271 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:46:56.608926 (+ 2655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:46:56.609804 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:46:56.609807 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:46:56.609810 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:46:56.609964 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:46:56.610439 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:46:56.610443 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:46:56.610445 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:46:56.610725 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:46:56.610856 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 18:46:56.611655 (+ 799us) server_negotiation.cc:299] Negotiation successful
0811 18:46:56.611876 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":206,"threads_started":1}
I20260811 18:46:56.613508 26563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:46:56.593077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40319 (local address 127.25.25.3:50187)
0811 18:46:56.593897 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0811 18:46:56.593938 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 18:46:56.595702 (+ 1764us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:46:56.596562 (+ 860us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:46:56.596571 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:46:56.597243 (+ 672us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:46:56.598039 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:46:56.598073 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:46:56.599556 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:46:56.599561 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:46:56.601660 (+ 2099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:46:56.601678 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:46:56.602537 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:46:56.602543 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:46:56.602774 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:46:56.603443 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:46:56.603476 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:46:56.605973 (+ 2497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:46:56.609110 (+ 3137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:46:56.609121 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:46:56.609137 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:46:56.609697 (+ 560us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:46:56.610076 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:46:56.610079 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:46:56.610082 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:46:56.610351 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:46:56.610879 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:46:56.610886 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:46:56.611283 (+ 397us) client_negotiation.cc:769] Sending connection context
0811 18:46:56.611595 (+ 312us) client_negotiation.cc:240] Negotiation successful
0811 18:46:56.612037 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":338,"threads_started":1}
I20260811 18:46:56.614920 26560 heartbeater.cc:347] Connected to a master server at 127.25.25.62:40319
I20260811 18:46:56.615272 26560 heartbeater.cc:464] Registering TS with master...
I20260811 18:46:56.616186 26560 heartbeater.cc:511] Master 127.25.25.62:40319 requested a full tablet report, sending...
I20260811 18:46:56.617688 25792 ts_manager.cc:194] Registered new tserver with Master: 0b5139d294104624ae17d6056f3824f0 (127.25.25.3:40493)
I20260811 18:46:56.618530 25792 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.3@KRBTEST.COM'} at 127.25.25.3:50187
I20260811 18:46:56.627272 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 18:46:56 dist-test-slave-lgr5 krb5kdc[25712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474016, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 18:46:56 dist-test-slave-lgr5 krb5kdc[25712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474016, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.25.1@KRBTEST.COM
I20260811 18:46:56.681249 26570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:46:56.663954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44800 (local address 127.25.25.1:33893)
0811 18:46:56.664644 (+ 690us) server_negotiation.cc:206] Beginning negotiation
0811 18:46:56.664651 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:46:56.664681 (+ 30us) server_negotiation.cc:407] Connection header received
0811 18:46:56.664831 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:46:56.664838 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:46:56.665094 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:46:56.665231 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:46:56.666948 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:46:56.668288 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:46:56.669820 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:46:56.670410 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:46:56.670534 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:46:56.674796 (+ 4262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:46:56.674814 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:46:56.674841 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:46:56.674896 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:46:56.678121 (+ 3225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:46:56.678925 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:46:56.678935 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:46:56.678937 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:46:56.679099 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:46:56.679525 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:46:56.679530 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:46:56.679532 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:46:56.679937 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:46:56.680293 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0811 18:46:56.680594 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 18:46:56.680891 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":537,"thread_start_us":370,"threads_started":1}
W20260811 18:46:56.682667 25960 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44800
Aug 11 18:46:56 dist-test-slave-lgr5 krb5kdc[25712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474016, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 18:46:56 dist-test-slave-lgr5 krb5kdc[25712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474016, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.1@KRBTEST.COM
I20260811 18:46:56.732580 26570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:46:56.718248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44808 (local address 127.25.25.1:33893)
0811 18:46:56.718507 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 18:46:56.718515 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:46:56.718752 (+ 237us) server_negotiation.cc:407] Connection header received
0811 18:46:56.718911 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:46:56.718916 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:46:56.719014 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:46:56.719114 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:46:56.720607 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:46:56.721432 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:46:56.722785 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:46:56.723228 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:46:56.723332 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:46:56.727399 (+ 4067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:46:56.727405 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:46:56.727408 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:46:56.727453 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:46:56.730185 (+ 2732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:46:56.730854 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:46:56.730857 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:46:56.730860 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:46:56.730993 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:46:56.731285 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:46:56.731288 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:46:56.731290 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:46:56.731563 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:46:56.731753 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 18:46:56.732075 (+ 322us) server_negotiation.cc:299] Negotiation successful
0811 18:46:56.732323 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260811 18:46:56.734473 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 25892
I20260811 18:46:56.748231 26570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:46:56.735498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44824 (local address 127.25.25.1:33893)
0811 18:46:56.735656 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 18:46:56.735661 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:46:56.736135 (+ 474us) server_negotiation.cc:407] Connection header received
0811 18:46:56.736302 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:46:56.736306 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:46:56.736373 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:46:56.736452 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:46:56.737795 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:46:56.738593 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:46:56.740058 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:46:56.740599 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:46:56.740700 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:46:56.743123 (+ 2423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:46:56.743128 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:46:56.743131 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:46:56.743163 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:46:56.745806 (+ 2643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:46:56.746480 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:46:56.746483 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:46:56.746486 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:46:56.746652 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:46:56.746974 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:46:56.746977 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:46:56.746979 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:46:56.747238 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:46:56.747423 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 18:46:56.747682 (+ 259us) server_negotiation.cc:299] Negotiation successful
0811 18:46:56.747890 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 18:46:56.749075 26099 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:46:56.845073 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 25892
I20260811 18:46:56.873090 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 26123
Aug 11 18:46:56 dist-test-slave-lgr5 krb5kdc[25712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474016, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.2@KRBTEST.COM
I20260811 18:46:56.890394 26585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:46:56.874150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52176 (local address 127.25.25.2:38703)
0811 18:46:56.874788 (+ 638us) server_negotiation.cc:206] Beginning negotiation
0811 18:46:56.874795 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:46:56.874822 (+ 27us) server_negotiation.cc:407] Connection header received
0811 18:46:56.874887 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:46:56.874893 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:46:56.875165 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:46:56.875302 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:46:56.876718 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:46:56.877877 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:46:56.879178 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:46:56.879768 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:46:56.879888 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:46:56.884274 (+ 4386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:46:56.884291 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:46:56.884309 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:46:56.884360 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:46:56.887430 (+ 3070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:46:56.888328 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:46:56.888338 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:46:56.888340 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:46:56.888480 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:46:56.888808 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:46:56.888811 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:46:56.888813 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:46:56.889196 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:46:56.889446 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0811 18:46:56.889792 (+ 346us) server_negotiation.cc:299] Negotiation successful
0811 18:46:56.890043 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":492,"thread_start_us":346,"threads_started":1}
I20260811 18:46:56.891749 26319 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:46:56.976187 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 26123
I20260811 18:46:57.003027 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 26335
Aug 11 18:46:57 dist-test-slave-lgr5 krb5kdc[25712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474016, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.3@KRBTEST.COM
I20260811 18:46:57.021137 26589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:46:57.004301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35994 (local address 127.25.25.3:40493)
0811 18:46:57.005041 (+ 740us) server_negotiation.cc:206] Beginning negotiation
0811 18:46:57.005049 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:46:57.005082 (+ 33us) server_negotiation.cc:407] Connection header received
0811 18:46:57.005151 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:46:57.005157 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:46:57.005367 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:46:57.005508 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:46:57.006837 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:46:57.007970 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:46:57.009437 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:46:57.010040 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:46:57.010144 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:46:57.014954 (+ 4810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:46:57.014972 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:46:57.014989 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:46:57.015045 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:46:57.018122 (+ 3077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:46:57.018958 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:46:57.018968 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:46:57.018971 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:46:57.019120 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:46:57.019516 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:46:57.019519 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:46:57.019520 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:46:57.019886 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:46:57.020203 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0811 18:46:57.020518 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 18:46:57.020737 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":558,"thread_start_us":398,"threads_started":1}
I20260811 18:46:57.022606 26554 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:46:57.107877 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 26335
I20260811 18:46:57.135138 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 25735
I20260811 18:46:57.136458 25837 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:46:57.243402 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 25735
2026-08-11T18:46:57Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4480 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:46:57 dist-test-slave-lgr5 krb5kdc[26596](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:46:57 dist-test-slave-lgr5 krb5kdc[26596](info): set up 2 sockets
Aug 11 18:46:57 dist-test-slave-lgr5 krb5kdc[26596](info): commencing operation
krb5kdc: starting...
W20260811 18:46:58.507630 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.215s user 0.001s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:46:58 dist-test-slave-lgr5 krb5kdc[26596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:46:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:46:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:46:58.717555 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:38019
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:36981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:38019
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:46:59.062268 26616 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:46:59.062641 26616 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:46:59.062785 26616 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:46:59.070736 26616 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:46:59.070883 26616 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:46:59.070966 26616 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:46:59.071050 26616 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:46:59.071115 26616 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:46:59.082088 26616 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:36981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:38019
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:38019
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:46:59.083638 26616 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:46:59.085155 26616 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:46:59.097901 26622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:46:59.098060 26625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:46:59.098062 26623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:46:59.099336 26616 server_base.cc:1034] running on GCE node
I20260811 18:46:59.100400 26616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:46:59.102069 26616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:46:59.103322 26616 hybrid_clock.cc:648] HybridClock initialized: now 1786474019103260 us; error 36 us; skew 500 ppm
I20260811 18:46:59.103719 26616 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:46:59 dist-test-slave-lgr5 krb5kdc[26596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474019, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:46:59.110819 26616 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:46:59.112679 26616 webserver.cc:460] Webserver started at http://127.25.25.62:44577/ using document root <none> and password file <none>
I20260811 18:46:59.113483 26616 fs_manager.cc:359] Metadata directory not provided
I20260811 18:46:59.113608 26616 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:46:59.113961 26616 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:46:59.117305 26616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "3d667f41362a46bd9804c8842c960756"
format_stamp: "Formatted at 2026-08-11 18:46:59 on dist-test-slave-lgr5"
server_key: "02c6a9c5f37c9088e2c5bd06a0ee112e"
server_key_iv: "f0eefc3d81b7b82e2c459e7fa2402840"
server_key_version: "encryptionkey@0"
I20260811 18:46:59.118149 26616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "3d667f41362a46bd9804c8842c960756"
format_stamp: "Formatted at 2026-08-11 18:46:59 on dist-test-slave-lgr5"
server_key: "02c6a9c5f37c9088e2c5bd06a0ee112e"
server_key_iv: "f0eefc3d81b7b82e2c459e7fa2402840"
server_key_version: "encryptionkey@0"
I20260811 18:46:59.123731 26616 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 18:46:59.127877 26640 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:46:59.129328 26616 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260811 18:46:59.129514 26616 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "3d667f41362a46bd9804c8842c960756"
format_stamp: "Formatted at 2026-08-11 18:46:59 on dist-test-slave-lgr5"
server_key: "02c6a9c5f37c9088e2c5bd06a0ee112e"
server_key_iv: "f0eefc3d81b7b82e2c459e7fa2402840"
server_key_version: "encryptionkey@0"
I20260811 18:46:59.129715 26616 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:46:59.157758 26616 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:46:59.162361 26616 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:46:59.162657 26616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:46:59.181798 26616 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:38019
I20260811 18:46:59.181854 26737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:38019 every 8 connection(s)
I20260811 18:46:59.183302 26616 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:46:59.187399 26738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:46:59.188788 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 26616
I20260811 18:46:59.189030 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:46:59.189683 25700 external_mini_cluster.cc:1428] Setting key 28ec83efd956baa2c8ef972c8ac43b04
I20260811 18:46:59.202394 26738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d667f41362a46bd9804c8842c960756: Bootstrap starting.
Aug 11 18:46:59 dist-test-slave-lgr5 krb5kdc[26596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:46:59.206099 26738 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d667f41362a46bd9804c8842c960756: Neither blocks nor log segments found. Creating new log.
I20260811 18:46:59.207285 26738 log.cc:824] T 00000000000000000000000000000000 P 3d667f41362a46bd9804c8842c960756: Log is configured to *not* fsync() on all Append() calls
I20260811 18:46:59.210512 26738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d667f41362a46bd9804c8842c960756: No bootstrap required, opened a new log
I20260811 18:46:59.213986 26743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:46:59.191765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48862 (local address 127.25.25.62:38019)
0811 18:46:59.192660 (+ 895us) server_negotiation.cc:206] Beginning negotiation
0811 18:46:59.192672 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:46:59.192718 (+ 46us) server_negotiation.cc:407] Connection header received
0811 18:46:59.194401 (+ 1683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:46:59.194430 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:46:59.194885 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:46:59.195288 (+ 403us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:46:59.197348 (+ 2060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:46:59.198954 (+ 1606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:46:59.200866 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:46:59.201656 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:46:59.201812 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:46:59.206313 (+ 4501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:46:59.206324 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:46:59.206343 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:46:59.206395 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:46:59.209515 (+ 3120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:46:59.210294 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:46:59.210301 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:46:59.210308 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:46:59.210495 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:46:59.210898 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:46:59.210902 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:46:59.210904 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:46:59.211498 (+ 594us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:46:59.211807 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0811 18:46:59.212419 (+ 612us) server_negotiation.cc:299] Negotiation successful
0811 18:46:59.212854 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":677,"thread_start_us":397,"threads_started":1}
I20260811 18:46:59.218840 26738 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d667f41362a46bd9804c8842c960756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d667f41362a46bd9804c8842c960756" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38019 } }
I20260811 18:46:59.219287 26738 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3d667f41362a46bd9804c8842c960756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:46:59.219390 26738 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d667f41362a46bd9804c8842c960756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d667f41362a46bd9804c8842c960756, State: Initialized, Role: FOLLOWER
I20260811 18:46:59.219981 26738 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d667f41362a46bd9804c8842c960756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d667f41362a46bd9804c8842c960756" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38019 } }
I20260811 18:46:59.220288 26738 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3d667f41362a46bd9804c8842c960756 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:46:59.220420 26738 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d667f41362a46bd9804c8842c960756 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:46:59.220598 26738 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d667f41362a46bd9804c8842c960756 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:46:59.223100 26738 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d667f41362a46bd9804c8842c960756 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d667f41362a46bd9804c8842c960756" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38019 } }
I20260811 18:46:59.223774 26738 leader_election.cc:302] T 00000000000000000000000000000000 P 3d667f41362a46bd9804c8842c960756 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d667f41362a46bd9804c8842c960756; no voters:
I20260811 18:46:59.224555 26738 leader_election.cc:288] T 00000000000000000000000000000000 P 3d667f41362a46bd9804c8842c960756 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:46:59.224666 26745 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3d667f41362a46bd9804c8842c960756 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:46:59.225292 26745 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3d667f41362a46bd9804c8842c960756 [term 1 LEADER]: Becoming Leader. State: Replica: 3d667f41362a46bd9804c8842c960756, State: Running, Role: LEADER
I20260811 18:46:59.225879 26745 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d667f41362a46bd9804c8842c960756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d667f41362a46bd9804c8842c960756" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38019 } }
I20260811 18:46:59.226751 26738 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d667f41362a46bd9804c8842c960756 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:46:59.228996 26746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d667f41362a46bd9804c8842c960756 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3d667f41362a46bd9804c8842c960756" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d667f41362a46bd9804c8842c960756" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38019 } } }
I20260811 18:46:59.229461 26746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d667f41362a46bd9804c8842c960756 [sys.catalog]: This master's current role is: LEADER
I20260811 18:46:59.229199 26747 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d667f41362a46bd9804c8842c960756 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d667f41362a46bd9804c8842c960756. Latest consensus state: current_term: 1 leader_uuid: "3d667f41362a46bd9804c8842c960756" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d667f41362a46bd9804c8842c960756" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38019 } } }
I20260811 18:46:59.229741 26747 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d667f41362a46bd9804c8842c960756 [sys.catalog]: This master's current role is: LEADER
I20260811 18:46:59.231159 26754 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:46:59.236891 26754 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:46:59.246572 26754 catalog_manager.cc:1347] Generated new cluster ID: ff3e5a476d43435fbcd7d33fea81f818
I20260811 18:46:59.246718 26754 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:46:59.263232 26754 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:46:59.265264 26754 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:46:59.280879 26754 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3d667f41362a46bd9804c8842c960756: Generated new TSK 0
I20260811 18:46:59.282191 26754 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.25.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
I20260811 18:46:59.344534 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:0
--local_ip_for_outbound_sockets=127.25.25.1
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38019
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:36981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:46:59.709946 26785 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:46:59.710273 26785 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:46:59.710418 26785 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:46:59.718477 26785 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:46:59.718638 26785 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:46:59.718798 26785 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:46:59.729423 26785 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:36981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38019
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:46:59.730917 26785 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:46:59.732543 26785 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:46:59.746910 26792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:46:59.746976 26796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:46:59.746958 26793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:46:59.747892 26785 server_base.cc:1034] running on GCE node
I20260811 18:46:59.748651 26785 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:46:59.749686 26785 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:46:59.750900 26785 hybrid_clock.cc:648] HybridClock initialized: now 1786474019750843 us; error 54 us; skew 500 ppm
I20260811 18:46:59.751237 26785 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:46:59 dist-test-slave-lgr5 krb5kdc[26596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474019, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:46:59.754698 26785 init.cc:377] Logged in from keytab as kudu/127.25.25.1@KRBTEST.COM (short username kudu)
I20260811 18:46:59.756395 26785 webserver.cc:460] Webserver started at http://127.25.25.1:35633/ using document root <none> and password file <none>
I20260811 18:46:59.757195 26785 fs_manager.cc:359] Metadata directory not provided
I20260811 18:46:59.757331 26785 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:46:59.757681 26785 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:46:59.761168 26785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-0/data/instance:
uuid: "d5358b1532574eb9969af33435db67cb"
format_stamp: "Formatted at 2026-08-11 18:46:59 on dist-test-slave-lgr5"
server_key: "8653c2c257fdaa99f3a6338467a1f1b1"
server_key_iv: "f7522d8ddab1e9d4dba0314cb6e98ca3"
server_key_version: "encryptionkey@0"
I20260811 18:46:59.762115 26785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance:
uuid: "d5358b1532574eb9969af33435db67cb"
format_stamp: "Formatted at 2026-08-11 18:46:59 on dist-test-slave-lgr5"
server_key: "8653c2c257fdaa99f3a6338467a1f1b1"
server_key_iv: "f7522d8ddab1e9d4dba0314cb6e98ca3"
server_key_version: "encryptionkey@0"
I20260811 18:46:59.768131 26785 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 18:46:59.772611 26804 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:46:59.774246 26785 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:46:59.774430 26785 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "d5358b1532574eb9969af33435db67cb"
format_stamp: "Formatted at 2026-08-11 18:46:59 on dist-test-slave-lgr5"
server_key: "8653c2c257fdaa99f3a6338467a1f1b1"
server_key_iv: "f7522d8ddab1e9d4dba0314cb6e98ca3"
server_key_version: "encryptionkey@0"
I20260811 18:46:59.774660 26785 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:46:59.787933 26785 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:46:59.792590 26785 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:46:59.792889 26785 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:46:59.793977 26785 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:46:59.795467 26785 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:46:59.795547 26785 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:46:59.795643 26785 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:46:59.795686 26785 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:46:59.830098 26785 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:36613
I20260811 18:46:59.830142 26998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:36613 every 8 connection(s)
I20260811 18:46:59.831564 26785 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:46:59.833534 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 26785
I20260811 18:46:59.833743 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance
I20260811 18:46:59.834441 25700 external_mini_cluster.cc:1428] Setting key ac79e8e87dd780b3d98c19ae4d8bdb9b
Aug 11 18:46:59 dist-test-slave-lgr5 krb5kdc[26596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474019, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.25.2@KRBTEST.COM; defaulting to no policy
I20260811 18:46:59.855690 27001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:46:59.835632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:40547 (local address 127.25.25.62:38019)
0811 18:46:59.836309 (+ 677us) server_negotiation.cc:206] Beginning negotiation
0811 18:46:59.836317 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:46:59.837664 (+ 1347us) server_negotiation.cc:407] Connection header received
0811 18:46:59.839727 (+ 2063us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:46:59.839733 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:46:59.839828 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:46:59.839927 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:46:59.841785 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:46:59.842553 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:46:59.844324 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:46:59.844742 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:46:59.844869 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:46:59.848978 (+ 4109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:46:59.848986 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:46:59.848990 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:46:59.849031 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:46:59.852016 (+ 2985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:46:59.852980 (+ 964us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:46:59.852985 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:46:59.852987 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:46:59.853133 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:46:59.853642 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:46:59.853646 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:46:59.853648 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:46:59.853951 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:46:59.854109 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 18:46:59.855158 (+ 1049us) server_negotiation.cc:299] Negotiation successful
0811 18:46:59.855397 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":257,"threads_started":1}
I20260811 18:46:59.856842 27002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:46:59.836505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38019 (local address 127.25.25.1:40547)
0811 18:46:59.837461 (+ 956us) negotiation.cc:107] Waiting for socket to connect
0811 18:46:59.837535 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0811 18:46:59.839385 (+ 1850us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:46:59.840267 (+ 882us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:46:59.840277 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:46:59.840876 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:46:59.841566 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:46:59.841590 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:46:59.842733 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:46:59.842737 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:46:59.844154 (+ 1417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:46:59.844172 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:46:59.845010 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:46:59.845019 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:46:59.845276 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:46:59.846043 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:46:59.846068 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:46:59.848690 (+ 2622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:46:59.852240 (+ 3550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:46:59.852251 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:46:59.852268 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:46:59.852806 (+ 538us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:46:59.853261 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:46:59.853265 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:46:59.853268 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:46:59.853513 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:46:59.854146 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:46:59.854157 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:46:59.854628 (+ 471us) client_negotiation.cc:769] Sending connection context
0811 18:46:59.854941 (+ 313us) client_negotiation.cc:240] Negotiation successful
0811 18:46:59.855480 (+ 539us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":670,"thread_start_us":410,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.2@KRBTEST.COM" created.
I20260811 18:46:59.858690 26999 heartbeater.cc:347] Connected to a master server at 127.25.25.62:38019
I20260811 18:46:59.859087 26999 heartbeater.cc:464] Registering TS with master...
I20260811 18:46:59.859875 26999 heartbeater.cc:511] Master 127.25.25.62:38019 requested a full tablet report, sending...
I20260811 18:46:59.862291 26675 ts_manager.cc:194] Registered new tserver with Master: d5358b1532574eb9969af33435db67cb (127.25.25.1:36613)
I20260811 18:46:59.864364 26675 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.1@KRBTEST.COM'} at 127.25.25.1:40547
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
I20260811 18:46:59.883942 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:0
--local_ip_for_outbound_sockets=127.25.25.2
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38019
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:36981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:00.248222 27008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:00.248585 27008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:00.248737 27008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:00.256814 27008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:00.257011 27008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:00.257206 27008 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:47:00.268052 27008 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:36981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38019
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:00.269659 27008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:00.271184 27008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:00.287017 27019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:00.287050 27020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:00.286998 27026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:00.288054 27008 server_base.cc:1034] running on GCE node
I20260811 18:47:00.288825 27008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:00.289942 27008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:00.291208 27008 hybrid_clock.cc:648] HybridClock initialized: now 1786474020291143 us; error 54 us; skew 500 ppm
I20260811 18:47:00.291596 27008 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:00 dist-test-slave-lgr5 krb5kdc[26596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474020, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:00.295274 27008 init.cc:377] Logged in from keytab as kudu/127.25.25.2@KRBTEST.COM (short username kudu)
I20260811 18:47:00.297191 27008 webserver.cc:460] Webserver started at http://127.25.25.2:32789/ using document root <none> and password file <none>
I20260811 18:47:00.297951 27008 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:00.298066 27008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:00.298360 27008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:00.301769 27008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-1/data/instance:
uuid: "19ea26258cb3491ebfc1e00001af44ff"
format_stamp: "Formatted at 2026-08-11 18:47:00 on dist-test-slave-lgr5"
server_key: "ebe5611ca716aa5a6564ee470e4817d0"
server_key_iv: "6c896e5a82db987d3b2e7eb02a28fc24"
server_key_version: "encryptionkey@0"
I20260811 18:47:00.302759 27008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance:
uuid: "19ea26258cb3491ebfc1e00001af44ff"
format_stamp: "Formatted at 2026-08-11 18:47:00 on dist-test-slave-lgr5"
server_key: "ebe5611ca716aa5a6564ee470e4817d0"
server_key_iv: "6c896e5a82db987d3b2e7eb02a28fc24"
server_key_version: "encryptionkey@0"
I20260811 18:47:00.309154 27008 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 18:47:00.313426 27036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:00.315102 27008 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260811 18:47:00.315297 27008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "19ea26258cb3491ebfc1e00001af44ff"
format_stamp: "Formatted at 2026-08-11 18:47:00 on dist-test-slave-lgr5"
server_key: "ebe5611ca716aa5a6564ee470e4817d0"
server_key_iv: "6c896e5a82db987d3b2e7eb02a28fc24"
server_key_version: "encryptionkey@0"
I20260811 18:47:00.315518 27008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:00.328424 27008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:00.333364 27008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:00.333668 27008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:00.334815 27008 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:47:00.336443 27008 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:00.336529 27008 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:00.336621 27008 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:00.336666 27008 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:00.371915 27008 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:45827
I20260811 18:47:00.371964 27238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:45827 every 8 connection(s)
I20260811 18:47:00.373425 27008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:47:00.375489 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 27008
I20260811 18:47:00.375698 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance
I20260811 18:47:00.376154 25700 external_mini_cluster.cc:1428] Setting key c1cf4b368d3c80704f4ec46d24623dfa
Aug 11 18:47:00 dist-test-slave-lgr5 krb5kdc[26596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474020, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.25.3@KRBTEST.COM; defaulting to no policy
I20260811 18:47:00.398574 27244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:00.376403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:58905 (local address 127.25.25.62:38019)
0811 18:47:00.376889 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:00.376896 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:00.377908 (+ 1012us) server_negotiation.cc:407] Connection header received
0811 18:47:00.380571 (+ 2663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:00.380575 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:00.380648 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:00.380748 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:00.382964 (+ 2216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:00.383707 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:00.385897 (+ 2190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:00.386590 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:00.386732 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:00.390863 (+ 4131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:00.390871 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:00.390875 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:00.390923 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:00.394726 (+ 3803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:00.395726 (+ 1000us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:00.395733 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:00.395737 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:00.395912 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:00.396565 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:00.396571 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:00.396574 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:00.396952 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:00.397121 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:00.398036 (+ 915us) server_negotiation.cc:299] Negotiation successful
0811 18:47:00.398273 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":224,"threads_started":1}
I20260811 18:47:00.399808 27245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:00.376985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38019 (local address 127.25.25.2:58905)
0811 18:47:00.377738 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:00.377782 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:00.380223 (+ 2441us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:00.381058 (+ 835us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:00.381070 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:00.381850 (+ 780us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:00.382711 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:00.382740 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:00.383898 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:00.383903 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:00.385716 (+ 1813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:00.385736 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:00.386863 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:00.386869 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:00.387088 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:00.387897 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:00.387925 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:00.390548 (+ 2623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:00.394947 (+ 4399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:00.394959 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:00.394976 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:00.395560 (+ 584us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:00.396120 (+ 560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:00.396126 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:00.396130 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:00.396383 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:00.397148 (+ 765us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:00.397157 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:00.397608 (+ 451us) client_negotiation.cc:769] Sending connection context
0811 18:47:00.397873 (+ 265us) client_negotiation.cc:240] Negotiation successful
0811 18:47:00.398437 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":314,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.3@KRBTEST.COM" created.
I20260811 18:47:00.401592 27240 heartbeater.cc:347] Connected to a master server at 127.25.25.62:38019
I20260811 18:47:00.402002 27240 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:00.402983 27240 heartbeater.cc:511] Master 127.25.25.62:38019 requested a full tablet report, sending...
I20260811 18:47:00.404877 26675 ts_manager.cc:194] Registered new tserver with Master: 19ea26258cb3491ebfc1e00001af44ff (127.25.25.2:45827)
I20260811 18:47:00.405752 26675 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.2@KRBTEST.COM'} at 127.25.25.2:58905
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
I20260811 18:47:00.427263 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:0
--local_ip_for_outbound_sockets=127.25.25.3
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38019
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:36981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:00.781338 27250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:00.781687 27250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:00.781855 27250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:00.789933 27250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:00.790098 27250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:00.790345 27250 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:47:00.801337 27250 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:36981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38019
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:00.802886 27250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:00.804476 27250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:00.819024 27258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:00.819022 27263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:00.819018 27259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:00.820303 27250 server_base.cc:1034] running on GCE node
I20260811 18:47:00.821130 27250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:00.822247 27250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:00.823504 27250 hybrid_clock.cc:648] HybridClock initialized: now 1786474020823418 us; error 67 us; skew 500 ppm
I20260811 18:47:00.823904 27250 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:00 dist-test-slave-lgr5 krb5kdc[26596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474020, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:00.827509 27250 init.cc:377] Logged in from keytab as kudu/127.25.25.3@KRBTEST.COM (short username kudu)
I20260811 18:47:00.829397 27250 webserver.cc:460] Webserver started at http://127.25.25.3:44267/ using document root <none> and password file <none>
I20260811 18:47:00.830452 27250 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:00.830633 27250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:00.831085 27250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:00.835757 27250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-2/data/instance:
uuid: "e9d9ba317bff40d6a5be07697930f718"
format_stamp: "Formatted at 2026-08-11 18:47:00 on dist-test-slave-lgr5"
server_key: "8fbefa06424b87a09ff4e73aa3a12d8b"
server_key_iv: "323a11463bb2e08878e52dd549122316"
server_key_version: "encryptionkey@0"
I20260811 18:47:00.837031 27250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance:
uuid: "e9d9ba317bff40d6a5be07697930f718"
format_stamp: "Formatted at 2026-08-11 18:47:00 on dist-test-slave-lgr5"
server_key: "8fbefa06424b87a09ff4e73aa3a12d8b"
server_key_iv: "323a11463bb2e08878e52dd549122316"
server_key_version: "encryptionkey@0"
I20260811 18:47:00.843133 27250 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260811 18:47:00.847304 27274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:00.849043 27250 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 18:47:00.849242 27250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "e9d9ba317bff40d6a5be07697930f718"
format_stamp: "Formatted at 2026-08-11 18:47:00 on dist-test-slave-lgr5"
server_key: "8fbefa06424b87a09ff4e73aa3a12d8b"
server_key_iv: "323a11463bb2e08878e52dd549122316"
server_key_version: "encryptionkey@0"
I20260811 18:47:00.849490 27250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:00.867645 27250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:00.867780 26999 heartbeater.cc:503] Master 127.25.25.62:38019 was elected leader, sending a full tablet report...
I20260811 18:47:00.872912 27250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:00.873230 27250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:00.874306 27250 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:47:00.875902 27250 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:00.875988 27250 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:00.876154 27250 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:00.876214 27250 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:00.906967 27250 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:36023
I20260811 18:47:00.907011 27467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:36023 every 8 connection(s)
I20260811 18:47:00.908469 27250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:47:00.918828 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 27250
I20260811 18:47:00.919052 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance
I20260811 18:47:00.919504 25700 external_mini_cluster.cc:1428] Setting key a594d02c6861ad8ab5decd10898b07a1
Aug 11 18:47:00 dist-test-slave-lgr5 krb5kdc[26596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474020, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:00.929490 27470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:00.911321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:33589 (local address 127.25.25.62:38019)
0811 18:47:00.911783 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:00.911790 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:00.912982 (+ 1192us) server_negotiation.cc:407] Connection header received
0811 18:47:00.914996 (+ 2014us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:00.915003 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:00.915093 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:00.915197 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:00.916969 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:00.917777 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:00.919553 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:00.920000 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:00.920154 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:00.923879 (+ 3725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:00.923885 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:00.923888 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:00.923924 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:00.926435 (+ 2511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:00.927194 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:00.927198 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:00.927200 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:00.927317 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:00.927806 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:00.927816 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:00.927818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:00.928184 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:00.928327 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:00.928991 (+ 664us) server_negotiation.cc:299] Negotiation successful
0811 18:47:00.929183 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":207,"threads_started":1}
I20260811 18:47:00.930509 27475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:00.911950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38019 (local address 127.25.25.3:33589)
0811 18:47:00.912805 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:00.912845 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:00.914637 (+ 1792us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:00.915429 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:00.915470 (+ 41us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:00.916050 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:00.916766 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:00.916789 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:00.917932 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:00.917937 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:00.919381 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:00.919396 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:00.920286 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:00.920296 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:00.920538 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:00.921281 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:00.921307 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:00.923662 (+ 2355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:00.926595 (+ 2933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:00.926603 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:00.926618 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:00.927104 (+ 486us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:00.927438 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:00.927444 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:00.927448 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:00.927700 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:00.928295 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:00.928301 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:00.928649 (+ 348us) client_negotiation.cc:769] Sending connection context
0811 18:47:00.928887 (+ 238us) client_negotiation.cc:240] Negotiation successful
0811 18:47:00.929334 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":314,"threads_started":1}
I20260811 18:47:00.931979 27468 heartbeater.cc:347] Connected to a master server at 127.25.25.62:38019
I20260811 18:47:00.932320 27468 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:00.933137 27468 heartbeater.cc:511] Master 127.25.25.62:38019 requested a full tablet report, sending...
I20260811 18:47:00.934834 26675 ts_manager.cc:194] Registered new tserver with Master: e9d9ba317bff40d6a5be07697930f718 (127.25.25.3:36023)
I20260811 18:47:00.935761 26675 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.3@KRBTEST.COM'} at 127.25.25.3:33589
I20260811 18:47:00.947893 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:47:00.967623 27470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:00.954919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46558 (local address 127.25.25.62:38019)
0811 18:47:00.955149 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:00.955156 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:00.955615 (+ 459us) server_negotiation.cc:407] Connection header received
0811 18:47:00.955777 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:00.955781 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:00.955866 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:00.955976 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:00.957539 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:00.958285 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:00.959604 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:00.960053 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:00.960210 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:00.962531 (+ 2321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:00.962537 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:00.962540 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:00.962578 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:00.965153 (+ 2575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:00.965880 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:00.965884 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:00.965886 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:00.966024 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:00.966320 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:00.966324 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:00.966327 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:00.966664 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:00.966875 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:00.967199 (+ 324us) server_negotiation.cc:299] Negotiation successful
0811 18:47:00.967393 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 18:47:00.974834 26675 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46558:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:47:00.982682 26675 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:47:01.021708 27499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:00.997879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:45827 (local address 127.0.0.1:40296)
0811 18:47:01.012173 (+ 14294us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:01.012191 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:01.012296 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:01.013385 (+ 1089us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:01.013393 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:01.013437 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:01.013866 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:01.013880 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.015830 (+ 1950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.015834 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:01.018357 (+ 2523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:01.018374 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.020578 (+ 2204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.020585 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:01.020801 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:01.020856 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 18:47:01.021006 (+ 150us) client_negotiation.cc:240] Negotiation successful
0811 18:47:01.021223 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14142,"mutex_wait_us":1,"thread_start_us":13617,"threads_started":1}
I20260811 18:47:01.022310 27500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:00.997838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60724 (local address 127.25.25.1:36613)
0811 18:47:01.011051 (+ 13213us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:01.011064 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:01.013358 (+ 2294us) server_negotiation.cc:407] Connection header received
0811 18:47:01.013608 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:01.013616 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:01.013855 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:01.014054 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:01.014920 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.016536 (+ 1616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.019109 (+ 2573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.020642 (+ 1533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.020743 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:01.020970 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:01.021816 (+ 846us) server_negotiation.cc:299] Negotiation successful
0811 18:47:01.021995 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12926,"thread_start_us":13224,"threads_started":1}
I20260811 18:47:01.023027 27497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:00.997615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:36613 (local address 127.0.0.1:60724)
0811 18:47:01.011886 (+ 14271us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:01.011953 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:01.012237 (+ 284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:01.014315 (+ 2078us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:01.014319 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:01.014343 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:01.014728 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:01.014739 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.016697 (+ 1958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.016702 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:01.018869 (+ 2167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:01.018883 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.021159 (+ 2276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.021165 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:01.021331 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:01.021366 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 18:47:01.021464 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 18:47:01.021598 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13949,"mutex_wait_us":41,"thread_start_us":14276,"threads_started":1}
I20260811 18:47:01.023262 27501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:00.998187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40296 (local address 127.25.25.2:45827)
0811 18:47:01.011953 (+ 13766us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:01.011962 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:01.012456 (+ 494us) server_negotiation.cc:407] Connection header received
0811 18:47:01.012573 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:01.012581 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:01.012860 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:01.013073 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:01.014089 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.015669 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.018552 (+ 2883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.020063 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.020225 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:01.020448 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:01.022227 (+ 1779us) server_negotiation.cc:299] Negotiation successful
0811 18:47:01.022421 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13598,"thread_start_us":13500,"threads_started":1}
I20260811 18:47:01.027918 26885 tablet_service.cc:1467] Processing CreateTablet for tablet a72fa8edd89541bca29a49c3a5b4c362 (DEFAULT_TABLE table=test-table [id=9857ae1a2ddd4461820ce57fa1c33d8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:01.028683 27124 tablet_service.cc:1467] Processing CreateTablet for tablet a72fa8edd89541bca29a49c3a5b4c362 (DEFAULT_TABLE table=test-table [id=9857ae1a2ddd4461820ce57fa1c33d8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:01.029906 26885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a72fa8edd89541bca29a49c3a5b4c362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:01.030706 27124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a72fa8edd89541bca29a49c3a5b4c362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:01.031234 27499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:01.013737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:36023 (local address 127.0.0.1:56674)
0811 18:47:01.022872 (+ 9135us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:01.022895 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:01.023027 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:01.025590 (+ 2563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:01.025595 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:01.025625 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:01.025804 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:01.025817 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.027290 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.027295 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:01.028624 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:01.028638 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.030580 (+ 1942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.030584 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:01.030724 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:01.030751 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 18:47:01.030835 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 18:47:01.030989 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9026,"thread_start_us":10551,"threads_started":1}
I20260811 18:47:01.032014 27502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:01.013044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56674 (local address 127.25.25.3:36023)
0811 18:47:01.024916 (+ 11872us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:01.024926 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:01.024965 (+ 39us) server_negotiation.cc:407] Connection header received
0811 18:47:01.025085 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:01.025093 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:01.025356 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:01.025589 (+ 233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:01.025991 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.027141 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.028824 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.030159 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.030288 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:01.030483 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:01.031597 (+ 1114us) server_negotiation.cc:299] Negotiation successful
0811 18:47:01.031736 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10957,"thread_start_us":10780,"threads_started":1}
I20260811 18:47:01.035552 27355 tablet_service.cc:1467] Processing CreateTablet for tablet a72fa8edd89541bca29a49c3a5b4c362 (DEFAULT_TABLE table=test-table [id=9857ae1a2ddd4461820ce57fa1c33d8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:01.037220 27355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a72fa8edd89541bca29a49c3a5b4c362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:01.045711 27504 tablet_bootstrap.cc:492] T a72fa8edd89541bca29a49c3a5b4c362 P d5358b1532574eb9969af33435db67cb: Bootstrap starting.
I20260811 18:47:01.048017 27505 tablet_bootstrap.cc:492] T a72fa8edd89541bca29a49c3a5b4c362 P 19ea26258cb3491ebfc1e00001af44ff: Bootstrap starting.
I20260811 18:47:01.049722 27504 tablet_bootstrap.cc:654] T a72fa8edd89541bca29a49c3a5b4c362 P d5358b1532574eb9969af33435db67cb: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:01.050271 27506 tablet_bootstrap.cc:492] T a72fa8edd89541bca29a49c3a5b4c362 P e9d9ba317bff40d6a5be07697930f718: Bootstrap starting.
I20260811 18:47:01.051249 27504 log.cc:824] T a72fa8edd89541bca29a49c3a5b4c362 P d5358b1532574eb9969af33435db67cb: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:01.051442 27505 tablet_bootstrap.cc:654] T a72fa8edd89541bca29a49c3a5b4c362 P 19ea26258cb3491ebfc1e00001af44ff: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:01.052997 27505 log.cc:824] T a72fa8edd89541bca29a49c3a5b4c362 P 19ea26258cb3491ebfc1e00001af44ff: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:01.054877 27506 tablet_bootstrap.cc:654] T a72fa8edd89541bca29a49c3a5b4c362 P e9d9ba317bff40d6a5be07697930f718: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:01.055384 27504 tablet_bootstrap.cc:492] T a72fa8edd89541bca29a49c3a5b4c362 P d5358b1532574eb9969af33435db67cb: No bootstrap required, opened a new log
I20260811 18:47:01.055662 27504 ts_tablet_manager.cc:1397] T a72fa8edd89541bca29a49c3a5b4c362 P d5358b1532574eb9969af33435db67cb: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s
I20260811 18:47:01.056315 27506 log.cc:824] T a72fa8edd89541bca29a49c3a5b4c362 P e9d9ba317bff40d6a5be07697930f718: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:01.056962 27505 tablet_bootstrap.cc:492] T a72fa8edd89541bca29a49c3a5b4c362 P 19ea26258cb3491ebfc1e00001af44ff: No bootstrap required, opened a new log
I20260811 18:47:01.057304 27505 ts_tablet_manager.cc:1397] T a72fa8edd89541bca29a49c3a5b4c362 P 19ea26258cb3491ebfc1e00001af44ff: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260811 18:47:01.059537 27506 tablet_bootstrap.cc:492] T a72fa8edd89541bca29a49c3a5b4c362 P e9d9ba317bff40d6a5be07697930f718: No bootstrap required, opened a new log
I20260811 18:47:01.059818 27506 ts_tablet_manager.cc:1397] T a72fa8edd89541bca29a49c3a5b4c362 P e9d9ba317bff40d6a5be07697930f718: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260811 18:47:01.063416 27504 raft_consensus.cc:348] T a72fa8edd89541bca29a49c3a5b4c362 P d5358b1532574eb9969af33435db67cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5358b1532574eb9969af33435db67cb" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 36613 } } peers { permanent_uuid: "19ea26258cb3491ebfc1e00001af44ff" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45827 } } peers { permanent_uuid: "e9d9ba317bff40d6a5be07697930f718" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36023 } }
I20260811 18:47:01.064288 27504 raft_consensus.cc:374] T a72fa8edd89541bca29a49c3a5b4c362 P d5358b1532574eb9969af33435db67cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:01.064477 27504 raft_consensus.cc:729] T a72fa8edd89541bca29a49c3a5b4c362 P d5358b1532574eb9969af33435db67cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5358b1532574eb9969af33435db67cb, State: Initialized, Role: FOLLOWER
I20260811 18:47:01.065459 27504 consensus_queue.cc:260] T a72fa8edd89541bca29a49c3a5b4c362 P d5358b1532574eb9969af33435db67cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5358b1532574eb9969af33435db67cb" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 36613 } } peers { permanent_uuid: "19ea26258cb3491ebfc1e00001af44ff" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45827 } } peers { permanent_uuid: "e9d9ba317bff40d6a5be07697930f718" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36023 } }
I20260811 18:47:01.067461 27504 ts_tablet_manager.cc:1428] T a72fa8edd89541bca29a49c3a5b4c362 P d5358b1532574eb9969af33435db67cb: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260811 18:47:01.068068 27505 raft_consensus.cc:348] T a72fa8edd89541bca29a49c3a5b4c362 P 19ea26258cb3491ebfc1e00001af44ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5358b1532574eb9969af33435db67cb" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 36613 } } peers { permanent_uuid: "19ea26258cb3491ebfc1e00001af44ff" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45827 } } peers { permanent_uuid: "e9d9ba317bff40d6a5be07697930f718" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36023 } }
I20260811 18:47:01.068643 27505 raft_consensus.cc:374] T a72fa8edd89541bca29a49c3a5b4c362 P 19ea26258cb3491ebfc1e00001af44ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:01.068754 27505 raft_consensus.cc:729] T a72fa8edd89541bca29a49c3a5b4c362 P 19ea26258cb3491ebfc1e00001af44ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19ea26258cb3491ebfc1e00001af44ff, State: Initialized, Role: FOLLOWER
I20260811 18:47:01.069494 27505 consensus_queue.cc:260] T a72fa8edd89541bca29a49c3a5b4c362 P 19ea26258cb3491ebfc1e00001af44ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5358b1532574eb9969af33435db67cb" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 36613 } } peers { permanent_uuid: "19ea26258cb3491ebfc1e00001af44ff" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45827 } } peers { permanent_uuid: "e9d9ba317bff40d6a5be07697930f718" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36023 } }
I20260811 18:47:01.070822 27240 heartbeater.cc:503] Master 127.25.25.62:38019 was elected leader, sending a full tablet report...
I20260811 18:47:01.070772 27506 raft_consensus.cc:348] T a72fa8edd89541bca29a49c3a5b4c362 P e9d9ba317bff40d6a5be07697930f718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5358b1532574eb9969af33435db67cb" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 36613 } } peers { permanent_uuid: "19ea26258cb3491ebfc1e00001af44ff" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45827 } } peers { permanent_uuid: "e9d9ba317bff40d6a5be07697930f718" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36023 } }
I20260811 18:47:01.071307 27506 raft_consensus.cc:374] T a72fa8edd89541bca29a49c3a5b4c362 P e9d9ba317bff40d6a5be07697930f718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:01.071420 27506 raft_consensus.cc:729] T a72fa8edd89541bca29a49c3a5b4c362 P e9d9ba317bff40d6a5be07697930f718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9d9ba317bff40d6a5be07697930f718, State: Initialized, Role: FOLLOWER
I20260811 18:47:01.071594 27505 ts_tablet_manager.cc:1428] T a72fa8edd89541bca29a49c3a5b4c362 P 19ea26258cb3491ebfc1e00001af44ff: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260811 18:47:01.072129 27506 consensus_queue.cc:260] T a72fa8edd89541bca29a49c3a5b4c362 P e9d9ba317bff40d6a5be07697930f718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5358b1532574eb9969af33435db67cb" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 36613 } } peers { permanent_uuid: "19ea26258cb3491ebfc1e00001af44ff" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45827 } } peers { permanent_uuid: "e9d9ba317bff40d6a5be07697930f718" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36023 } }
I20260811 18:47:01.073441 27468 heartbeater.cc:503] Master 127.25.25.62:38019 was elected leader, sending a full tablet report...
I20260811 18:47:01.074178 27506 ts_tablet_manager.cc:1428] T a72fa8edd89541bca29a49c3a5b4c362 P e9d9ba317bff40d6a5be07697930f718: Time spent starting tablet: real 0.014s user 0.008s sys 0.007s
W20260811 18:47:01.084496 27000 tablet.cc:2369] T a72fa8edd89541bca29a49c3a5b4c362 P d5358b1532574eb9969af33435db67cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:47:01.108940 27517 raft_consensus.cc:482] T a72fa8edd89541bca29a49c3a5b4c362 P 19ea26258cb3491ebfc1e00001af44ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:47:01.109315 27517 raft_consensus.cc:504] T a72fa8edd89541bca29a49c3a5b4c362 P 19ea26258cb3491ebfc1e00001af44ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5358b1532574eb9969af33435db67cb" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 36613 } } peers { permanent_uuid: "19ea26258cb3491ebfc1e00001af44ff" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45827 } } peers { permanent_uuid: "e9d9ba317bff40d6a5be07697930f718" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36023 } }
I20260811 18:47:01.111166 27517 leader_election.cc:288] T a72fa8edd89541bca29a49c3a5b4c362 P 19ea26258cb3491ebfc1e00001af44ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5358b1532574eb9969af33435db67cb (127.25.25.1:36613), e9d9ba317bff40d6a5be07697930f718 (127.25.25.3:36023)
I20260811 18:47:01.120563 27502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:01.111792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:35585 (local address 127.25.25.3:36023)
0811 18:47:01.112009 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:01.112016 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:01.112671 (+ 655us) server_negotiation.cc:407] Connection header received
0811 18:47:01.112829 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:01.112833 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:01.112914 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:01.113035 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:01.113842 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.114915 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.118048 (+ 3133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.119346 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.119524 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:01.119642 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:01.120146 (+ 504us) server_negotiation.cc:299] Negotiation successful
0811 18:47:01.120299 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 18:47:01.120639 27500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:01.111708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:55573 (local address 127.25.25.1:36613)
0811 18:47:01.112170 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:01.112177 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:01.112477 (+ 300us) server_negotiation.cc:407] Connection header received
0811 18:47:01.112665 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:01.112671 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:01.112753 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:01.112850 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:01.113755 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.114879 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.118049 (+ 3170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.119323 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.119544 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:01.119642 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:01.120155 (+ 513us) server_negotiation.cc:299] Negotiation successful
0811 18:47:01.120299 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283}
I20260811 18:47:01.120931 27521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:01.111526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:36613 (local address 127.25.25.2:55573)
0811 18:47:01.112361 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:01.112377 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:01.112519 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:01.112876 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:01.112881 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:01.112907 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:01.113587 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:01.113604 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.115049 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.115055 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:01.117820 (+ 2765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:01.117844 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.119637 (+ 1793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.119644 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:01.119899 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:01.119981 (+ 82us) client_negotiation.cc:769] Sending connection context
0811 18:47:01.120099 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 18:47:01.120294 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":686,"mutex_wait_us":253,"spinlock_wait_cycles":29056,"thread_start_us":446,"threads_started":1}
I20260811 18:47:01.120954 27522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:01.111629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:36023 (local address 127.25.25.2:35585)
0811 18:47:01.112552 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:01.112567 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:01.112708 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:01.113065 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:01.113069 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:01.113102 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:01.113590 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:01.113603 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.115052 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.115056 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:01.117820 (+ 2764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:01.117848 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.119638 (+ 1790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.119644 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:01.119902 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:01.119976 (+ 74us) client_negotiation.cc:769] Sending connection context
0811 18:47:01.120101 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 18:47:01.120294 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":799,"mutex_wait_us":182,"thread_start_us":572,"threads_started":1}
I20260811 18:47:01.122123 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a72fa8edd89541bca29a49c3a5b4c362" candidate_uuid: "19ea26258cb3491ebfc1e00001af44ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5358b1532574eb9969af33435db67cb" is_pre_election: true
I20260811 18:47:01.122148 27388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a72fa8edd89541bca29a49c3a5b4c362" candidate_uuid: "19ea26258cb3491ebfc1e00001af44ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9d9ba317bff40d6a5be07697930f718" is_pre_election: true
I20260811 18:47:01.122690 26915 raft_consensus.cc:2454] T a72fa8edd89541bca29a49c3a5b4c362 P d5358b1532574eb9969af33435db67cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19ea26258cb3491ebfc1e00001af44ff in term 0.
I20260811 18:47:01.122869 27388 raft_consensus.cc:2454] T a72fa8edd89541bca29a49c3a5b4c362 P e9d9ba317bff40d6a5be07697930f718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19ea26258cb3491ebfc1e00001af44ff in term 0.
I20260811 18:47:01.123463 27037 leader_election.cc:302] T a72fa8edd89541bca29a49c3a5b4c362 P 19ea26258cb3491ebfc1e00001af44ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 19ea26258cb3491ebfc1e00001af44ff, d5358b1532574eb9969af33435db67cb, e9d9ba317bff40d6a5be07697930f718; no voters:
I20260811 18:47:01.124022 27517 raft_consensus.cc:2781] T a72fa8edd89541bca29a49c3a5b4c362 P 19ea26258cb3491ebfc1e00001af44ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:47:01.124224 27517 raft_consensus.cc:482] T a72fa8edd89541bca29a49c3a5b4c362 P 19ea26258cb3491ebfc1e00001af44ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:47:01.124329 27517 raft_consensus.cc:3037] T a72fa8edd89541bca29a49c3a5b4c362 P 19ea26258cb3491ebfc1e00001af44ff [term 0 FOLLOWER]: Advancing to term 1
W20260811 18:47:01.125581 27243 tablet.cc:2369] T a72fa8edd89541bca29a49c3a5b4c362 P 19ea26258cb3491ebfc1e00001af44ff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:47:01.126825 27517 raft_consensus.cc:504] T a72fa8edd89541bca29a49c3a5b4c362 P 19ea26258cb3491ebfc1e00001af44ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5358b1532574eb9969af33435db67cb" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 36613 } } peers { permanent_uuid: "19ea26258cb3491ebfc1e00001af44ff" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45827 } } peers { permanent_uuid: "e9d9ba317bff40d6a5be07697930f718" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36023 } }
I20260811 18:47:01.127538 27517 leader_election.cc:288] T a72fa8edd89541bca29a49c3a5b4c362 P 19ea26258cb3491ebfc1e00001af44ff [CANDIDATE]: Term 1 election: Requested vote from peers d5358b1532574eb9969af33435db67cb (127.25.25.1:36613), e9d9ba317bff40d6a5be07697930f718 (127.25.25.3:36023)
I20260811 18:47:01.128199 26915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a72fa8edd89541bca29a49c3a5b4c362" candidate_uuid: "19ea26258cb3491ebfc1e00001af44ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5358b1532574eb9969af33435db67cb"
I20260811 18:47:01.128260 27388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a72fa8edd89541bca29a49c3a5b4c362" candidate_uuid: "19ea26258cb3491ebfc1e00001af44ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9d9ba317bff40d6a5be07697930f718"
I20260811 18:47:01.128441 26915 raft_consensus.cc:3037] T a72fa8edd89541bca29a49c3a5b4c362 P d5358b1532574eb9969af33435db67cb [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:01.128486 27388 raft_consensus.cc:3037] T a72fa8edd89541bca29a49c3a5b4c362 P e9d9ba317bff40d6a5be07697930f718 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:01.130919 26915 raft_consensus.cc:2454] T a72fa8edd89541bca29a49c3a5b4c362 P d5358b1532574eb9969af33435db67cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19ea26258cb3491ebfc1e00001af44ff in term 1.
I20260811 18:47:01.131052 27388 raft_consensus.cc:2454] T a72fa8edd89541bca29a49c3a5b4c362 P e9d9ba317bff40d6a5be07697930f718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19ea26258cb3491ebfc1e00001af44ff in term 1.
I20260811 18:47:01.131513 27037 leader_election.cc:302] T a72fa8edd89541bca29a49c3a5b4c362 P 19ea26258cb3491ebfc1e00001af44ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19ea26258cb3491ebfc1e00001af44ff, d5358b1532574eb9969af33435db67cb; no voters:
I20260811 18:47:01.131901 27517 raft_consensus.cc:2781] T a72fa8edd89541bca29a49c3a5b4c362 P 19ea26258cb3491ebfc1e00001af44ff [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:01.132484 27517 raft_consensus.cc:686] T a72fa8edd89541bca29a49c3a5b4c362 P 19ea26258cb3491ebfc1e00001af44ff [term 1 LEADER]: Becoming Leader. State: Replica: 19ea26258cb3491ebfc1e00001af44ff, State: Running, Role: LEADER
I20260811 18:47:01.133111 27517 consensus_queue.cc:237] T a72fa8edd89541bca29a49c3a5b4c362 P 19ea26258cb3491ebfc1e00001af44ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5358b1532574eb9969af33435db67cb" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 36613 } } peers { permanent_uuid: "19ea26258cb3491ebfc1e00001af44ff" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45827 } } peers { permanent_uuid: "e9d9ba317bff40d6a5be07697930f718" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36023 } }
I20260811 18:47:01.138908 26674 catalog_manager.cc:5495] T a72fa8edd89541bca29a49c3a5b4c362 P 19ea26258cb3491ebfc1e00001af44ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 19ea26258cb3491ebfc1e00001af44ff (127.25.25.2). New cstate: current_term: 1 leader_uuid: "19ea26258cb3491ebfc1e00001af44ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5358b1532574eb9969af33435db67cb" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 36613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19ea26258cb3491ebfc1e00001af44ff" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9d9ba317bff40d6a5be07697930f718" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36023 } health_report { overall_health: UNKNOWN } } }
W20260811 18:47:01.160339 27469 tablet.cc:2369] T a72fa8edd89541bca29a49c3a5b4c362 P e9d9ba317bff40d6a5be07697930f718: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 18:47:01 dist-test-slave-lgr5 krb5kdc[26596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.1@KRBTEST.COM
I20260811 18:47:01.189428 27500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:01.171747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60740 (local address 127.25.25.1:36613)
0811 18:47:01.171980 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:01.171987 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:01.172550 (+ 563us) server_negotiation.cc:407] Connection header received
0811 18:47:01.172752 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:01.172757 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:01.172855 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:01.172950 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:01.174657 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.175493 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.176910 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.177378 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.177510 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:01.182191 (+ 4681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:01.182212 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:01.182230 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:01.182284 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:01.186020 (+ 3736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:01.186951 (+ 931us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:01.186961 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:01.186963 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:01.187148 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:01.187624 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:01.187628 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:01.187631 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:01.188113 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:01.188445 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:01.188819 (+ 374us) server_negotiation.cc:299] Negotiation successful
0811 18:47:01.189068 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
Aug 11 18:47:01 dist-test-slave-lgr5 krb5kdc[26596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474021, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 18:47:01 dist-test-slave-lgr5 krb5kdc[26596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474021, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.25.1@KRBTEST.COM
I20260811 18:47:01.241755 27500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:01.227355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60756 (local address 127.25.25.1:36613)
0811 18:47:01.227570 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:01.227577 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:01.228019 (+ 442us) server_negotiation.cc:407] Connection header received
0811 18:47:01.228249 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:01.228255 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:01.228344 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:01.228471 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:01.229907 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.230676 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.232041 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.232544 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.232665 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:01.236767 (+ 4102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:01.236772 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:01.236776 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:01.236816 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:01.239328 (+ 2512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:01.239972 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:01.239976 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:01.239979 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:01.240173 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:01.240560 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:01.240563 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:01.240565 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:01.240853 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:01.241058 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:01.241263 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 18:47:01.241456 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
Aug 11 18:47:01 dist-test-slave-lgr5 krb5kdc[26596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 18:47:01 dist-test-slave-lgr5 krb5kdc[26596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.1@KRBTEST.COM
I20260811 18:47:01.295678 27500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:01.281075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60764 (local address 127.25.25.1:36613)
0811 18:47:01.281280 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:01.281287 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:01.281644 (+ 357us) server_negotiation.cc:407] Connection header received
0811 18:47:01.281841 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:01.281845 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:01.281915 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:01.282009 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:01.283459 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.284242 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.285529 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.285995 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.286123 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:01.290221 (+ 4098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:01.290226 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:01.290230 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:01.290274 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:01.292858 (+ 2584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:01.293586 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:01.293589 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:01.293592 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:01.293728 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:01.294165 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:01.294170 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:01.294172 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:01.294528 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:01.294743 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:01.295133 (+ 390us) server_negotiation.cc:299] Negotiation successful
0811 18:47:01.295343 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260811 18:47:01.297906 26848 tablet_service.cc:2908] Rejecting scan request for tablet a72fa8edd89541bca29a49c3a5b4c362: Uninitialized: clean time has not yet been initialized
I20260811 18:47:01.301288 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 26785
I20260811 18:47:01.314401 27500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:01.302234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60772 (local address 127.25.25.1:36613)
0811 18:47:01.302399 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:01.302404 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:01.302846 (+ 442us) server_negotiation.cc:407] Connection header received
0811 18:47:01.302961 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:01.302965 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:01.303051 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:01.303141 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:01.304489 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.305209 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.306448 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.306893 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.307043 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:01.309485 (+ 2442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:01.309491 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:01.309494 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:01.309544 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:01.312109 (+ 2565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:01.312806 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:01.312810 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:01.312813 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:01.312955 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:01.313230 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:01.313233 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:01.313235 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:01.313535 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:01.313754 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:01.313973 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 18:47:01.314158 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 18:47:01.315128 26990 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:01.406414 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 26785
I20260811 18:47:01.434738 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 27008
Aug 11 18:47:01 dist-test-slave-lgr5 krb5kdc[26596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.2@KRBTEST.COM
I20260811 18:47:01.450513 27501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:01.435618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40298 (local address 127.25.25.2:45827)
0811 18:47:01.435839 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:01.435844 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:01.435866 (+ 22us) server_negotiation.cc:407] Connection header received
0811 18:47:01.436020 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:01.436026 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:01.436132 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:01.436235 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:01.437502 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.438252 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.439652 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.440117 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.440250 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:01.444524 (+ 4274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:01.444546 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:01.444563 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:01.444609 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:01.447617 (+ 3008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:01.448513 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:01.448523 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:01.448525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:01.448702 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:01.449033 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:01.449036 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:01.449038 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:01.449396 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:01.449644 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:01.449975 (+ 331us) server_negotiation.cc:299] Negotiation successful
0811 18:47:01.450195 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 18:47:01.451362 27232 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:01.543431 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 27008
I20260811 18:47:01.566716 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 27250
Aug 11 18:47:01 dist-test-slave-lgr5 krb5kdc[26596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.3@KRBTEST.COM
I20260811 18:47:01.582819 27502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:01.567551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56688 (local address 127.25.25.3:36023)
0811 18:47:01.567754 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:01.567759 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:01.567779 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:47:01.567892 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:01.567897 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:01.567968 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:01.568050 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:01.569378 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.570145 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.571439 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:01.571854 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:01.571959 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:01.576926 (+ 4967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:01.576947 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:01.576965 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:01.577020 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:01.579850 (+ 2830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:01.580760 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:01.580769 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:01.580771 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:01.580964 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:01.581381 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:01.581387 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:01.581390 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:01.581810 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:01.582086 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:01.582335 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 18:47:01.582536 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 18:47:01.583537 27460 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:01.673839 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 27250
I20260811 18:47:01.701689 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 26616
I20260811 18:47:01.702868 26731 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:01.813691 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 26616
2026-08-11T18:47:01Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4570 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:47:01 dist-test-slave-lgr5 krb5kdc[27556](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:47:01 dist-test-slave-lgr5 krb5kdc[27556](info): set up 2 sockets
Aug 11 18:47:01 dist-test-slave-lgr5 krb5kdc[27556](info): commencing operation
krb5kdc: starting...
W20260811 18:47:03.067469 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.204s user 0.003s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:47:03 dist-test-slave-lgr5 krb5kdc[27556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:47:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:47:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:47:03.286165 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:37899
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:46635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:37899
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:03.638361 27584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:03.638710 27584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:03.638803 27584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:03.646447 27584 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:47:03.646576 27584 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 18:47:03.646621 27584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:03.646682 27584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:03.646737 27584 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:47:03.646798 27584 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:47:03.657212 27584 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:46635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:37899
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:37899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:03.658586 27584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:03.660022 27584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:03.672897 27590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:03.672923 27593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:03.672887 27591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:03.673651 27584 server_base.cc:1034] running on GCE node
I20260811 18:47:03.674607 27584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:03.676276 27584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:03.677577 27584 hybrid_clock.cc:648] HybridClock initialized: now 1786474023677513 us; error 89 us; skew 500 ppm
I20260811 18:47:03.678009 27584 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:03 dist-test-slave-lgr5 krb5kdc[27556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474023, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:03.681627 27584 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:47:03.683470 27584 webserver.cc:460] Webserver started at http://127.25.25.62:37647/ using document root <none> and password file <none>
I20260811 18:47:03.684370 27584 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:03.684492 27584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:03.684832 27584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:03.688405 27584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "9d9be757d2e3458ab152f35ec6b0d501"
format_stamp: "Formatted at 2026-08-11 18:47:03 on dist-test-slave-lgr5"
server_key: "0540aaa53cccb513321853c0a83d4727"
server_key_iv: "86205c299f9f690b04295859d8db61c8"
server_key_version: "encryptionkey@0"
I20260811 18:47:03.689342 27584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "9d9be757d2e3458ab152f35ec6b0d501"
format_stamp: "Formatted at 2026-08-11 18:47:03 on dist-test-slave-lgr5"
server_key: "0540aaa53cccb513321853c0a83d4727"
server_key_iv: "86205c299f9f690b04295859d8db61c8"
server_key_version: "encryptionkey@0"
I20260811 18:47:03.695784 27584 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 18:47:03.700145 27604 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:03.701731 27584 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:47:03.701912 27584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "9d9be757d2e3458ab152f35ec6b0d501"
format_stamp: "Formatted at 2026-08-11 18:47:03 on dist-test-slave-lgr5"
server_key: "0540aaa53cccb513321853c0a83d4727"
server_key_iv: "86205c299f9f690b04295859d8db61c8"
server_key_version: "encryptionkey@0"
I20260811 18:47:03.702152 27584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:03.721730 27584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:03.726805 27584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:03.727123 27584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:03.750577 27584 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:37899
I20260811 18:47:03.750602 27709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:37899 every 8 connection(s)
I20260811 18:47:03.752156 27584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:47:03.756433 27710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:03.758481 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 27584
I20260811 18:47:03.758731 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:47:03.759557 25700 external_mini_cluster.cc:1428] Setting key 2f6a808f16e69f39183279ea82176d0d
I20260811 18:47:03.770593 27710 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d9be757d2e3458ab152f35ec6b0d501: Bootstrap starting.
I20260811 18:47:03.774943 27710 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d9be757d2e3458ab152f35ec6b0d501: Neither blocks nor log segments found. Creating new log.
Aug 11 18:47:03 dist-test-slave-lgr5 krb5kdc[27556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:03.776284 27710 log.cc:824] T 00000000000000000000000000000000 P 9d9be757d2e3458ab152f35ec6b0d501: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:03.780248 27710 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d9be757d2e3458ab152f35ec6b0d501: No bootstrap required, opened a new log
I20260811 18:47:03.786703 27713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:03.762020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50428 (local address 127.25.25.62:37899)
0811 18:47:03.762996 (+ 976us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:03.763011 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:03.763061 (+ 50us) server_negotiation.cc:407] Connection header received
0811 18:47:03.764992 (+ 1931us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:03.765024 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:03.765530 (+ 506us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:03.765937 (+ 407us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:03.767892 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:03.769392 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:03.771287 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:03.772127 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:03.772296 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:03.777232 (+ 4936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:03.777246 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:03.777266 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:03.777306 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:03.781323 (+ 4017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:03.782325 (+ 1002us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:03.782335 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:03.782345 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:03.782592 (+ 247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:03.782975 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:03.782984 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:03.782988 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:03.783803 (+ 815us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:03.784169 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:03.784533 (+ 364us) server_negotiation.cc:299] Negotiation successful
0811 18:47:03.785097 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":720,"thread_start_us":468,"threads_started":1}
I20260811 18:47:03.790516 27710 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d9be757d2e3458ab152f35ec6b0d501 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d9be757d2e3458ab152f35ec6b0d501" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 37899 } }
I20260811 18:47:03.790912 27710 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d9be757d2e3458ab152f35ec6b0d501 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:03.790990 27710 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d9be757d2e3458ab152f35ec6b0d501 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d9be757d2e3458ab152f35ec6b0d501, State: Initialized, Role: FOLLOWER
I20260811 18:47:03.791534 27710 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d9be757d2e3458ab152f35ec6b0d501 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d9be757d2e3458ab152f35ec6b0d501" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 37899 } }
I20260811 18:47:03.791751 27710 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d9be757d2e3458ab152f35ec6b0d501 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:47:03.791853 27710 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d9be757d2e3458ab152f35ec6b0d501 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:47:03.791977 27710 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d9be757d2e3458ab152f35ec6b0d501 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:03.794291 27710 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d9be757d2e3458ab152f35ec6b0d501 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d9be757d2e3458ab152f35ec6b0d501" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 37899 } }
I20260811 18:47:03.794813 27710 leader_election.cc:302] T 00000000000000000000000000000000 P 9d9be757d2e3458ab152f35ec6b0d501 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d9be757d2e3458ab152f35ec6b0d501; no voters:
I20260811 18:47:03.795399 27710 leader_election.cc:288] T 00000000000000000000000000000000 P 9d9be757d2e3458ab152f35ec6b0d501 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:47:03.795531 27715 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d9be757d2e3458ab152f35ec6b0d501 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:03.796212 27715 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d9be757d2e3458ab152f35ec6b0d501 [term 1 LEADER]: Becoming Leader. State: Replica: 9d9be757d2e3458ab152f35ec6b0d501, State: Running, Role: LEADER
I20260811 18:47:03.796864 27715 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d9be757d2e3458ab152f35ec6b0d501 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d9be757d2e3458ab152f35ec6b0d501" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 37899 } }
I20260811 18:47:03.797520 27710 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d9be757d2e3458ab152f35ec6b0d501 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:47:03.799882 27717 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d9be757d2e3458ab152f35ec6b0d501 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d9be757d2e3458ab152f35ec6b0d501. Latest consensus state: current_term: 1 leader_uuid: "9d9be757d2e3458ab152f35ec6b0d501" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d9be757d2e3458ab152f35ec6b0d501" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 37899 } } }
I20260811 18:47:03.800364 27717 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d9be757d2e3458ab152f35ec6b0d501 [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:03.800354 27716 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d9be757d2e3458ab152f35ec6b0d501 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d9be757d2e3458ab152f35ec6b0d501" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d9be757d2e3458ab152f35ec6b0d501" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 37899 } } }
I20260811 18:47:03.800666 27716 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d9be757d2e3458ab152f35ec6b0d501 [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:03.802181 27724 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:47:03.807444 27724 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:47:03.817957 27724 catalog_manager.cc:1347] Generated new cluster ID: 82ef82f496ed4345a42b92d0227b518d
I20260811 18:47:03.818106 27724 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:47:03.827934 27724 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:47:03.830312 27724 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:47:03.840785 27724 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d9be757d2e3458ab152f35ec6b0d501: Generated new TSK 0
I20260811 18:47:03.842187 27724 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.25.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
I20260811 18:47:03.909248 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:0
--local_ip_for_outbound_sockets=127.25.25.1
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:37899
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:46635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:04.292701 27753 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:04.293104 27753 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:04.293233 27753 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:04.301081 27753 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:04.301257 27753 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:04.301400 27753 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:47:04.301506 27753 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:47:04.312227 27753 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:46635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.25.62:37899
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:04.313839 27753 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:04.315469 27753 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:04.329882 27765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:04.329921 27764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:04.329850 27767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:04.330550 27753 server_base.cc:1034] running on GCE node
I20260811 18:47:04.331248 27753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:04.332271 27753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:04.333500 27753 hybrid_clock.cc:648] HybridClock initialized: now 1786474024333421 us; error 52 us; skew 500 ppm
I20260811 18:47:04.333809 27753 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:04 dist-test-slave-lgr5 krb5kdc[27556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474024, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:04.341671 27753 init.cc:377] Logged in from keytab as kudu/127.25.25.1@KRBTEST.COM (short username kudu)
I20260811 18:47:04.343295 27753 webserver.cc:460] Webserver started at http://127.25.25.1:36283/ using document root <none> and password file <none>
I20260811 18:47:04.344028 27753 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:04.344164 27753 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:04.344506 27753 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:04.347630 27753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-0/data/instance:
uuid: "3ec9ae52da7a492d9e3966df88a3261a"
format_stamp: "Formatted at 2026-08-11 18:47:04 on dist-test-slave-lgr5"
server_key: "f2f5290a0585bfbaa2baa18f3ec9e25e"
server_key_iv: "4e9183006f4e6b7e1a5d265c4d13a65b"
server_key_version: "encryptionkey@0"
I20260811 18:47:04.348507 27753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance:
uuid: "3ec9ae52da7a492d9e3966df88a3261a"
format_stamp: "Formatted at 2026-08-11 18:47:04 on dist-test-slave-lgr5"
server_key: "f2f5290a0585bfbaa2baa18f3ec9e25e"
server_key_iv: "4e9183006f4e6b7e1a5d265c4d13a65b"
server_key_version: "encryptionkey@0"
I20260811 18:47:04.353950 27753 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260811 18:47:04.357882 27777 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:04.359390 27753 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 18:47:04.359555 27753 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "3ec9ae52da7a492d9e3966df88a3261a"
format_stamp: "Formatted at 2026-08-11 18:47:04 on dist-test-slave-lgr5"
server_key: "f2f5290a0585bfbaa2baa18f3ec9e25e"
server_key_iv: "4e9183006f4e6b7e1a5d265c4d13a65b"
server_key_version: "encryptionkey@0"
I20260811 18:47:04.359751 27753 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:04.381646 27753 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:04.386446 27753 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:04.386696 27753 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:04.389752 27753 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:04.389853 27753 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:04.390012 27753 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:04.390069 27753 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:47:04 dist-test-slave-lgr5 krb5kdc[27556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474024, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:04.420238 27799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:04.390397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:59323 (local address 127.25.25.62:37899)
0811 18:47:04.391058 (+ 661us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:04.391065 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:04.392516 (+ 1451us) server_negotiation.cc:407] Connection header received
0811 18:47:04.395695 (+ 3179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:04.395702 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:04.395816 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:04.395915 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:04.398923 (+ 3008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:04.400131 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:04.403821 (+ 3690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:04.404453 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:04.404597 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:04.410944 (+ 6347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:04.410954 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:04.410960 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:04.411016 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:04.414847 (+ 3831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:04.416424 (+ 1577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:04.416433 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:04.416436 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:04.416664 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:04.417495 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:04.417501 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:04.417505 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:04.417963 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:04.418135 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:04.419470 (+ 1335us) server_negotiation.cc:299] Negotiation successful
0811 18:47:04.419789 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":524,"thread_start_us":375,"threads_started":1}
I20260811 18:47:04.421927 27808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:04.391185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:37899 (local address 127.25.25.1:59323)
0811 18:47:04.392273 (+ 1088us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:04.392340 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:04.395192 (+ 2852us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:04.396655 (+ 1463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:04.396671 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:04.397763 (+ 1092us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:04.398674 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:04.398706 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:04.400418 (+ 1712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:04.400427 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:04.403541 (+ 3114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:04.403579 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:04.404796 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:04.404805 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:04.405211 (+ 406us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:04.406372 (+ 1161us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:04.406458 (+ 86us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:04.410510 (+ 4052us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:04.415098 (+ 4588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:04.415115 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:04.415139 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:04.416178 (+ 1039us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:04.416860 (+ 682us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:04.416867 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:04.416871 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:04.417300 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:04.418159 (+ 859us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:04.418174 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:04.418869 (+ 695us) client_negotiation.cc:769] Sending connection context
0811 18:47:04.419291 (+ 422us) client_negotiation.cc:240] Negotiation successful
0811 18:47:04.420074 (+ 783us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":703,"thread_start_us":422,"threads_started":1}
I20260811 18:47:04.431905 27753 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:44855
I20260811 18:47:04.431998 27999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:44855 every 8 connection(s)
I20260811 18:47:04.433399 27753 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:47:04.436192 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 27753
I20260811 18:47:04.436254 28001 heartbeater.cc:347] Connected to a master server at 127.25.25.62:37899
I20260811 18:47:04.436498 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance
I20260811 18:47:04.436547 28001 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:04.437337 25700 external_mini_cluster.cc:1428] Setting key d8df03202faf959088908ba514e3c874
I20260811 18:47:04.437552 28001 heartbeater.cc:511] Master 127.25.25.62:37899 requested a full tablet report, sending...
I20260811 18:47:04.440371 27631 ts_manager.cc:194] Registered new tserver with Master: 3ec9ae52da7a492d9e3966df88a3261a (127.25.25.1:44855)
I20260811 18:47:04.442638 27631 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.1@KRBTEST.COM'} at 127.25.25.1:59323
I20260811 18:47:04.444659 27799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:04.430087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:42323 (local address 127.25.25.62:37899)
0811 18:47:04.430282 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:04.430289 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:04.430906 (+ 617us) server_negotiation.cc:407] Connection header received
0811 18:47:04.431116 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:04.431122 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:04.431200 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:04.431288 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:04.432677 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:04.433426 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:04.435183 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:04.435817 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:04.435945 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:04.438385 (+ 2440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:04.438393 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:04.438398 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:04.438445 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:04.441696 (+ 3251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:04.442478 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:04.442484 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:04.442487 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:04.442635 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:04.443040 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:04.443045 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:04.443047 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:04.443359 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:04.443508 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:04.444025 (+ 517us) server_negotiation.cc:299] Negotiation successful
0811 18:47:04.444305 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 18:47:04.444772 27997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:04.430111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:37899 (local address 127.25.25.1:42323)
0811 18:47:04.430765 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:04.430791 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:04.430977 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:04.431348 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:04.431353 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:04.432138 (+ 785us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:04.432490 (+ 352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:04.432503 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:04.433586 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:04.433591 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:04.434981 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:04.435002 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:04.436244 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:04.436253 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:04.436454 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:04.437118 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:04.437138 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:04.438110 (+ 972us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:04.441887 (+ 3777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:04.441893 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:04.441897 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:04.442345 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:04.442764 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:04.442770 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:04.442774 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:04.442927 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:04.443487 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:04.443492 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:04.443689 (+ 197us) client_negotiation.cc:769] Sending connection context
0811 18:47:04.443906 (+ 217us) client_negotiation.cc:240] Negotiation successful
0811 18:47:04.444296 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":362,"threads_started":1}
WARNING: no policy specified for kudu/127.25.25.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
I20260811 18:47:04.487627 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:0
--local_ip_for_outbound_sockets=127.25.25.2
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:37899
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:46635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:04.838805 28008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:04.839144 28008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:04.839289 28008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:04.847496 28008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:04.847645 28008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:04.847779 28008 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:47:04.847896 28008 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:47:04.858645 28008 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:46635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.25.62:37899
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:04.860159 28008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:04.861706 28008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:04.876277 28020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:04.876217 28023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:04.876308 28021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:04.877233 28008 server_base.cc:1034] running on GCE node
I20260811 18:47:04.877874 28008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:04.878942 28008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:04.880189 28008 hybrid_clock.cc:648] HybridClock initialized: now 1786474024880121 us; error 33 us; skew 500 ppm
I20260811 18:47:04.880489 28008 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:04 dist-test-slave-lgr5 krb5kdc[27556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474024, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:04.883819 28008 init.cc:377] Logged in from keytab as kudu/127.25.25.2@KRBTEST.COM (short username kudu)
I20260811 18:47:04.885579 28008 webserver.cc:460] Webserver started at http://127.25.25.2:39823/ using document root <none> and password file <none>
I20260811 18:47:04.886339 28008 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:04.886453 28008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:04.886775 28008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:04.890071 28008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-1/data/instance:
uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5"
format_stamp: "Formatted at 2026-08-11 18:47:04 on dist-test-slave-lgr5"
server_key: "6388ecac93c70f17cb4d453432c54e68"
server_key_iv: "8e8c07d78e459e209ccd327b887803c1"
server_key_version: "encryptionkey@0"
I20260811 18:47:04.890939 28008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance:
uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5"
format_stamp: "Formatted at 2026-08-11 18:47:04 on dist-test-slave-lgr5"
server_key: "6388ecac93c70f17cb4d453432c54e68"
server_key_iv: "8e8c07d78e459e209ccd327b887803c1"
server_key_version: "encryptionkey@0"
I20260811 18:47:04.896512 28008 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 18:47:04.900476 28036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:04.902029 28008 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:47:04.902199 28008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5"
format_stamp: "Formatted at 2026-08-11 18:47:04 on dist-test-slave-lgr5"
server_key: "6388ecac93c70f17cb4d453432c54e68"
server_key_iv: "8e8c07d78e459e209ccd327b887803c1"
server_key_version: "encryptionkey@0"
I20260811 18:47:04.902446 28008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:04.931860 28008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:04.936599 28008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:04.936890 28008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:04.939893 28008 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:04.940006 28008 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:04.940179 28008 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:04.940255 28008 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:47:04 dist-test-slave-lgr5 krb5kdc[27556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474024, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:04.965893 27799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:04.940614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:35799 (local address 127.25.25.62:37899)
0811 18:47:04.940822 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:04.940828 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:04.942427 (+ 1599us) server_negotiation.cc:407] Connection header received
0811 18:47:04.944573 (+ 2146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:04.944579 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:04.944671 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:04.944762 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:04.947155 (+ 2393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:04.948124 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:04.950895 (+ 2771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:04.951508 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:04.951669 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:04.957529 (+ 5860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:04.957535 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:04.957539 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:04.957580 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:04.960826 (+ 3246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:04.962421 (+ 1595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:04.962429 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:04.962433 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:04.962670 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:04.963351 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:04.963357 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:04.963361 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:04.963788 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:04.963979 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:04.965256 (+ 1277us) server_negotiation.cc:299] Negotiation successful
0811 18:47:04.965539 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 18:47:04.967108 28047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:04.941375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:37899 (local address 127.25.25.2:35799)
0811 18:47:04.942252 (+ 877us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:04.942295 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:04.944269 (+ 1974us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:04.945098 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:04.945111 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:04.945932 (+ 821us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:04.946950 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:04.946975 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:04.948312 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:04.948316 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:04.950694 (+ 2378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:04.950710 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:04.951900 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:04.951911 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:04.952192 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:04.953033 (+ 841us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:04.953063 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:04.957158 (+ 4095us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:04.961173 (+ 4015us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:04.961185 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:04.961215 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:04.962232 (+ 1017us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:04.962814 (+ 582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:04.962820 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:04.962823 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:04.963211 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:04.964142 (+ 931us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:04.964152 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:04.964765 (+ 613us) client_negotiation.cc:769] Sending connection context
0811 18:47:04.965110 (+ 345us) client_negotiation.cc:240] Negotiation successful
0811 18:47:04.965738 (+ 628us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":371,"threads_started":1}
I20260811 18:47:04.988998 28008 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:44101
I20260811 18:47:04.989035 28255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:44101 every 8 connection(s)
I20260811 18:47:04.990108 27799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:04.974442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:42739 (local address 127.25.25.62:37899)
0811 18:47:04.974635 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:04.974639 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:04.975259 (+ 620us) server_negotiation.cc:407] Connection header received
0811 18:47:04.975461 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:04.975468 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:04.975545 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:04.975631 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:04.977043 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:04.978101 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:04.980226 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:04.980662 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:04.980784 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:04.983483 (+ 2699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:04.983491 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:04.983496 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:04.983557 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:04.986928 (+ 3371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:04.987786 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:04.987793 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:04.987796 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:04.988005 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:04.988499 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:04.988504 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:04.988508 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:04.988888 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:04.989036 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:04.989529 (+ 493us) server_negotiation.cc:299] Negotiation successful
0811 18:47:04.989759 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 18:47:04.990243 28194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:04.974460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:37899 (local address 127.25.25.2:42739)
0811 18:47:04.975132 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:04.975149 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:04.975313 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:04.975681 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:04.975685 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:04.976262 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:04.976797 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:04.976814 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:04.978281 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:04.978287 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:04.980002 (+ 1715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:04.980021 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:04.980882 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:04.980890 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:04.981051 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:04.981779 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:04.981808 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:04.983240 (+ 1432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:04.987075 (+ 3835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:04.987081 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:04.987084 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:04.987641 (+ 557us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:04.988197 (+ 556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:04.988206 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:04.988210 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:04.988375 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:04.989026 (+ 651us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:04.989031 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:04.989246 (+ 215us) client_negotiation.cc:769] Sending connection context
0811 18:47:04.989393 (+ 147us) client_negotiation.cc:240] Negotiation successful
0811 18:47:04.989782 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":352,"threads_started":1}
I20260811 18:47:04.990624 28008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:47:04.992952 28256 heartbeater.cc:347] Connected to a master server at 127.25.25.62:37899
I20260811 18:47:04.993199 28256 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:04.994022 28256 heartbeater.cc:511] Master 127.25.25.62:37899 requested a full tablet report, sending...
I20260811 18:47:04.995446 27631 ts_manager.cc:194] Registered new tserver with Master: 5a386ce6c6cd477aafc3c4df5b6e4ac5 (127.25.25.2:44101)
I20260811 18:47:04.996312 27631 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.2@KRBTEST.COM'} at 127.25.25.2:35799
I20260811 18:47:05.000984 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 28008
I20260811 18:47:05.001170 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance
I20260811 18:47:05.001593 25700 external_mini_cluster.cc:1428] Setting key 49a2c686b9ed253de1676f1e18ef6442
WARNING: no policy specified for kudu/127.25.25.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
I20260811 18:47:05.049001 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:0
--local_ip_for_outbound_sockets=127.25.25.3
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:37899
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:46635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:05.401676 28262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:05.402002 28262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:05.402148 28262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:05.410056 28262 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:05.410200 28262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:05.410326 28262 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:47:05.410449 28262 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:47:05.420817 28262 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:46635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.25.62:37899
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:05.422206 28262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:05.423668 28262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:05.437965 28270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:05.437881 28275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:05.437942 28278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:05.438815 28262 server_base.cc:1034] running on GCE node
I20260811 18:47:05.439528 28262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:05.440619 28262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:05.441829 28262 hybrid_clock.cc:648] HybridClock initialized: now 1786474025441749 us; error 62 us; skew 500 ppm
I20260811 18:47:05.442137 28262 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:05 dist-test-slave-lgr5 krb5kdc[27556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474025, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:05.445508 28262 init.cc:377] Logged in from keytab as kudu/127.25.25.3@KRBTEST.COM (short username kudu)
I20260811 18:47:05.446739 28001 heartbeater.cc:503] Master 127.25.25.62:37899 was elected leader, sending a full tablet report...
I20260811 18:47:05.447396 28262 webserver.cc:460] Webserver started at http://127.25.25.3:33479/ using document root <none> and password file <none>
I20260811 18:47:05.448282 28262 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:05.448387 28262 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:05.448868 28262 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:05.452505 28262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-2/data/instance:
uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc"
format_stamp: "Formatted at 2026-08-11 18:47:05 on dist-test-slave-lgr5"
server_key: "139f0ceac720a6ed04c5c84c9be47a38"
server_key_iv: "ca5991aa4e49f204f566d210bf47634e"
server_key_version: "encryptionkey@0"
I20260811 18:47:05.453472 28262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance:
uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc"
format_stamp: "Formatted at 2026-08-11 18:47:05 on dist-test-slave-lgr5"
server_key: "139f0ceac720a6ed04c5c84c9be47a38"
server_key_iv: "ca5991aa4e49f204f566d210bf47634e"
server_key_version: "encryptionkey@0"
I20260811 18:47:05.459684 28262 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 18:47:05.464644 28286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:05.466414 28262 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260811 18:47:05.466640 28262 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc"
format_stamp: "Formatted at 2026-08-11 18:47:05 on dist-test-slave-lgr5"
server_key: "139f0ceac720a6ed04c5c84c9be47a38"
server_key_iv: "ca5991aa4e49f204f566d210bf47634e"
server_key_version: "encryptionkey@0"
I20260811 18:47:05.466913 28262 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:05.487928 28262 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:05.493255 28262 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:05.493567 28262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:05.497080 28262 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:05.497202 28262 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:05.497380 28262 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:05.497478 28262 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:47:05 dist-test-slave-lgr5 krb5kdc[27556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474025, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:05.523433 28305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:05.497896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:42873 (local address 127.25.25.62:37899)
0811 18:47:05.498532 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:05.498539 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:05.499869 (+ 1330us) server_negotiation.cc:407] Connection header received
0811 18:47:05.502217 (+ 2348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:05.502223 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:05.502334 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:05.502475 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:05.505116 (+ 2641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.506435 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.509493 (+ 3058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.510025 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.510154 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:05.514602 (+ 4448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:05.514610 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:05.514616 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:05.514671 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:05.518718 (+ 4047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:05.519893 (+ 1175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:05.519902 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:05.519906 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:05.520163 (+ 257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:05.521034 (+ 871us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:05.521041 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:05.521044 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:05.521513 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:05.521707 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:05.522635 (+ 928us) server_negotiation.cc:299] Negotiation successful
0811 18:47:05.522936 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":483,"thread_start_us":315,"threads_started":1}
I20260811 18:47:05.524917 28306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:05.498694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:37899 (local address 127.25.25.3:42873)
0811 18:47:05.499647 (+ 953us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:05.499709 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:05.501857 (+ 2148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:05.502814 (+ 957us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:05.502830 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:05.503805 (+ 975us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:05.504829 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:05.504880 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.506684 (+ 1804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.506691 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:05.509278 (+ 2587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:05.509301 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.510347 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.510355 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:05.510562 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:05.511260 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:05.511285 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:05.514189 (+ 2904us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:05.518941 (+ 4752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:05.518955 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:05.518981 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:05.519686 (+ 705us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:05.520377 (+ 691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:05.520385 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:05.520389 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:05.520798 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:05.521683 (+ 885us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:05.521694 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:05.522159 (+ 465us) client_negotiation.cc:769] Sending connection context
0811 18:47:05.522476 (+ 317us) client_negotiation.cc:240] Negotiation successful
0811 18:47:05.523145 (+ 669us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":639,"thread_start_us":375,"threads_started":1}
I20260811 18:47:05.552204 28305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:05.537031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:60217 (local address 127.25.25.62:37899)
0811 18:47:05.537249 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:05.537256 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:05.538054 (+ 798us) server_negotiation.cc:407] Connection header received
0811 18:47:05.538240 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:05.538246 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:05.538333 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:05.538421 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:05.539505 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.540323 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.542189 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.542778 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.542925 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:05.545726 (+ 2801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:05.545731 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:05.545735 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:05.545780 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:05.549083 (+ 3303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:05.550112 (+ 1029us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:05.550118 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:05.550122 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:05.550268 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:05.550653 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:05.550659 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:05.550663 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:05.550969 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:05.551113 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:05.551565 (+ 452us) server_negotiation.cc:299] Negotiation successful
0811 18:47:05.551808 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 18:47:05.552379 28445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:05.537119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:37899 (local address 127.25.25.3:60217)
0811 18:47:05.537920 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:05.537939 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:05.538104 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:05.538475 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:05.538480 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:05.539017 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:05.539333 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:05.539344 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.540495 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.540499 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:05.542014 (+ 1515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:05.542035 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.543103 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.543111 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:05.543343 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:05.544117 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:05.544146 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:05.545460 (+ 1314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:05.549234 (+ 3774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:05.549239 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:05.549248 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:05.549920 (+ 672us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:05.550394 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:05.550400 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:05.550404 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:05.550538 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:05.551094 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:05.551099 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:05.551293 (+ 194us) client_negotiation.cc:769] Sending connection context
0811 18:47:05.551427 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 18:47:05.551830 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":664,"thread_start_us":483,"threads_started":1}
I20260811 18:47:05.559202 28262 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:36595
I20260811 18:47:05.559212 28522 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:36595 every 8 connection(s)
I20260811 18:47:05.560633 28262 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:47:05.562119 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 28262
I20260811 18:47:05.562319 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance
I20260811 18:47:05.562811 25700 external_mini_cluster.cc:1428] Setting key 39b526c0ed0a8cc72eefe266b1ce5012
I20260811 18:47:05.563074 28524 heartbeater.cc:347] Connected to a master server at 127.25.25.62:37899
I20260811 18:47:05.563400 28524 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:05.564404 28524 heartbeater.cc:511] Master 127.25.25.62:37899 requested a full tablet report, sending...
I20260811 18:47:05.566181 27633 ts_manager.cc:194] Registered new tserver with Master: 9dfef3fea5f2494e8f4d04ff1fd363cc (127.25.25.3:36595)
I20260811 18:47:05.567225 27633 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.3@KRBTEST.COM'} at 127.25.25.3:42873
I20260811 18:47:05.579823 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 18:47:05 dist-test-slave-lgr5 krb5kdc[27556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474025, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 18:47:05 dist-test-slave-lgr5 krb5kdc[27556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474025, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:05.633643 28305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:05.617779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50430 (local address 127.25.25.62:37899)
0811 18:47:05.618039 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:05.618047 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:05.618417 (+ 370us) server_negotiation.cc:407] Connection header received
0811 18:47:05.618620 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:05.618624 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:05.618717 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:05.618848 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:05.620438 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.621187 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.622533 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.622954 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.623076 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:05.627546 (+ 4470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:05.627552 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:05.627556 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:05.627606 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:05.630572 (+ 2966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:05.631403 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:05.631408 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:05.631411 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:05.631582 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:05.632029 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:05.632034 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:05.632036 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:05.632419 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:05.632708 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:05.633040 (+ 332us) server_negotiation.cc:299] Negotiation successful
0811 18:47:05.633288 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260811 18:47:05.638397 27633 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50430:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:47:05.645764 27633 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:47:05.671218 28546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:05.659138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44396 (local address 127.25.25.1:44855)
0811 18:47:05.659866 (+ 728us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:05.659878 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:05.660634 (+ 756us) server_negotiation.cc:407] Connection header received
0811 18:47:05.660926 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:05.660935 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:05.661249 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:05.661564 (+ 315us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:05.662647 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.664390 (+ 1743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.667603 (+ 3213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.669488 (+ 1885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.669630 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:05.669890 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:05.670695 (+ 805us) server_negotiation.cc:299] Negotiation successful
0811 18:47:05.670889 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":328,"threads_started":1}
I20260811 18:47:05.671859 28543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:05.658966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:44855 (local address 127.0.0.1:44396)
0811 18:47:05.660419 (+ 1453us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:05.660472 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:05.660675 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:05.661859 (+ 1184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:05.661867 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:05.661899 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:05.662410 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:05.662427 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.664621 (+ 2194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.664627 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:05.667366 (+ 2739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:05.667388 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.669734 (+ 2346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.669741 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:05.670250 (+ 509us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:05.670359 (+ 109us) client_negotiation.cc:769] Sending connection context
0811 18:47:05.670620 (+ 261us) client_negotiation.cc:240] Negotiation successful
0811 18:47:05.670878 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1165,"thread_start_us":897,"threads_started":1}
I20260811 18:47:05.675626 28551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:05.660953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:36595 (local address 127.0.0.1:48920)
0811 18:47:05.661583 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:05.661605 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:05.661730 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:05.666310 (+ 4580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:05.666316 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:05.666350 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:05.666902 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:05.666917 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.669040 (+ 2123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.669046 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:05.672628 (+ 3582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:05.672638 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.674739 (+ 2101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.674745 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:05.674873 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:05.674902 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 18:47:05.675006 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 18:47:05.675181 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"mutex_wait_us":337,"thread_start_us":320,"threads_started":1}
I20260811 18:47:05.675613 28553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:05.661428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48920 (local address 127.25.25.3:36595)
0811 18:47:05.665643 (+ 4215us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:05.665650 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:05.665678 (+ 28us) server_negotiation.cc:407] Connection header received
0811 18:47:05.665761 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:05.665766 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:05.666063 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:05.667152 (+ 1089us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:05.667656 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.668846 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.672798 (+ 3952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.674471 (+ 1673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.674632 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:05.674899 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:05.675105 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 18:47:05.675291 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4064,"thread_start_us":3869,"threads_started":1}
I20260811 18:47:05.676783 27879 tablet_service.cc:1467] Processing CreateTablet for tablet 2c1c26d036c74a5aa837b93505d63fe6 (DEFAULT_TABLE table=test-table [id=d1a6037bf54549b4ab9a3c20a5c643af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:05.677809 28555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:05.661903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42030 (local address 127.25.25.2:44101)
0811 18:47:05.665144 (+ 3241us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:05.665155 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:05.665511 (+ 356us) server_negotiation.cc:407] Connection header received
0811 18:47:05.665643 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:05.665653 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:05.666035 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:05.666278 (+ 243us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:05.667533 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.669138 (+ 1605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.675061 (+ 5923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.676606 (+ 1545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.676762 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:05.676985 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:05.677314 (+ 329us) server_negotiation.cc:299] Negotiation successful
0811 18:47:05.677519 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3049,"thread_start_us":2907,"threads_started":1}
I20260811 18:47:05.678224 28556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:05.662200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:44101 (local address 127.0.0.1:42030)
0811 18:47:05.664596 (+ 2396us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:05.665192 (+ 596us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:05.665354 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:05.666550 (+ 1196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:05.666560 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:05.666591 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:05.667178 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:05.667195 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.669298 (+ 2103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.669304 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:05.672610 (+ 3306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:05.672636 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.676861 (+ 4225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.676869 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:05.677084 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:05.677123 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 18:47:05.677235 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 18:47:05.677391 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2246,"mutex_wait_us":45,"thread_start_us":2073,"threads_started":1}
I20260811 18:47:05.678567 27879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c1c26d036c74a5aa837b93505d63fe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:05.679967 28391 tablet_service.cc:1467] Processing CreateTablet for tablet 2c1c26d036c74a5aa837b93505d63fe6 (DEFAULT_TABLE table=test-table [id=d1a6037bf54549b4ab9a3c20a5c643af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:05.681396 28391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c1c26d036c74a5aa837b93505d63fe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:05.682253 28120 tablet_service.cc:1467] Processing CreateTablet for tablet 2c1c26d036c74a5aa837b93505d63fe6 (DEFAULT_TABLE table=test-table [id=d1a6037bf54549b4ab9a3c20a5c643af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:05.683796 28120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c1c26d036c74a5aa837b93505d63fe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:05.694190 28559 tablet_bootstrap.cc:492] T 2c1c26d036c74a5aa837b93505d63fe6 P 9dfef3fea5f2494e8f4d04ff1fd363cc: Bootstrap starting.
I20260811 18:47:05.697664 28559 tablet_bootstrap.cc:654] T 2c1c26d036c74a5aa837b93505d63fe6 P 9dfef3fea5f2494e8f4d04ff1fd363cc: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:05.698784 28559 log.cc:824] T 2c1c26d036c74a5aa837b93505d63fe6 P 9dfef3fea5f2494e8f4d04ff1fd363cc: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:05.700438 28562 tablet_bootstrap.cc:492] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a: Bootstrap starting.
I20260811 18:47:05.703474 28559 tablet_bootstrap.cc:492] T 2c1c26d036c74a5aa837b93505d63fe6 P 9dfef3fea5f2494e8f4d04ff1fd363cc: No bootstrap required, opened a new log
I20260811 18:47:05.703748 28559 ts_tablet_manager.cc:1397] T 2c1c26d036c74a5aa837b93505d63fe6 P 9dfef3fea5f2494e8f4d04ff1fd363cc: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.005s
I20260811 18:47:05.704717 28562 tablet_bootstrap.cc:654] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:05.704963 28563 tablet_bootstrap.cc:492] T 2c1c26d036c74a5aa837b93505d63fe6 P 5a386ce6c6cd477aafc3c4df5b6e4ac5: Bootstrap starting.
I20260811 18:47:05.706095 28562 log.cc:824] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:05.709450 28562 tablet_bootstrap.cc:492] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a: No bootstrap required, opened a new log
I20260811 18:47:05.709597 28563 tablet_bootstrap.cc:654] T 2c1c26d036c74a5aa837b93505d63fe6 P 5a386ce6c6cd477aafc3c4df5b6e4ac5: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:05.709748 28562 ts_tablet_manager.cc:1397] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260811 18:47:05.711000 28563 log.cc:824] T 2c1c26d036c74a5aa837b93505d63fe6 P 5a386ce6c6cd477aafc3c4df5b6e4ac5: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:05.714457 28563 tablet_bootstrap.cc:492] T 2c1c26d036c74a5aa837b93505d63fe6 P 5a386ce6c6cd477aafc3c4df5b6e4ac5: No bootstrap required, opened a new log
I20260811 18:47:05.714389 28559 raft_consensus.cc:348] T 2c1c26d036c74a5aa837b93505d63fe6 P 9dfef3fea5f2494e8f4d04ff1fd363cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } }
I20260811 18:47:05.714819 28563 ts_tablet_manager.cc:1397] T 2c1c26d036c74a5aa837b93505d63fe6 P 5a386ce6c6cd477aafc3c4df5b6e4ac5: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260811 18:47:05.714890 28559 raft_consensus.cc:374] T 2c1c26d036c74a5aa837b93505d63fe6 P 9dfef3fea5f2494e8f4d04ff1fd363cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:05.714983 28559 raft_consensus.cc:729] T 2c1c26d036c74a5aa837b93505d63fe6 P 9dfef3fea5f2494e8f4d04ff1fd363cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dfef3fea5f2494e8f4d04ff1fd363cc, State: Initialized, Role: FOLLOWER
I20260811 18:47:05.715730 28559 consensus_queue.cc:260] T 2c1c26d036c74a5aa837b93505d63fe6 P 9dfef3fea5f2494e8f4d04ff1fd363cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } }
I20260811 18:47:05.716982 28524 heartbeater.cc:503] Master 127.25.25.62:37899 was elected leader, sending a full tablet report...
I20260811 18:47:05.717693 28559 ts_tablet_manager.cc:1428] T 2c1c26d036c74a5aa837b93505d63fe6 P 9dfef3fea5f2494e8f4d04ff1fd363cc: Time spent starting tablet: real 0.014s user 0.012s sys 0.002s
I20260811 18:47:05.718031 28562 raft_consensus.cc:348] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } }
I20260811 18:47:05.718405 28562 raft_consensus.cc:374] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:05.718502 28562 raft_consensus.cc:729] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ec9ae52da7a492d9e3966df88a3261a, State: Initialized, Role: FOLLOWER
I20260811 18:47:05.719130 28562 consensus_queue.cc:260] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } }
I20260811 18:47:05.725204 28575 raft_consensus.cc:482] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:47:05.725597 28575 raft_consensus.cc:504] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } }
I20260811 18:47:05.726344 28563 raft_consensus.cc:348] T 2c1c26d036c74a5aa837b93505d63fe6 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } }
I20260811 18:47:05.726887 28563 raft_consensus.cc:374] T 2c1c26d036c74a5aa837b93505d63fe6 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:05.727015 28563 raft_consensus.cc:729] T 2c1c26d036c74a5aa837b93505d63fe6 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a386ce6c6cd477aafc3c4df5b6e4ac5, State: Initialized, Role: FOLLOWER
I20260811 18:47:05.727648 28562 ts_tablet_manager.cc:1428] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a: Time spent starting tablet: real 0.018s user 0.007s sys 0.010s
I20260811 18:47:05.727798 28563 consensus_queue.cc:260] T 2c1c26d036c74a5aa837b93505d63fe6 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } }
I20260811 18:47:05.729094 28256 heartbeater.cc:503] Master 127.25.25.62:37899 was elected leader, sending a full tablet report...
I20260811 18:47:05.729875 28563 ts_tablet_manager.cc:1428] T 2c1c26d036c74a5aa837b93505d63fe6 P 5a386ce6c6cd477aafc3c4df5b6e4ac5: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
I20260811 18:47:05.730554 28575 leader_election.cc:288] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9dfef3fea5f2494e8f4d04ff1fd363cc (127.25.25.3:36595), 5a386ce6c6cd477aafc3c4df5b6e4ac5 (127.25.25.2:44101)
I20260811 18:47:05.739754 28553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:05.730710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:45233 (local address 127.25.25.3:36595)
0811 18:47:05.731202 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:05.731208 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:05.731337 (+ 129us) server_negotiation.cc:407] Connection header received
0811 18:47:05.731649 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:05.731656 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:05.731742 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:05.731839 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:05.733852 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.735263 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.737975 (+ 2712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.738784 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.738913 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:05.739042 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:05.739359 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 18:47:05.739498 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331}
I20260811 18:47:05.739816 28578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:05.730018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:36595 (local address 127.25.25.1:45233)
0811 18:47:05.731227 (+ 1209us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:05.731247 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:05.731465 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:05.732032 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:05.732038 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:05.732620 (+ 582us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:05.733222 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:05.733244 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.735396 (+ 2152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.735402 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:05.737792 (+ 2390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:05.737810 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.739038 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.739045 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:05.739197 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:05.739224 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 18:47:05.739314 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 18:47:05.739460 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1061,"thread_start_us":878,"threads_started":1}
I20260811 18:47:05.741173 28555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:05.731809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:59739 (local address 127.25.25.2:44101)
0811 18:47:05.732013 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:05.732018 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:05.735260 (+ 3242us) server_negotiation.cc:407] Connection header received
0811 18:47:05.735497 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:05.735503 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:05.735588 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:05.735685 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:05.736363 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.737471 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.739185 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.740054 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.740210 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:05.740322 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:05.740848 (+ 526us) server_negotiation.cc:299] Negotiation successful
0811 18:47:05.740966 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 18:47:05.741071 28434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c1c26d036c74a5aa837b93505d63fe6" candidate_uuid: "3ec9ae52da7a492d9e3966df88a3261a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" is_pre_election: true
I20260811 18:47:05.741386 28579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:05.731408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:44101 (local address 127.25.25.1:59739)
0811 18:47:05.735135 (+ 3727us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:05.735158 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:05.735310 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:05.735708 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:05.735711 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:05.735735 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:05.736181 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:05.736195 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.737623 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.737627 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:05.739006 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:05.739023 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.740466 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.740473 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:05.740651 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:05.740686 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 18:47:05.740789 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 18:47:05.740946 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3547,"thread_start_us":3384,"threads_started":1}
I20260811 18:47:05.741765 28434 raft_consensus.cc:2454] T 2c1c26d036c74a5aa837b93505d63fe6 P 9dfef3fea5f2494e8f4d04ff1fd363cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ec9ae52da7a492d9e3966df88a3261a in term 0.
I20260811 18:47:05.742547 27782 leader_election.cc:302] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ec9ae52da7a492d9e3966df88a3261a, 9dfef3fea5f2494e8f4d04ff1fd363cc; no voters:
I20260811 18:47:05.742442 28172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c1c26d036c74a5aa837b93505d63fe6" candidate_uuid: "3ec9ae52da7a492d9e3966df88a3261a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" is_pre_election: true
W20260811 18:47:05.742846 28257 tablet.cc:2369] T 2c1c26d036c74a5aa837b93505d63fe6 P 5a386ce6c6cd477aafc3c4df5b6e4ac5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:47:05.743062 28575 raft_consensus.cc:2781] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:47:05.743121 28172 raft_consensus.cc:2454] T 2c1c26d036c74a5aa837b93505d63fe6 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ec9ae52da7a492d9e3966df88a3261a in term 0.
I20260811 18:47:05.743219 28575 raft_consensus.cc:482] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:47:05.743324 28575 raft_consensus.cc:3037] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:05.745744 28575 raft_consensus.cc:504] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } }
I20260811 18:47:05.746345 28575 leader_election.cc:288] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a [CANDIDATE]: Term 1 election: Requested vote from peers 9dfef3fea5f2494e8f4d04ff1fd363cc (127.25.25.3:36595), 5a386ce6c6cd477aafc3c4df5b6e4ac5 (127.25.25.2:44101)
I20260811 18:47:05.746927 28434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c1c26d036c74a5aa837b93505d63fe6" candidate_uuid: "3ec9ae52da7a492d9e3966df88a3261a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc"
I20260811 18:47:05.746925 28172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c1c26d036c74a5aa837b93505d63fe6" candidate_uuid: "3ec9ae52da7a492d9e3966df88a3261a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5"
I20260811 18:47:05.747160 28172 raft_consensus.cc:3037] T 2c1c26d036c74a5aa837b93505d63fe6 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:05.747160 28434 raft_consensus.cc:3037] T 2c1c26d036c74a5aa837b93505d63fe6 P 9dfef3fea5f2494e8f4d04ff1fd363cc [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:05.750504 28434 raft_consensus.cc:2454] T 2c1c26d036c74a5aa837b93505d63fe6 P 9dfef3fea5f2494e8f4d04ff1fd363cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ec9ae52da7a492d9e3966df88a3261a in term 1.
I20260811 18:47:05.750494 28172 raft_consensus.cc:2454] T 2c1c26d036c74a5aa837b93505d63fe6 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ec9ae52da7a492d9e3966df88a3261a in term 1.
I20260811 18:47:05.750962 27782 leader_election.cc:302] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ec9ae52da7a492d9e3966df88a3261a, 5a386ce6c6cd477aafc3c4df5b6e4ac5; no voters:
I20260811 18:47:05.751253 28575 raft_consensus.cc:2781] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:05.751413 28575 raft_consensus.cc:686] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a [term 1 LEADER]: Becoming Leader. State: Replica: 3ec9ae52da7a492d9e3966df88a3261a, State: Running, Role: LEADER
I20260811 18:47:05.751945 28575 consensus_queue.cc:237] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } }
I20260811 18:47:05.756950 27633 catalog_manager.cc:5495] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ec9ae52da7a492d9e3966df88a3261a (127.25.25.1). New cstate: current_term: 1 leader_uuid: "3ec9ae52da7a492d9e3966df88a3261a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } health_report { overall_health: UNKNOWN } } }
I20260811 18:47:05.788687 28546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:05.783052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44404 (local address 127.25.25.1:44855)
0811 18:47:05.783235 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:05.783240 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:05.783385 (+ 145us) server_negotiation.cc:407] Connection header received
0811 18:47:05.783748 (+ 363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:05.783753 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:05.783861 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:05.783998 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:47:05.784448 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.785154 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.786542 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.786929 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.787024 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:05.787538 (+ 514us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:47:05.788112 (+ 574us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:47:05.788238 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:05.788368 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 18:47:05.788465 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 18:47:05.797247 28434 raft_consensus.cc:1261] T 2c1c26d036c74a5aa837b93505d63fe6 P 9dfef3fea5f2494e8f4d04ff1fd363cc [term 1 FOLLOWER]: Refusing update from remote peer 3ec9ae52da7a492d9e3966df88a3261a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:47:05.797247 28172 raft_consensus.cc:1261] T 2c1c26d036c74a5aa837b93505d63fe6 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 1 FOLLOWER]: Refusing update from remote peer 3ec9ae52da7a492d9e3966df88a3261a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:47:05.798225 28575 consensus_queue.cc:1035] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:47:05.798559 28574 consensus_queue.cc:1035] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 18:47:05.812363 28525 tablet.cc:2369] T 2c1c26d036c74a5aa837b93505d63fe6 P 9dfef3fea5f2494e8f4d04ff1fd363cc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:47:05.814106 28587 mvcc.cc:205] Tried to move back new op lower bound from 7317397609655148544 to 7317397609484509184. Current Snapshot: MvccSnapshot[applied={T|T < 7317397609655148544}]
I20260811 18:47:05.836144 27633 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50430:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:47:05.836496 27633 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50430:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:47:05.841079 27633 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9d9be757d2e3458ab152f35ec6b0d501: Sending DeleteTablet for 3 replicas of tablet 2c1c26d036c74a5aa837b93505d63fe6
I20260811 18:47:05.842567 27879 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c1c26d036c74a5aa837b93505d63fe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:05 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:44396
I20260811 18:47:05.842693 28120 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c1c26d036c74a5aa837b93505d63fe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:05 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:42030
I20260811 18:47:05.843922 28391 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c1c26d036c74a5aa837b93505d63fe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:05 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:48920
I20260811 18:47:05.844288 27633 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50430:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:47:05.845094 27633 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:47:05.846933 28606 tablet_replica.cc:330] T 2c1c26d036c74a5aa837b93505d63fe6 P 9dfef3fea5f2494e8f4d04ff1fd363cc: stopping tablet replica
I20260811 18:47:05.847448 28606 raft_consensus.cc:2229] T 2c1c26d036c74a5aa837b93505d63fe6 P 9dfef3fea5f2494e8f4d04ff1fd363cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:47:05.848063 28606 raft_consensus.cc:2258] T 2c1c26d036c74a5aa837b93505d63fe6 P 9dfef3fea5f2494e8f4d04ff1fd363cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:05.849009 28605 tablet_replica.cc:330] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a: stopping tablet replica
I20260811 18:47:05.849470 28605 raft_consensus.cc:2229] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:47:05.850230 28605 raft_consensus.cc:2258] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:05.853964 28605 ts_tablet_manager.cc:1905] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:05.857641 27877 tablet_service.cc:1467] Processing CreateTablet for tablet 05389bd8049d441fa4e24d8b66cd697c (DEFAULT_TABLE table=test-table [id=d3fc9b62d8aa416393599f7ea3784440]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:05.858342 27877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05389bd8049d441fa4e24d8b66cd697c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:05.860132 28391 tablet_service.cc:1467] Processing CreateTablet for tablet 05389bd8049d441fa4e24d8b66cd697c (DEFAULT_TABLE table=test-table [id=d3fc9b62d8aa416393599f7ea3784440]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:05.860677 28391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05389bd8049d441fa4e24d8b66cd697c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:05.862578 28605 ts_tablet_manager.cc:1918] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:47:05.862794 28605 log.cc:1196] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-0/wal/wals/2c1c26d036c74a5aa837b93505d63fe6
I20260811 18:47:05.863700 28602 tablet_replica.cc:330] T 2c1c26d036c74a5aa837b93505d63fe6 P 5a386ce6c6cd477aafc3c4df5b6e4ac5: stopping tablet replica
I20260811 18:47:05.864007 28119 tablet_service.cc:1467] Processing CreateTablet for tablet 05389bd8049d441fa4e24d8b66cd697c (DEFAULT_TABLE table=test-table [id=d3fc9b62d8aa416393599f7ea3784440]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:05.864441 28602 raft_consensus.cc:2229] T 2c1c26d036c74a5aa837b93505d63fe6 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:47:05.864791 28119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05389bd8049d441fa4e24d8b66cd697c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:05.865157 28602 raft_consensus.cc:2258] T 2c1c26d036c74a5aa837b93505d63fe6 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:05.867583 28602 ts_tablet_manager.cc:1905] T 2c1c26d036c74a5aa837b93505d63fe6 P 5a386ce6c6cd477aafc3c4df5b6e4ac5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:05.867574 28606 ts_tablet_manager.cc:1905] T 2c1c26d036c74a5aa837b93505d63fe6 P 9dfef3fea5f2494e8f4d04ff1fd363cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:05.870448 28605 ts_tablet_manager.cc:1939] T 2c1c26d036c74a5aa837b93505d63fe6 P 3ec9ae52da7a492d9e3966df88a3261a: Deleting consensus metadata
I20260811 18:47:05.873286 27606 catalog_manager.cc:4841] TS 3ec9ae52da7a492d9e3966df88a3261a (127.25.25.1:44855): tablet 2c1c26d036c74a5aa837b93505d63fe6 (table test-table [id=d1a6037bf54549b4ab9a3c20a5c643af]) successfully deleted
I20260811 18:47:05.874572 28559 tablet_bootstrap.cc:492] T 05389bd8049d441fa4e24d8b66cd697c P 9dfef3fea5f2494e8f4d04ff1fd363cc: Bootstrap starting.
I20260811 18:47:05.875391 28606 ts_tablet_manager.cc:1918] T 2c1c26d036c74a5aa837b93505d63fe6 P 9dfef3fea5f2494e8f4d04ff1fd363cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:47:05.875626 28606 log.cc:1196] T 2c1c26d036c74a5aa837b93505d63fe6 P 9dfef3fea5f2494e8f4d04ff1fd363cc: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-2/wal/wals/2c1c26d036c74a5aa837b93505d63fe6
I20260811 18:47:05.876358 28606 ts_tablet_manager.cc:1939] T 2c1c26d036c74a5aa837b93505d63fe6 P 9dfef3fea5f2494e8f4d04ff1fd363cc: Deleting consensus metadata
I20260811 18:47:05.876566 28559 tablet_bootstrap.cc:654] T 05389bd8049d441fa4e24d8b66cd697c P 9dfef3fea5f2494e8f4d04ff1fd363cc: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:05.878552 27606 catalog_manager.cc:4841] TS 9dfef3fea5f2494e8f4d04ff1fd363cc (127.25.25.3:36595): tablet 2c1c26d036c74a5aa837b93505d63fe6 (table test-table [id=d1a6037bf54549b4ab9a3c20a5c643af]) successfully deleted
I20260811 18:47:05.879860 28563 tablet_bootstrap.cc:492] T 05389bd8049d441fa4e24d8b66cd697c P 5a386ce6c6cd477aafc3c4df5b6e4ac5: Bootstrap starting.
I20260811 18:47:05.880795 28562 tablet_bootstrap.cc:492] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a: Bootstrap starting.
I20260811 18:47:05.881748 28563 tablet_bootstrap.cc:654] T 05389bd8049d441fa4e24d8b66cd697c P 5a386ce6c6cd477aafc3c4df5b6e4ac5: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:05.882606 28562 tablet_bootstrap.cc:654] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:05.884681 28559 tablet_bootstrap.cc:492] T 05389bd8049d441fa4e24d8b66cd697c P 9dfef3fea5f2494e8f4d04ff1fd363cc: No bootstrap required, opened a new log
I20260811 18:47:05.884853 28559 ts_tablet_manager.cc:1397] T 05389bd8049d441fa4e24d8b66cd697c P 9dfef3fea5f2494e8f4d04ff1fd363cc: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20260811 18:47:05.883991 28602 ts_tablet_manager.cc:1918] T 2c1c26d036c74a5aa837b93505d63fe6 P 5a386ce6c6cd477aafc3c4df5b6e4ac5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:47:05.885738 28559 raft_consensus.cc:348] T 05389bd8049d441fa4e24d8b66cd697c P 9dfef3fea5f2494e8f4d04ff1fd363cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } }
I20260811 18:47:05.885991 28559 raft_consensus.cc:374] T 05389bd8049d441fa4e24d8b66cd697c P 9dfef3fea5f2494e8f4d04ff1fd363cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:05.886098 28559 raft_consensus.cc:729] T 05389bd8049d441fa4e24d8b66cd697c P 9dfef3fea5f2494e8f4d04ff1fd363cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dfef3fea5f2494e8f4d04ff1fd363cc, State: Initialized, Role: FOLLOWER
I20260811 18:47:05.886273 28602 log.cc:1196] T 2c1c26d036c74a5aa837b93505d63fe6 P 5a386ce6c6cd477aafc3c4df5b6e4ac5: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-1/wal/wals/2c1c26d036c74a5aa837b93505d63fe6
I20260811 18:47:05.886567 28559 consensus_queue.cc:260] T 05389bd8049d441fa4e24d8b66cd697c P 9dfef3fea5f2494e8f4d04ff1fd363cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } }
I20260811 18:47:05.887071 28602 ts_tablet_manager.cc:1939] T 2c1c26d036c74a5aa837b93505d63fe6 P 5a386ce6c6cd477aafc3c4df5b6e4ac5: Deleting consensus metadata
I20260811 18:47:05.887231 28559 ts_tablet_manager.cc:1428] T 05389bd8049d441fa4e24d8b66cd697c P 9dfef3fea5f2494e8f4d04ff1fd363cc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:47:05.889284 27606 catalog_manager.cc:4841] TS 5a386ce6c6cd477aafc3c4df5b6e4ac5 (127.25.25.2:44101): tablet 2c1c26d036c74a5aa837b93505d63fe6 (table test-table [id=d1a6037bf54549b4ab9a3c20a5c643af]) successfully deleted
I20260811 18:47:05.891431 28562 tablet_bootstrap.cc:492] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a: No bootstrap required, opened a new log
I20260811 18:47:05.891623 28562 ts_tablet_manager.cc:1397] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.005s
I20260811 18:47:05.892313 28563 tablet_bootstrap.cc:492] T 05389bd8049d441fa4e24d8b66cd697c P 5a386ce6c6cd477aafc3c4df5b6e4ac5: No bootstrap required, opened a new log
I20260811 18:47:05.892496 28563 ts_tablet_manager.cc:1397] T 05389bd8049d441fa4e24d8b66cd697c P 5a386ce6c6cd477aafc3c4df5b6e4ac5: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.000s
I20260811 18:47:05.892680 28562 raft_consensus.cc:348] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } }
I20260811 18:47:05.892948 28562 raft_consensus.cc:374] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:05.893046 28562 raft_consensus.cc:729] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ec9ae52da7a492d9e3966df88a3261a, State: Initialized, Role: FOLLOWER
I20260811 18:47:05.893347 28562 consensus_queue.cc:260] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } }
I20260811 18:47:05.894086 28562 ts_tablet_manager.cc:1428] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:47:05.893669 28563 raft_consensus.cc:348] T 05389bd8049d441fa4e24d8b66cd697c P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } }
I20260811 18:47:05.894454 28563 raft_consensus.cc:374] T 05389bd8049d441fa4e24d8b66cd697c P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:05.894578 28563 raft_consensus.cc:729] T 05389bd8049d441fa4e24d8b66cd697c P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a386ce6c6cd477aafc3c4df5b6e4ac5, State: Initialized, Role: FOLLOWER
I20260811 18:47:05.895725 28563 consensus_queue.cc:260] T 05389bd8049d441fa4e24d8b66cd697c P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } }
I20260811 18:47:05.897806 28563 ts_tablet_manager.cc:1428] T 05389bd8049d441fa4e24d8b66cd697c P 5a386ce6c6cd477aafc3c4df5b6e4ac5: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260811 18:47:05.908002 28574 raft_consensus.cc:482] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:47:05.908284 28574 raft_consensus.cc:504] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } }
I20260811 18:47:05.908981 28574 leader_election.cc:288] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a386ce6c6cd477aafc3c4df5b6e4ac5 (127.25.25.2:44101), 9dfef3fea5f2494e8f4d04ff1fd363cc (127.25.25.3:36595)
I20260811 18:47:05.909682 28434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05389bd8049d441fa4e24d8b66cd697c" candidate_uuid: "3ec9ae52da7a492d9e3966df88a3261a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" is_pre_election: true
I20260811 18:47:05.909703 28172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05389bd8049d441fa4e24d8b66cd697c" candidate_uuid: "3ec9ae52da7a492d9e3966df88a3261a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" is_pre_election: true
I20260811 18:47:05.909929 28434 raft_consensus.cc:2454] T 05389bd8049d441fa4e24d8b66cd697c P 9dfef3fea5f2494e8f4d04ff1fd363cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ec9ae52da7a492d9e3966df88a3261a in term 0.
I20260811 18:47:05.909971 28172 raft_consensus.cc:2454] T 05389bd8049d441fa4e24d8b66cd697c P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ec9ae52da7a492d9e3966df88a3261a in term 0.
I20260811 18:47:05.910382 27782 leader_election.cc:302] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ec9ae52da7a492d9e3966df88a3261a, 9dfef3fea5f2494e8f4d04ff1fd363cc; no voters:
I20260811 18:47:05.910692 28574 raft_consensus.cc:2781] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:47:05.910794 28574 raft_consensus.cc:482] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:47:05.910905 28574 raft_consensus.cc:3037] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:05.913614 28574 raft_consensus.cc:504] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } }
I20260811 18:47:05.914166 28574 leader_election.cc:288] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a [CANDIDATE]: Term 1 election: Requested vote from peers 5a386ce6c6cd477aafc3c4df5b6e4ac5 (127.25.25.2:44101), 9dfef3fea5f2494e8f4d04ff1fd363cc (127.25.25.3:36595)
I20260811 18:47:05.914750 28172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05389bd8049d441fa4e24d8b66cd697c" candidate_uuid: "3ec9ae52da7a492d9e3966df88a3261a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5"
I20260811 18:47:05.914789 28434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05389bd8049d441fa4e24d8b66cd697c" candidate_uuid: "3ec9ae52da7a492d9e3966df88a3261a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc"
I20260811 18:47:05.914994 28434 raft_consensus.cc:3037] T 05389bd8049d441fa4e24d8b66cd697c P 9dfef3fea5f2494e8f4d04ff1fd363cc [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:05.914973 28172 raft_consensus.cc:3037] T 05389bd8049d441fa4e24d8b66cd697c P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:05.917338 28434 raft_consensus.cc:2454] T 05389bd8049d441fa4e24d8b66cd697c P 9dfef3fea5f2494e8f4d04ff1fd363cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ec9ae52da7a492d9e3966df88a3261a in term 1.
I20260811 18:47:05.917790 27782 leader_election.cc:302] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ec9ae52da7a492d9e3966df88a3261a, 9dfef3fea5f2494e8f4d04ff1fd363cc; no voters:
I20260811 18:47:05.918102 28574 raft_consensus.cc:2781] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:05.918081 28172 raft_consensus.cc:2454] T 05389bd8049d441fa4e24d8b66cd697c P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ec9ae52da7a492d9e3966df88a3261a in term 1.
I20260811 18:47:05.918287 28574 raft_consensus.cc:686] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a [term 1 LEADER]: Becoming Leader. State: Replica: 3ec9ae52da7a492d9e3966df88a3261a, State: Running, Role: LEADER
I20260811 18:47:05.918609 28574 consensus_queue.cc:237] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } }
I20260811 18:47:05.921576 27631 catalog_manager.cc:5495] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ec9ae52da7a492d9e3966df88a3261a (127.25.25.1). New cstate: current_term: 1 leader_uuid: "3ec9ae52da7a492d9e3966df88a3261a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } health_report { overall_health: UNKNOWN } } }
W20260811 18:47:05.936491 28002 tablet.cc:2369] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 18:47:05 dist-test-slave-lgr5 krb5kdc[27556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474023, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:05.981106 28305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:05.962924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50442 (local address 127.25.25.62:37899)
0811 18:47:05.963155 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:05.963162 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:05.963910 (+ 748us) server_negotiation.cc:407] Connection header received
0811 18:47:05.964240 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:05.964246 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:05.964374 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:05.964509 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:05.966106 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.966928 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.968897 (+ 1969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.969392 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.969510 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:05.974216 (+ 4706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:05.974248 (+ 32us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:05.974255 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:05.974296 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:05.978154 (+ 3858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:05.978954 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:05.978960 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:05.978964 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:05.979110 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:05.979484 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:05.979490 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:05.979493 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:05.979769 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:05.979906 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:05.980405 (+ 499us) server_negotiation.cc:299] Negotiation successful
0811 18:47:05.980763 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":139,"server-negotiator.queue_time_us":67}
I20260811 18:47:05.981139 28625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:05.962923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:37899 (local address 127.0.0.1:50442)
0811 18:47:05.963791 (+ 868us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:05.963812 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:05.963986 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:05.964561 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:05.964566 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:05.965558 (+ 992us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:05.965913 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:05.965927 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.967082 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.967088 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:05.968720 (+ 1632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:05.968737 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:05.969592 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:05.969599 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:05.969783 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:05.970543 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:05.970569 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:05.973939 (+ 3370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:05.978316 (+ 4377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:05.978335 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:05.978345 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:05.978823 (+ 478us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:05.979223 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:05.979228 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:05.979232 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:05.979374 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:05.979907 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:05.979917 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:05.980133 (+ 216us) client_negotiation.cc:769] Sending connection context
0811 18:47:05.980304 (+ 171us) client_negotiation.cc:240] Negotiation successful
0811 18:47:05.980622 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":693,"thread_start_us":456,"threads_started":1}
I20260811 18:47:05.986912 27631 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:50442:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 18:47:05.988339 27631 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:47:05.997115 27877 tablet_service.cc:1467] Processing CreateTablet for tablet 05e4c42d184b4a999768862887426567 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=bb293a3545124331a5848afcc42f2c75]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:47:05.997377 28119 tablet_service.cc:1467] Processing CreateTablet for tablet 05e4c42d184b4a999768862887426567 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=bb293a3545124331a5848afcc42f2c75]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:47:05.997725 27877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05e4c42d184b4a999768862887426567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:05.997931 28119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05e4c42d184b4a999768862887426567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:06.001252 28391 tablet_service.cc:1467] Processing CreateTablet for tablet 05e4c42d184b4a999768862887426567 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=bb293a3545124331a5848afcc42f2c75]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:47:06.001897 28391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05e4c42d184b4a999768862887426567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:06.005802 28562 tablet_bootstrap.cc:492] T 05e4c42d184b4a999768862887426567 P 3ec9ae52da7a492d9e3966df88a3261a: Bootstrap starting.
I20260811 18:47:06.007901 28562 tablet_bootstrap.cc:654] T 05e4c42d184b4a999768862887426567 P 3ec9ae52da7a492d9e3966df88a3261a: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:06.015575 28563 tablet_bootstrap.cc:492] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5: Bootstrap starting.
I20260811 18:47:06.017469 28563 tablet_bootstrap.cc:654] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:06.019546 28562 tablet_bootstrap.cc:492] T 05e4c42d184b4a999768862887426567 P 3ec9ae52da7a492d9e3966df88a3261a: No bootstrap required, opened a new log
I20260811 18:47:06.019797 28562 ts_tablet_manager.cc:1397] T 05e4c42d184b4a999768862887426567 P 3ec9ae52da7a492d9e3966df88a3261a: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.008s
I20260811 18:47:06.020782 28559 tablet_bootstrap.cc:492] T 05e4c42d184b4a999768862887426567 P 9dfef3fea5f2494e8f4d04ff1fd363cc: Bootstrap starting.
I20260811 18:47:06.022552 28559 tablet_bootstrap.cc:654] T 05e4c42d184b4a999768862887426567 P 9dfef3fea5f2494e8f4d04ff1fd363cc: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:06.025202 28562 raft_consensus.cc:348] T 05e4c42d184b4a999768862887426567 P 3ec9ae52da7a492d9e3966df88a3261a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } }
I20260811 18:47:06.025544 28562 raft_consensus.cc:374] T 05e4c42d184b4a999768862887426567 P 3ec9ae52da7a492d9e3966df88a3261a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:06.025636 28562 raft_consensus.cc:729] T 05e4c42d184b4a999768862887426567 P 3ec9ae52da7a492d9e3966df88a3261a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ec9ae52da7a492d9e3966df88a3261a, State: Initialized, Role: FOLLOWER
I20260811 18:47:06.025914 28562 consensus_queue.cc:260] T 05e4c42d184b4a999768862887426567 P 3ec9ae52da7a492d9e3966df88a3261a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } }
I20260811 18:47:06.027761 28574 tablet_replica.cc:439] T 05e4c42d184b4a999768862887426567 P 3ec9ae52da7a492d9e3966df88a3261a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } } }
I20260811 18:47:06.028162 28574 tablet_replica.cc:442] T 05e4c42d184b4a999768862887426567 P 3ec9ae52da7a492d9e3966df88a3261a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:47:06.029577 28563 tablet_bootstrap.cc:492] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5: No bootstrap required, opened a new log
I20260811 18:47:06.029870 28563 ts_tablet_manager.cc:1397] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.009s
I20260811 18:47:06.030043 28559 tablet_bootstrap.cc:492] T 05e4c42d184b4a999768862887426567 P 9dfef3fea5f2494e8f4d04ff1fd363cc: No bootstrap required, opened a new log
I20260811 18:47:06.030220 28559 ts_tablet_manager.cc:1397] T 05e4c42d184b4a999768862887426567 P 9dfef3fea5f2494e8f4d04ff1fd363cc: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.004s
I20260811 18:47:06.031008 28563 raft_consensus.cc:348] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } }
I20260811 18:47:06.031047 28559 raft_consensus.cc:348] T 05e4c42d184b4a999768862887426567 P 9dfef3fea5f2494e8f4d04ff1fd363cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } }
I20260811 18:47:06.031282 28559 raft_consensus.cc:374] T 05e4c42d184b4a999768862887426567 P 9dfef3fea5f2494e8f4d04ff1fd363cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:06.031277 28563 raft_consensus.cc:374] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:06.031371 28559 raft_consensus.cc:729] T 05e4c42d184b4a999768862887426567 P 9dfef3fea5f2494e8f4d04ff1fd363cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dfef3fea5f2494e8f4d04ff1fd363cc, State: Initialized, Role: FOLLOWER
I20260811 18:47:06.031373 28563 raft_consensus.cc:729] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a386ce6c6cd477aafc3c4df5b6e4ac5, State: Initialized, Role: FOLLOWER
I20260811 18:47:06.031648 28559 consensus_queue.cc:260] T 05e4c42d184b4a999768862887426567 P 9dfef3fea5f2494e8f4d04ff1fd363cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } }
I20260811 18:47:06.031651 28563 consensus_queue.cc:260] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } }
I20260811 18:47:06.032301 28563 ts_tablet_manager.cc:1428] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:47:06.032294 28559 ts_tablet_manager.cc:1428] T 05e4c42d184b4a999768862887426567 P 9dfef3fea5f2494e8f4d04ff1fd363cc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:47:06.032207 28572 tablet_replica.cc:439] T 05e4c42d184b4a999768862887426567 P 9dfef3fea5f2494e8f4d04ff1fd363cc: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } } }
I20260811 18:47:06.032605 28572 tablet_replica.cc:442] T 05e4c42d184b4a999768862887426567 P 9dfef3fea5f2494e8f4d04ff1fd363cc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:47:06.032908 28562 ts_tablet_manager.cc:1428] T 05e4c42d184b4a999768862887426567 P 3ec9ae52da7a492d9e3966df88a3261a: Time spent starting tablet: real 0.013s user 0.000s sys 0.002s
I20260811 18:47:06.032985 28577 tablet_replica.cc:439] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } } }
I20260811 18:47:06.033349 28577 tablet_replica.cc:442] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:47:06.155370 28577 raft_consensus.cc:482] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:47:06.155628 28577 raft_consensus.cc:504] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } }
I20260811 18:47:06.157474 28577 leader_election.cc:288] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ec9ae52da7a492d9e3966df88a3261a (127.25.25.1:44855), 9dfef3fea5f2494e8f4d04ff1fd363cc (127.25.25.3:36595)
I20260811 18:47:06.166560 28553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:06.159236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:47133 (local address 127.25.25.3:36595)
0811 18:47:06.159432 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:06.159438 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:06.160252 (+ 814us) server_negotiation.cc:407] Connection header received
0811 18:47:06.160405 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:06.160412 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:06.160495 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:06.160591 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:06.161279 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.162030 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.164010 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.165287 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.165419 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:06.165537 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:06.166164 (+ 627us) server_negotiation.cc:299] Negotiation successful
0811 18:47:06.166311 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 18:47:06.166678 28634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:06.159002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:36595 (local address 127.25.25.2:47133)
0811 18:47:06.160057 (+ 1055us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:06.160105 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:06.160248 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:06.160635 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:06.160640 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:06.160667 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:06.161083 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:06.161098 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.162177 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.162181 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:06.163794 (+ 1613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:06.163814 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.165759 (+ 1945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.165764 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:06.165961 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:06.166015 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 18:47:06.166106 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 18:47:06.166261 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":890,"mutex_wait_us":64,"thread_start_us":603,"threads_started":1}
I20260811 18:47:06.166719 28546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:06.158054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:53461 (local address 127.25.25.1:44855)
0811 18:47:06.158281 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:06.158292 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:06.158913 (+ 621us) server_negotiation.cc:407] Connection header received
0811 18:47:06.159165 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:06.159172 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:06.159265 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:06.159337 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:06.160246 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.161222 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.163971 (+ 2749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.165375 (+ 1404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.165536 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:06.165636 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:06.166236 (+ 600us) server_negotiation.cc:299] Negotiation successful
0811 18:47:06.166404 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 18:47:06.167570 28632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:06.157860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:44855 (local address 127.25.25.2:53461)
0811 18:47:06.158756 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:06.158775 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:06.158942 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:06.159577 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:06.159585 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:06.159617 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:06.160035 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:06.160050 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.161358 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.161364 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:06.163764 (+ 2400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:06.163789 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.165677 (+ 1888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.165686 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:06.165974 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:06.166054 (+ 80us) client_negotiation.cc:769] Sending connection context
0811 18:47:06.167009 (+ 955us) client_negotiation.cc:240] Negotiation successful
0811 18:47:06.167166 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":766,"mutex_wait_us":81,"thread_start_us":601,"threads_started":1}
I20260811 18:47:06.167650 28434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05e4c42d184b4a999768862887426567" candidate_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" is_pre_election: true
I20260811 18:47:06.167986 28434 raft_consensus.cc:2454] T 05e4c42d184b4a999768862887426567 P 9dfef3fea5f2494e8f4d04ff1fd363cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a386ce6c6cd477aafc3c4df5b6e4ac5 in term 0.
I20260811 18:47:06.168656 28038 leader_election.cc:302] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a386ce6c6cd477aafc3c4df5b6e4ac5, 9dfef3fea5f2494e8f4d04ff1fd363cc; no voters:
I20260811 18:47:06.168640 27909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05e4c42d184b4a999768862887426567" candidate_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ec9ae52da7a492d9e3966df88a3261a" is_pre_election: true
I20260811 18:47:06.169070 28577 raft_consensus.cc:2781] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:47:06.169166 28577 raft_consensus.cc:482] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:47:06.169234 28577 raft_consensus.cc:3037] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:06.169209 27909 raft_consensus.cc:2454] T 05e4c42d184b4a999768862887426567 P 3ec9ae52da7a492d9e3966df88a3261a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a386ce6c6cd477aafc3c4df5b6e4ac5 in term 0.
I20260811 18:47:06.171762 28577 raft_consensus.cc:504] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } }
I20260811 18:47:06.172425 28577 leader_election.cc:288] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [CANDIDATE]: Term 1 election: Requested vote from peers 3ec9ae52da7a492d9e3966df88a3261a (127.25.25.1:44855), 9dfef3fea5f2494e8f4d04ff1fd363cc (127.25.25.3:36595)
I20260811 18:47:06.173118 27909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05e4c42d184b4a999768862887426567" candidate_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ec9ae52da7a492d9e3966df88a3261a"
I20260811 18:47:06.173385 27909 raft_consensus.cc:3037] T 05e4c42d184b4a999768862887426567 P 3ec9ae52da7a492d9e3966df88a3261a [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:06.173349 28434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05e4c42d184b4a999768862887426567" candidate_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc"
I20260811 18:47:06.173588 28434 raft_consensus.cc:3037] T 05e4c42d184b4a999768862887426567 P 9dfef3fea5f2494e8f4d04ff1fd363cc [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:06.176656 28434 raft_consensus.cc:2454] T 05e4c42d184b4a999768862887426567 P 9dfef3fea5f2494e8f4d04ff1fd363cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a386ce6c6cd477aafc3c4df5b6e4ac5 in term 1.
I20260811 18:47:06.176949 27909 raft_consensus.cc:2454] T 05e4c42d184b4a999768862887426567 P 3ec9ae52da7a492d9e3966df88a3261a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a386ce6c6cd477aafc3c4df5b6e4ac5 in term 1.
I20260811 18:47:06.177248 28038 leader_election.cc:302] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a386ce6c6cd477aafc3c4df5b6e4ac5, 9dfef3fea5f2494e8f4d04ff1fd363cc; no voters:
I20260811 18:47:06.177640 28577 raft_consensus.cc:2781] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:06.178205 28577 raft_consensus.cc:686] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 1 LEADER]: Becoming Leader. State: Replica: 5a386ce6c6cd477aafc3c4df5b6e4ac5, State: Running, Role: LEADER
I20260811 18:47:06.178674 28577 consensus_queue.cc:237] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } }
I20260811 18:47:06.181166 28635 tablet_replica.cc:439] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5: TxnStatusTablet state changed. Reason: New leader 5a386ce6c6cd477aafc3c4df5b6e4ac5. Latest consensus state: current_term: 1 leader_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } } }
I20260811 18:47:06.181697 28635 tablet_replica.cc:442] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:47:06.182459 28638 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 18:47:06.182689 28638 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 18:47:06.183403 27630 catalog_manager.cc:5495] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a386ce6c6cd477aafc3c4df5b6e4ac5 (127.25.25.2). New cstate: current_term: 1 leader_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } health_report { overall_health: UNKNOWN } } }
I20260811 18:47:06.207547 28625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:06.199064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:44101 (local address 127.0.0.1:42034)
0811 18:47:06.199333 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:06.199354 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:06.199528 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:06.200211 (+ 683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:06.200216 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:06.200231 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:47:06.200467 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:06.200481 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.202040 (+ 1559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.202046 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:06.203737 (+ 1691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:06.203758 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.204911 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.204918 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:06.205149 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:06.205259 (+ 110us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:47:06.206560 (+ 1301us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:47:06.206593 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 18:47:06.206708 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 18:47:06.206894 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 18:47:06.208297 28555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:06.199214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42034 (local address 127.25.25.2:44101)
0811 18:47:06.199394 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:06.199400 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:06.199421 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:47:06.199801 (+ 380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:06.199807 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:06.199952 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:06.200157 (+ 205us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:47:06.200644 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.201884 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.203922 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.204700 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.204862 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:06.205555 (+ 693us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:47:06.206424 (+ 869us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:47:06.206607 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:06.207835 (+ 1228us) server_negotiation.cc:299] Negotiation successful
0811 18:47:06.207944 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 18:47:06.213433 28434 raft_consensus.cc:1261] T 05e4c42d184b4a999768862887426567 P 9dfef3fea5f2494e8f4d04ff1fd363cc [term 1 FOLLOWER]: Refusing update from remote peer 5a386ce6c6cd477aafc3c4df5b6e4ac5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:47:06.213747 27909 raft_consensus.cc:1261] T 05e4c42d184b4a999768862887426567 P 3ec9ae52da7a492d9e3966df88a3261a [term 1 FOLLOWER]: Refusing update from remote peer 5a386ce6c6cd477aafc3c4df5b6e4ac5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:47:06.214787 28577 consensus_queue.cc:1035] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:47:06.215286 28635 consensus_queue.cc:1035] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:47:06.220189 28574 tablet_replica.cc:439] T 05e4c42d184b4a999768862887426567 P 3ec9ae52da7a492d9e3966df88a3261a: TxnStatusTablet state changed. Reason: New leader 5a386ce6c6cd477aafc3c4df5b6e4ac5. Latest consensus state: current_term: 1 leader_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } } }
I20260811 18:47:06.220585 28574 tablet_replica.cc:442] T 05e4c42d184b4a999768862887426567 P 3ec9ae52da7a492d9e3966df88a3261a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:47:06.227588 28574 tablet_replica.cc:439] T 05e4c42d184b4a999768862887426567 P 3ec9ae52da7a492d9e3966df88a3261a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } } }
I20260811 18:47:06.227933 28574 tablet_replica.cc:442] T 05e4c42d184b4a999768862887426567 P 3ec9ae52da7a492d9e3966df88a3261a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:47:06.231118 28577 tablet_replica.cc:439] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } } }
I20260811 18:47:06.231484 28577 tablet_replica.cc:442] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:47:06.236506 28572 tablet_replica.cc:439] T 05e4c42d184b4a999768862887426567 P 9dfef3fea5f2494e8f4d04ff1fd363cc: TxnStatusTablet state changed. Reason: New leader 5a386ce6c6cd477aafc3c4df5b6e4ac5. Latest consensus state: current_term: 1 leader_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } } }
I20260811 18:47:06.236812 28572 tablet_replica.cc:442] T 05e4c42d184b4a999768862887426567 P 9dfef3fea5f2494e8f4d04ff1fd363cc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:47:06.240492 28577 tablet_replica.cc:439] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } } }
I20260811 18:47:06.240829 28577 tablet_replica.cc:442] T 05e4c42d184b4a999768862887426567 P 5a386ce6c6cd477aafc3c4df5b6e4ac5: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:47:06.245579 28572 tablet_replica.cc:439] T 05e4c42d184b4a999768862887426567 P 9dfef3fea5f2494e8f4d04ff1fd363cc: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ec9ae52da7a492d9e3966df88a3261a" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 44855 } } peers { permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 } } peers { permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 } } }
I20260811 18:47:06.245884 28572 tablet_replica.cc:442] T 05e4c42d184b4a999768862887426567 P 9dfef3fea5f2494e8f4d04ff1fd363cc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:47:06.277037 28555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:06.263005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:59453 (local address 127.25.25.2:44101)
0811 18:47:06.263263 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:06.263269 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:06.269075 (+ 5806us) server_negotiation.cc:407] Connection header received
0811 18:47:06.269349 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:06.269356 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:06.269491 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:06.269621 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:47:06.270239 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.271498 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.274460 (+ 2962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.275233 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.275394 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:06.276149 (+ 755us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:47:06.276321 (+ 172us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:47:06.276440 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:06.276599 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 18:47:06.276701 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260811 18:47:06.277170 28650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:06.263022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:44101 (local address 127.25.25.1:59453)
0811 18:47:06.268894 (+ 5872us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:06.268921 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:06.269156 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:06.269655 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:06.269661 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:06.269676 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:47:06.270017 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:06.270031 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.271665 (+ 1634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.271671 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:06.274210 (+ 2539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:06.274236 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.275497 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.275505 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:06.275748 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:06.275850 (+ 102us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:47:06.276449 (+ 599us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:47:06.276464 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 18:47:06.276556 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 18:47:06.276739 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5615,"thread_start_us":5309,"threads_started":1}
I20260811 18:47:06.295712 28172 raft_consensus.cc:1261] T 05389bd8049d441fa4e24d8b66cd697c P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 1 FOLLOWER]: Refusing update from remote peer 3ec9ae52da7a492d9e3966df88a3261a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:47:06.296605 28575 consensus_queue.cc:1035] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a386ce6c6cd477aafc3c4df5b6e4ac5" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:47:06.300650 28434 raft_consensus.cc:1261] T 05389bd8049d441fa4e24d8b66cd697c P 9dfef3fea5f2494e8f4d04ff1fd363cc [term 1 FOLLOWER]: Refusing update from remote peer 3ec9ae52da7a492d9e3966df88a3261a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:47:06.301613 28575 consensus_queue.cc:1035] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dfef3fea5f2494e8f4d04ff1fd363cc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:47:06.313632 28584 mvcc.cc:205] Tried to move back new op lower bound from 7317397611695017984 to 7317397610165284864. Current Snapshot: MvccSnapshot[applied={T|T < 7317397611695017984}]
I20260811 18:47:06.326719 28588 mvcc.cc:205] Tried to move back new op lower bound from 7317397611695017984 to 7317397610165284864. Current Snapshot: MvccSnapshot[applied={T|T < 7317397611695017984}]
I20260811 18:47:06.359918 28546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:06.351524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:33243 (local address 127.25.25.1:44855)
0811 18:47:06.351710 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:06.351716 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:06.352518 (+ 802us) server_negotiation.cc:407] Connection header received
0811 18:47:06.352849 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:06.352856 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:06.352958 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:06.353022 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:47:06.353987 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.355269 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.357540 (+ 2271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.358252 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.358357 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:06.359061 (+ 704us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:47:06.359214 (+ 153us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:47:06.359325 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:06.359482 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 18:47:06.359588 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 18:47:06.360064 28667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:06.351519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:44855 (local address 127.25.25.2:33243)
0811 18:47:06.352400 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:06.352421 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:06.352650 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:06.353235 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:06.353241 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:06.353258 (+ 17us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:47:06.353736 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:06.353749 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.355465 (+ 1716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.355471 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:06.357350 (+ 1879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:06.357368 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.358569 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.358575 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:06.358754 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:06.358837 (+ 83us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:47:06.359342 (+ 505us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:47:06.359355 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 18:47:06.359442 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 18:47:06.359626 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":668,"thread_start_us":3276,"threads_started":1}
I20260811 18:47:06.406579 27631 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50430:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:47:06.406904 27631 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50430:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:47:06.410770 27631 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9d9be757d2e3458ab152f35ec6b0d501: Sending DeleteTablet for 3 replicas of tablet 05389bd8049d441fa4e24d8b66cd697c
I20260811 18:47:06.411752 27877 tablet_service.cc:1514] Processing DeleteTablet for tablet 05389bd8049d441fa4e24d8b66cd697c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:06 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:44396
I20260811 18:47:06.411975 28119 tablet_service.cc:1514] Processing DeleteTablet for tablet 05389bd8049d441fa4e24d8b66cd697c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:06 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:42030
I20260811 18:47:06.412245 28391 tablet_service.cc:1514] Processing DeleteTablet for tablet 05389bd8049d441fa4e24d8b66cd697c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:06 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:48920
I20260811 18:47:06.421232 28674 tablet_replica.cc:330] T 05389bd8049d441fa4e24d8b66cd697c P 9dfef3fea5f2494e8f4d04ff1fd363cc: stopping tablet replica
I20260811 18:47:06.421469 28673 tablet_replica.cc:330] T 05389bd8049d441fa4e24d8b66cd697c P 5a386ce6c6cd477aafc3c4df5b6e4ac5: stopping tablet replica
I20260811 18:47:06.421530 28674 raft_consensus.cc:2229] T 05389bd8049d441fa4e24d8b66cd697c P 9dfef3fea5f2494e8f4d04ff1fd363cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:47:06.421698 28673 raft_consensus.cc:2229] T 05389bd8049d441fa4e24d8b66cd697c P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:47:06.421818 28674 raft_consensus.cc:2258] T 05389bd8049d441fa4e24d8b66cd697c P 9dfef3fea5f2494e8f4d04ff1fd363cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:06.422432 28673 raft_consensus.cc:2258] T 05389bd8049d441fa4e24d8b66cd697c P 5a386ce6c6cd477aafc3c4df5b6e4ac5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:06.423235 28674 ts_tablet_manager.cc:1905] T 05389bd8049d441fa4e24d8b66cd697c P 9dfef3fea5f2494e8f4d04ff1fd363cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:06.423686 28673 ts_tablet_manager.cc:1905] T 05389bd8049d441fa4e24d8b66cd697c P 5a386ce6c6cd477aafc3c4df5b6e4ac5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:06.431989 28673 ts_tablet_manager.cc:1918] T 05389bd8049d441fa4e24d8b66cd697c P 5a386ce6c6cd477aafc3c4df5b6e4ac5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:47:06.432189 28673 log.cc:1196] T 05389bd8049d441fa4e24d8b66cd697c P 5a386ce6c6cd477aafc3c4df5b6e4ac5: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-1/wal/wals/05389bd8049d441fa4e24d8b66cd697c
I20260811 18:47:06.432714 28673 ts_tablet_manager.cc:1939] T 05389bd8049d441fa4e24d8b66cd697c P 5a386ce6c6cd477aafc3c4df5b6e4ac5: Deleting consensus metadata
I20260811 18:47:06.433990 27606 catalog_manager.cc:4841] TS 5a386ce6c6cd477aafc3c4df5b6e4ac5 (127.25.25.2:44101): tablet 05389bd8049d441fa4e24d8b66cd697c (table test-table [id=d3fc9b62d8aa416393599f7ea3784440]) successfully deleted
I20260811 18:47:06.436064 28672 tablet_replica.cc:330] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a: stopping tablet replica
I20260811 18:47:06.436506 28672 raft_consensus.cc:2229] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:47:06.437005 28672 raft_consensus.cc:2258] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:06.438642 28672 ts_tablet_manager.cc:1905] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:06.441301 28674 ts_tablet_manager.cc:1918] T 05389bd8049d441fa4e24d8b66cd697c P 9dfef3fea5f2494e8f4d04ff1fd363cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:47:06.441480 28674 log.cc:1196] T 05389bd8049d441fa4e24d8b66cd697c P 9dfef3fea5f2494e8f4d04ff1fd363cc: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-2/wal/wals/05389bd8049d441fa4e24d8b66cd697c
I20260811 18:47:06.442015 28674 ts_tablet_manager.cc:1939] T 05389bd8049d441fa4e24d8b66cd697c P 9dfef3fea5f2494e8f4d04ff1fd363cc: Deleting consensus metadata
I20260811 18:47:06.445413 27606 catalog_manager.cc:4841] TS 9dfef3fea5f2494e8f4d04ff1fd363cc (127.25.25.3:36595): tablet 05389bd8049d441fa4e24d8b66cd697c (table test-table [id=d3fc9b62d8aa416393599f7ea3784440]) successfully deleted
Aug 11 18:47:06 dist-test-slave-lgr5 krb5kdc[27556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474025, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.25.1@KRBTEST.COM
I20260811 18:47:06.447082 28672 ts_tablet_manager.cc:1918] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:47:06.447347 28672 log.cc:1196] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474012733352-25700-0/minicluster-data/ts-0/wal/wals/05389bd8049d441fa4e24d8b66cd697c
I20260811 18:47:06.447971 28672 ts_tablet_manager.cc:1939] T 05389bd8049d441fa4e24d8b66cd697c P 3ec9ae52da7a492d9e3966df88a3261a: Deleting consensus metadata
I20260811 18:47:06.449506 27606 catalog_manager.cc:4841] TS 3ec9ae52da7a492d9e3966df88a3261a (127.25.25.1:44855): tablet 05389bd8049d441fa4e24d8b66cd697c (table test-table [id=d3fc9b62d8aa416393599f7ea3784440]) successfully deleted
I20260811 18:47:06.456521 28546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:06.423881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44416 (local address 127.25.25.1:44855)
0811 18:47:06.424132 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:06.424139 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:06.434869 (+ 10730us) server_negotiation.cc:407] Connection header received
0811 18:47:06.435391 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:06.435398 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:06.435505 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:06.435614 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:06.437722 (+ 2108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.439021 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.441290 (+ 2269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.441975 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.442091 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:06.447719 (+ 5628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:06.447743 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:06.447767 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:06.447820 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:06.452187 (+ 4367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:06.453492 (+ 1305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:06.453505 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:06.453509 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:06.453744 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:06.454264 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:06.454270 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:06.454274 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:06.454825 (+ 551us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:06.455184 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:06.455819 (+ 635us) server_negotiation.cc:299] Negotiation successful
0811 18:47:06.456140 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
W20260811 18:47:06.458037 27993 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44416
I20260811 18:47:06.481953 28305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:06.464768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50444 (local address 127.25.25.62:37899)
0811 18:47:06.464976 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:06.464983 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:06.465638 (+ 655us) server_negotiation.cc:407] Connection header received
0811 18:47:06.465822 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:06.465828 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:06.465915 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:06.466024 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:06.467831 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.469024 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.471051 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.471763 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.471896 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:06.474960 (+ 3064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:06.474966 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:06.474970 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:06.475040 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:06.478512 (+ 3472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:06.479579 (+ 1067us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:06.479587 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:06.479591 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:06.479777 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:06.480286 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:06.480292 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:06.480296 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:06.480647 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:06.480894 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:06.481346 (+ 452us) server_negotiation.cc:299] Negotiation successful
0811 18:47:06.481602 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260811 18:47:06.482568 27631 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50444
I20260811 18:47:06.484535 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 27753
I20260811 18:47:06.500837 28546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:06.485716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44428 (local address 127.25.25.1:44855)
0811 18:47:06.485903 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:06.485909 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:06.486030 (+ 121us) server_negotiation.cc:407] Connection header received
0811 18:47:06.486196 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:06.486202 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:06.486290 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:06.486401 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:06.487496 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.488571 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.489758 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.490392 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.490523 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:06.493214 (+ 2691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:06.493221 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:06.493227 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:06.493278 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:06.496914 (+ 3636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:06.497920 (+ 1006us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:06.497935 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:06.497939 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:06.498145 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:06.498724 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:06.498730 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:06.498734 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:06.499352 (+ 618us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:06.499645 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:06.500021 (+ 376us) server_negotiation.cc:299] Negotiation successful
0811 18:47:06.500351 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260811 18:47:06.501550 27993 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44428
W20260811 18:47:06.502183 25700 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 27753: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:47:06.502377 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 27753
I20260811 18:47:06.547766 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 28008
Aug 11 18:47:06 dist-test-slave-lgr5 krb5kdc[27556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474025, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.25.2@KRBTEST.COM
I20260811 18:47:06.564846 28555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:06.548610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42044 (local address 127.25.25.2:44101)
0811 18:47:06.548792 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:06.548798 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:06.548881 (+ 83us) server_negotiation.cc:407] Connection header received
0811 18:47:06.549091 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:06.549095 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:06.549164 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:06.549264 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:06.550509 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.551312 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.552754 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.553275 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.553392 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:06.557847 (+ 4455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:06.557862 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:06.557884 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:06.557931 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:06.561281 (+ 3350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:06.562088 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:06.562097 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:06.562099 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:06.562263 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:06.562714 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:06.562718 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:06.562720 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:06.563168 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:06.563512 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:06.563811 (+ 299us) server_negotiation.cc:299] Negotiation successful
0811 18:47:06.564103 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
W20260811 18:47:06.565603 28249 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42044
W20260811 18:47:06.566313 25700 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 28008: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:47:06.566493 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 28008
I20260811 18:47:06.606025 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 28262
Aug 11 18:47:06 dist-test-slave-lgr5 krb5kdc[27556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474025, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.25.3@KRBTEST.COM
I20260811 18:47:06.622965 28553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:06.606865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48928 (local address 127.25.25.3:36595)
0811 18:47:06.607057 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:06.607064 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:06.607084 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:47:06.607272 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:06.607276 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:06.607345 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:06.607453 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:06.608810 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.609696 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.611472 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:06.612357 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:06.612497 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:06.617088 (+ 4591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:06.617111 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:06.617130 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:06.617182 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:06.620299 (+ 3117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:06.621141 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:06.621151 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:06.621154 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:06.621379 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:06.621687 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:06.621690 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:06.621692 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:06.622087 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:06.622366 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:06.622536 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 18:47:06.622729 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260811 18:47:06.623708 28510 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48928
W20260811 18:47:06.624418 25700 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 28262: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:47:06.624584 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 28262
I20260811 18:47:06.660370 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 27584
I20260811 18:47:06.661635 27703 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:06.780678 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 27584
2026-08-11T18:47:06Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (4969 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:47:06 dist-test-slave-lgr5 krb5kdc[28687](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:47:06 dist-test-slave-lgr5 krb5kdc[28687](info): set up 2 sockets
Aug 11 18:47:06 dist-test-slave-lgr5 krb5kdc[28687](info): commencing operation
krb5kdc: starting...
W20260811 18:47:08.040772 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.207s user 0.008s sys 0.016s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:47:08 dist-test-slave-lgr5 krb5kdc[28687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:47:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:47:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:47:08.266032 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:43997
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:34467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:43997
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:08.616614 28711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:08.617050 28711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:08.617209 28711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:08.625298 28711 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:47:08.625443 28711 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 18:47:08.625516 28711 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:08.625604 28711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:08.625674 28711 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:47:08.625756 28711 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:47:08.635999 28711 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:34467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:43997
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:43997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:08.637424 28711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:08.638881 28711 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:08.651485 28717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:08.651496 28725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:08.651563 28719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:08.652245 28711 server_base.cc:1034] running on GCE node
I20260811 18:47:08.653101 28711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:08.654660 28711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:08.655881 28711 hybrid_clock.cc:648] HybridClock initialized: now 1786474028655819 us; error 38 us; skew 500 ppm
I20260811 18:47:08.656258 28711 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:08 dist-test-slave-lgr5 krb5kdc[28687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474028, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:08.659502 28711 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:47:08.661134 28711 webserver.cc:460] Webserver started at http://127.25.25.62:44209/ using document root <none> and password file <none>
I20260811 18:47:08.661911 28711 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:08.662027 28711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:08.662388 28711 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:08.665736 28711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "838f080aecdb4ff392f5b285b334c79f"
format_stamp: "Formatted at 2026-08-11 18:47:08 on dist-test-slave-lgr5"
server_key: "c097ac27e19c1afdb1582819f71e78e5"
server_key_iv: "a9bac48453096fd0cbe4fb55d6af5d6e"
server_key_version: "encryptionkey@0"
I20260811 18:47:08.666605 28711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "838f080aecdb4ff392f5b285b334c79f"
format_stamp: "Formatted at 2026-08-11 18:47:08 on dist-test-slave-lgr5"
server_key: "c097ac27e19c1afdb1582819f71e78e5"
server_key_iv: "a9bac48453096fd0cbe4fb55d6af5d6e"
server_key_version: "encryptionkey@0"
I20260811 18:47:08.672676 28711 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 18:47:08.676617 28741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:08.678139 28711 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:47:08.678323 28711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "838f080aecdb4ff392f5b285b334c79f"
format_stamp: "Formatted at 2026-08-11 18:47:08 on dist-test-slave-lgr5"
server_key: "c097ac27e19c1afdb1582819f71e78e5"
server_key_iv: "a9bac48453096fd0cbe4fb55d6af5d6e"
server_key_version: "encryptionkey@0"
I20260811 18:47:08.678557 28711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:08.701068 28711 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:08.705729 28711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:08.706001 28711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:08.727645 28711 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:43997
I20260811 18:47:08.727663 28848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:43997 every 8 connection(s)
I20260811 18:47:08.729156 28711 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:47:08.733349 28849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:08.739516 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 28711
I20260811 18:47:08.739719 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:47:08.740396 25700 external_mini_cluster.cc:1428] Setting key eabd860dcbb630d79b720233dd3452cf
I20260811 18:47:08.744741 28849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 838f080aecdb4ff392f5b285b334c79f: Bootstrap starting.
I20260811 18:47:08.748652 28849 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 838f080aecdb4ff392f5b285b334c79f: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:08.749852 28849 log.cc:824] T 00000000000000000000000000000000 P 838f080aecdb4ff392f5b285b334c79f: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:08.753286 28849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 838f080aecdb4ff392f5b285b334c79f: No bootstrap required, opened a new log
Aug 11 18:47:08 dist-test-slave-lgr5 krb5kdc[28687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:08.762792 28849 raft_consensus.cc:348] T 00000000000000000000000000000000 P 838f080aecdb4ff392f5b285b334c79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "838f080aecdb4ff392f5b285b334c79f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43997 } }
I20260811 18:47:08.763316 28849 raft_consensus.cc:374] T 00000000000000000000000000000000 P 838f080aecdb4ff392f5b285b334c79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:08.763461 28849 raft_consensus.cc:729] T 00000000000000000000000000000000 P 838f080aecdb4ff392f5b285b334c79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 838f080aecdb4ff392f5b285b334c79f, State: Initialized, Role: FOLLOWER
I20260811 18:47:08.764284 28849 consensus_queue.cc:260] T 00000000000000000000000000000000 P 838f080aecdb4ff392f5b285b334c79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "838f080aecdb4ff392f5b285b334c79f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43997 } }
I20260811 18:47:08.764554 28849 raft_consensus.cc:388] T 00000000000000000000000000000000 P 838f080aecdb4ff392f5b285b334c79f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:47:08.764706 28849 raft_consensus.cc:482] T 00000000000000000000000000000000 P 838f080aecdb4ff392f5b285b334c79f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:47:08.764882 28849 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 838f080aecdb4ff392f5b285b334c79f [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:08.765359 28853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:08.742475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56834 (local address 127.25.25.62:43997)
0811 18:47:08.743291 (+ 816us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:08.743303 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:08.743347 (+ 44us) server_negotiation.cc:407] Connection header received
0811 18:47:08.745086 (+ 1739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:08.745111 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:08.745538 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:08.745869 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:08.747797 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:08.749453 (+ 1656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:08.751081 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:08.751889 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:08.752038 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:08.757029 (+ 4991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:08.757038 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:08.757056 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:08.757108 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:08.760480 (+ 3372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:08.761522 (+ 1042us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:08.761534 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:08.761542 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:08.761765 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:08.762195 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:08.762198 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:08.762200 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:08.762817 (+ 617us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:08.763050 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:08.763626 (+ 576us) server_negotiation.cc:299] Negotiation successful
0811 18:47:08.764074 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":601,"thread_start_us":365,"threads_started":1}
I20260811 18:47:08.767522 28849 raft_consensus.cc:504] T 00000000000000000000000000000000 P 838f080aecdb4ff392f5b285b334c79f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "838f080aecdb4ff392f5b285b334c79f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43997 } }
I20260811 18:47:08.768296 28849 leader_election.cc:302] T 00000000000000000000000000000000 P 838f080aecdb4ff392f5b285b334c79f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 838f080aecdb4ff392f5b285b334c79f; no voters:
I20260811 18:47:08.769042 28849 leader_election.cc:288] T 00000000000000000000000000000000 P 838f080aecdb4ff392f5b285b334c79f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:47:08.769181 28855 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 838f080aecdb4ff392f5b285b334c79f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:08.769940 28855 raft_consensus.cc:686] T 00000000000000000000000000000000 P 838f080aecdb4ff392f5b285b334c79f [term 1 LEADER]: Becoming Leader. State: Replica: 838f080aecdb4ff392f5b285b334c79f, State: Running, Role: LEADER
I20260811 18:47:08.770519 28855 consensus_queue.cc:237] T 00000000000000000000000000000000 P 838f080aecdb4ff392f5b285b334c79f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "838f080aecdb4ff392f5b285b334c79f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43997 } }
I20260811 18:47:08.771363 28849 sys_catalog.cc:564] T 00000000000000000000000000000000 P 838f080aecdb4ff392f5b285b334c79f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:47:08.773211 28857 sys_catalog.cc:455] T 00000000000000000000000000000000 P 838f080aecdb4ff392f5b285b334c79f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 838f080aecdb4ff392f5b285b334c79f. Latest consensus state: current_term: 1 leader_uuid: "838f080aecdb4ff392f5b285b334c79f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "838f080aecdb4ff392f5b285b334c79f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43997 } } }
I20260811 18:47:08.773612 28857 sys_catalog.cc:458] T 00000000000000000000000000000000 P 838f080aecdb4ff392f5b285b334c79f [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:08.774070 28856 sys_catalog.cc:455] T 00000000000000000000000000000000 P 838f080aecdb4ff392f5b285b334c79f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "838f080aecdb4ff392f5b285b334c79f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "838f080aecdb4ff392f5b285b334c79f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43997 } } }
I20260811 18:47:08.774561 28856 sys_catalog.cc:458] T 00000000000000000000000000000000 P 838f080aecdb4ff392f5b285b334c79f [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:08.785099 28863 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:47:08.794688 28863 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:47:08.805101 28863 catalog_manager.cc:1347] Generated new cluster ID: 53d79b77f21f438c80c6a32eefb0e686
I20260811 18:47:08.805243 28863 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:47:08.816628 28863 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:47:08.818063 28863 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:47:08.831961 28863 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 838f080aecdb4ff392f5b285b334c79f: Generated new TSK 0
I20260811 18:47:08.833266 28863 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.25.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
I20260811 18:47:08.890200 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:0
--local_ip_for_outbound_sockets=127.25.25.1
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:43997
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:34467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:09.246058 28892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:09.246420 28892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:09.246587 28892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:09.254311 28892 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:09.254477 28892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:09.254606 28892 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 18:47:09.254676 28892 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:47:09.254788 28892 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:47:09.265390 28892 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:34467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.25.62:43997
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:09.266886 28892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:09.268378 28892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:09.282440 28899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:09.282636 28898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:09.283116 28901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:09.284116 28892 server_base.cc:1034] running on GCE node
I20260811 18:47:09.284920 28892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:09.286142 28892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:09.287412 28892 hybrid_clock.cc:648] HybridClock initialized: now 1786474029287335 us; error 68 us; skew 500 ppm
I20260811 18:47:09.287894 28892 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:09 dist-test-slave-lgr5 krb5kdc[28687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474029, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:09.291752 28892 init.cc:377] Logged in from keytab as kudu/127.25.25.1@KRBTEST.COM (short username kudu)
I20260811 18:47:09.293650 28892 webserver.cc:460] Webserver started at http://127.25.25.1:46331/ using document root <none> and password file <none>
I20260811 18:47:09.294464 28892 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:09.294610 28892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:09.294973 28892 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:09.298384 28892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-0/data/instance:
uuid: "3ae515004de7466e9bff5b3268814dfd"
format_stamp: "Formatted at 2026-08-11 18:47:09 on dist-test-slave-lgr5"
server_key: "c19700828de9ad4530155aa23b6ae5dc"
server_key_iv: "58a9ba59668a6c4cf02630c1a90cb4e5"
server_key_version: "encryptionkey@0"
I20260811 18:47:09.299288 28892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance:
uuid: "3ae515004de7466e9bff5b3268814dfd"
format_stamp: "Formatted at 2026-08-11 18:47:09 on dist-test-slave-lgr5"
server_key: "c19700828de9ad4530155aa23b6ae5dc"
server_key_iv: "58a9ba59668a6c4cf02630c1a90cb4e5"
server_key_version: "encryptionkey@0"
I20260811 18:47:09.305409 28892 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260811 18:47:09.309556 28914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:09.311086 28892 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:47:09.311291 28892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "3ae515004de7466e9bff5b3268814dfd"
format_stamp: "Formatted at 2026-08-11 18:47:09 on dist-test-slave-lgr5"
server_key: "c19700828de9ad4530155aa23b6ae5dc"
server_key_iv: "58a9ba59668a6c4cf02630c1a90cb4e5"
server_key_version: "encryptionkey@0"
I20260811 18:47:09.311538 28892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:09.337668 28892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:09.351058 28892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:09.351482 28892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:09.354626 28892 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:09.354745 28892 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:09.354867 28892 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:09.354956 28892 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:47:09 dist-test-slave-lgr5 krb5kdc[28687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474029, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:09.381857 28931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:09.355588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:44825 (local address 127.25.25.62:43997)
0811 18:47:09.356231 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:09.356236 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:09.357590 (+ 1354us) server_negotiation.cc:407] Connection header received
0811 18:47:09.359898 (+ 2308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:09.359905 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:09.360011 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:09.360177 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:09.362940 (+ 2763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:09.364029 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:09.367030 (+ 3001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:09.367766 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:09.367952 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:09.373728 (+ 5776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:09.373736 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:09.373742 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:09.373794 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:09.377373 (+ 3579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:09.378605 (+ 1232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:09.378610 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:09.378612 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:09.378745 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:09.379363 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:09.379368 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:09.379371 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:09.379723 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:09.379885 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:09.381124 (+ 1239us) server_negotiation.cc:299] Negotiation successful
0811 18:47:09.381442 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":329,"threads_started":1}
I20260811 18:47:09.383769 28932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:09.356434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43997 (local address 127.25.25.1:44825)
0811 18:47:09.357384 (+ 950us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:09.357432 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:09.359549 (+ 2117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:09.360485 (+ 936us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:09.360499 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:09.361525 (+ 1026us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:09.362655 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:09.362696 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:09.364273 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:09.364282 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:09.366781 (+ 2499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:09.366803 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:09.368122 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:09.368132 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:09.368466 (+ 334us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:09.369432 (+ 966us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:09.369473 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:09.373390 (+ 3917us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:09.377589 (+ 4199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:09.377603 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:09.377629 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:09.378465 (+ 836us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:09.378862 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:09.378868 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:09.378872 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:09.379216 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:09.379895 (+ 679us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:09.379909 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:09.380581 (+ 672us) client_negotiation.cc:769] Sending connection context
0811 18:47:09.381000 (+ 419us) client_negotiation.cc:240] Negotiation successful
0811 18:47:09.381765 (+ 765us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"thread_start_us":396,"threads_started":1}
I20260811 18:47:09.398923 28892 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:46177
I20260811 18:47:09.398969 29147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:46177 every 8 connection(s)
I20260811 18:47:09.400910 28892 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:47:09.403842 29148 heartbeater.cc:347] Connected to a master server at 127.25.25.62:43997
I20260811 18:47:09.404220 29148 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:09.405141 29148 heartbeater.cc:511] Master 127.25.25.62:43997 requested a full tablet report, sending...
I20260811 18:47:09.405782 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 28892
I20260811 18:47:09.405975 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance
I20260811 18:47:09.406811 25700 external_mini_cluster.cc:1428] Setting key ebbd2aa8a7c3876f1a3f70881140cff6
I20260811 18:47:09.407262 28931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:09.390374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:46061 (local address 127.25.25.62:43997)
0811 18:47:09.390595 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:09.390601 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:09.391572 (+ 971us) server_negotiation.cc:407] Connection header received
0811 18:47:09.391784 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:09.391788 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:09.391862 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:09.391968 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:09.393719 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:09.394641 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:09.397015 (+ 2374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:09.397463 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:09.397611 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:09.400496 (+ 2885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:09.400502 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:09.400506 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:09.400546 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:09.403765 (+ 3219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:09.404749 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:09.404757 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:09.404761 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:09.404960 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:09.405454 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:09.405460 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:09.405463 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:09.405858 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:09.406043 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:09.406644 (+ 601us) server_negotiation.cc:299] Negotiation successful
0811 18:47:09.406880 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 18:47:09.407307 29106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:09.390332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43997 (local address 127.25.25.1:46061)
0811 18:47:09.391437 (+ 1105us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:09.391461 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:09.391646 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:09.392041 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:09.392047 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:09.392882 (+ 835us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:09.393529 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:09.393548 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:09.394849 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:09.394857 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:09.396812 (+ 1955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:09.396835 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:09.397797 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:09.397805 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:09.398074 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:09.398937 (+ 863us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:09.398971 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:09.400207 (+ 1236us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:09.403943 (+ 3736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:09.403950 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:09.403955 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:09.404586 (+ 631us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:09.405118 (+ 532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:09.405123 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:09.405126 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:09.405311 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:09.406118 (+ 807us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:09.406123 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:09.406352 (+ 229us) client_negotiation.cc:769] Sending connection context
0811 18:47:09.406486 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 18:47:09.406848 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":911,"thread_start_us":623,"threads_started":1}
I20260811 18:47:09.407927 28770 ts_manager.cc:194] Registered new tserver with Master: 3ae515004de7466e9bff5b3268814dfd (127.25.25.1:46177)
I20260811 18:47:09.409996 28770 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.1@KRBTEST.COM'} at 127.25.25.1:44825
WARNING: no policy specified for kudu/127.25.25.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
I20260811 18:47:09.460371 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:0
--local_ip_for_outbound_sockets=127.25.25.2
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:43997
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:34467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:09.829833 29155 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:09.830197 29155 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:09.830376 29155 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:09.838814 29155 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:09.838975 29155 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:09.839090 29155 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 18:47:09.839159 29155 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:47:09.839264 29155 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:47:09.850224 29155 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:34467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.25.62:43997
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:09.851714 29155 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:09.853245 29155 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:09.867343 29167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:09.867309 29168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:09.867403 29174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:09.868309 29155 server_base.cc:1034] running on GCE node
I20260811 18:47:09.868969 29155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:09.870034 29155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:09.871276 29155 hybrid_clock.cc:648] HybridClock initialized: now 1786474029871220 us; error 49 us; skew 500 ppm
I20260811 18:47:09.871690 29155 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:09 dist-test-slave-lgr5 krb5kdc[28687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474029, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:09.875247 29155 init.cc:377] Logged in from keytab as kudu/127.25.25.2@KRBTEST.COM (short username kudu)
I20260811 18:47:09.877099 29155 webserver.cc:460] Webserver started at http://127.25.25.2:33401/ using document root <none> and password file <none>
I20260811 18:47:09.878037 29155 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:09.878178 29155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:09.878535 29155 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:09.881968 29155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-1/data/instance:
uuid: "45671dc4f7184e85923005550b435cd3"
format_stamp: "Formatted at 2026-08-11 18:47:09 on dist-test-slave-lgr5"
server_key: "853a367cab445b69288658ab1419955c"
server_key_iv: "2bd41ffb6be0d5230e50089fecc60ca7"
server_key_version: "encryptionkey@0"
I20260811 18:47:09.882920 29155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance:
uuid: "45671dc4f7184e85923005550b435cd3"
format_stamp: "Formatted at 2026-08-11 18:47:09 on dist-test-slave-lgr5"
server_key: "853a367cab445b69288658ab1419955c"
server_key_iv: "2bd41ffb6be0d5230e50089fecc60ca7"
server_key_version: "encryptionkey@0"
I20260811 18:47:09.888903 29155 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 18:47:09.892843 29183 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:09.894403 29155 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:47:09.894632 29155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "45671dc4f7184e85923005550b435cd3"
format_stamp: "Formatted at 2026-08-11 18:47:09 on dist-test-slave-lgr5"
server_key: "853a367cab445b69288658ab1419955c"
server_key_iv: "2bd41ffb6be0d5230e50089fecc60ca7"
server_key_version: "encryptionkey@0"
I20260811 18:47:09.894856 29155 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:09.912688 29155 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:09.917522 29155 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:09.917822 29155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:09.920784 29155 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:09.920907 29155 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:09.921036 29155 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:09.921113 29155 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:47:09 dist-test-slave-lgr5 krb5kdc[28687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474029, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:09.948210 29207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:09.921604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:42259 (local address 127.25.25.62:43997)
0811 18:47:09.922102 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:09.922110 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:09.923583 (+ 1473us) server_negotiation.cc:407] Connection header received
0811 18:47:09.926872 (+ 3289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:09.926879 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:09.927000 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:09.927148 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:09.930443 (+ 3295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:09.931471 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:09.934105 (+ 2634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:09.934809 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:09.934982 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:09.940263 (+ 5281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:09.940269 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:09.940272 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:09.940314 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:09.943756 (+ 3442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:09.945156 (+ 1400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:09.945163 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:09.945166 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:09.945352 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:09.945881 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:09.945887 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:09.945891 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:09.946247 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:09.946442 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:09.947645 (+ 1203us) server_negotiation.cc:299] Negotiation successful
0811 18:47:09.947874 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":242,"threads_started":1}
I20260811 18:47:09.950150 29210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:09.922322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43997 (local address 127.25.25.2:42259)
0811 18:47:09.923348 (+ 1026us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:09.923411 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:09.926373 (+ 2962us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:09.927590 (+ 1217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:09.927606 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:09.928761 (+ 1155us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:09.930033 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:09.930077 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:09.931694 (+ 1617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:09.931698 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:09.933879 (+ 2181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:09.933903 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:09.935118 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:09.935127 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:09.935432 (+ 305us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:09.936373 (+ 941us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:09.936415 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:09.939934 (+ 3519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:09.943990 (+ 4056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:09.944006 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:09.944035 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:09.944974 (+ 939us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:09.945503 (+ 529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:09.945506 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:09.945509 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:09.945747 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:09.946425 (+ 678us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:09.946436 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:09.947035 (+ 599us) client_negotiation.cc:769] Sending connection context
0811 18:47:09.947482 (+ 447us) client_negotiation.cc:240] Negotiation successful
0811 18:47:09.948228 (+ 746us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":652,"thread_start_us":360,"threads_started":1}
I20260811 18:47:09.973021 29207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:09.957116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:52433 (local address 127.25.25.62:43997)
0811 18:47:09.957315 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:09.957331 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:09.958033 (+ 702us) server_negotiation.cc:407] Connection header received
0811 18:47:09.958212 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:09.958216 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:09.958288 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:09.958410 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:09.959717 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:09.960664 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:09.962569 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:09.962988 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:09.963108 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:09.965794 (+ 2686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:09.965802 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:09.965806 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:09.965865 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:09.969331 (+ 3466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:09.970420 (+ 1089us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:09.970424 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:09.970427 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:09.970604 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:09.971108 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:09.971114 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:09.971117 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:09.971666 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:09.971867 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:09.972378 (+ 511us) server_negotiation.cc:299] Negotiation successful
0811 18:47:09.972617 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 18:47:09.973097 29362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:09.957113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43997 (local address 127.25.25.2:52433)
0811 18:47:09.957870 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:09.957893 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:09.958090 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:09.958454 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:09.958459 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:09.959117 (+ 658us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:09.959538 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:09.959553 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:09.960852 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:09.960858 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:09.962410 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:09.962427 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:09.963204 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:09.963211 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:09.963410 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:09.964222 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:09.964250 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:09.965478 (+ 1228us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:09.969583 (+ 4105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:09.969590 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:09.969598 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:09.970262 (+ 664us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:09.970747 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:09.970752 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:09.970756 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:09.970973 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:09.971845 (+ 872us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:09.971850 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:09.972042 (+ 192us) client_negotiation.cc:769] Sending connection context
0811 18:47:09.972202 (+ 160us) client_negotiation.cc:240] Negotiation successful
0811 18:47:09.972600 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":396,"threads_started":1}
I20260811 18:47:09.976050 29155 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:44849
I20260811 18:47:09.976153 29421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:44849 every 8 connection(s)
I20260811 18:47:09.977994 29155 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:47:09.981050 29424 heartbeater.cc:347] Connected to a master server at 127.25.25.62:43997
I20260811 18:47:09.981351 29424 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:09.982206 29424 heartbeater.cc:511] Master 127.25.25.62:43997 requested a full tablet report, sending...
I20260811 18:47:09.983739 28770 ts_manager.cc:194] Registered new tserver with Master: 45671dc4f7184e85923005550b435cd3 (127.25.25.2:44849)
I20260811 18:47:09.984642 28770 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.2@KRBTEST.COM'} at 127.25.25.2:42259
I20260811 18:47:09.984673 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 29155
I20260811 18:47:09.984844 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance
I20260811 18:47:09.985411 25700 external_mini_cluster.cc:1428] Setting key af101c56816e714302ac72813e33bf76
WARNING: no policy specified for kudu/127.25.25.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
I20260811 18:47:10.036394 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:0
--local_ip_for_outbound_sockets=127.25.25.3
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:43997
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:34467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:10.395046 29434 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:10.395368 29434 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:10.395516 29434 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:10.403385 29434 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:10.403527 29434 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:10.403658 29434 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 18:47:10.403728 29434 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:47:10.403836 29434 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:47:10.413977 29148 heartbeater.cc:503] Master 127.25.25.62:43997 was elected leader, sending a full tablet report...
I20260811 18:47:10.414309 29434 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:34467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.25.62:43997
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:10.416116 29434 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:10.417618 29434 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:10.436527 29444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:10.436540 29447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:10.436671 29443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:10.438681 29434 server_base.cc:1034] running on GCE node
I20260811 18:47:10.439411 29434 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:10.440524 29434 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:10.441751 29434 hybrid_clock.cc:648] HybridClock initialized: now 1786474030441695 us; error 44 us; skew 500 ppm
I20260811 18:47:10.442103 29434 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:10 dist-test-slave-lgr5 krb5kdc[28687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474030, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:10.445401 29434 init.cc:377] Logged in from keytab as kudu/127.25.25.3@KRBTEST.COM (short username kudu)
I20260811 18:47:10.446980 29434 webserver.cc:460] Webserver started at http://127.25.25.3:40517/ using document root <none> and password file <none>
I20260811 18:47:10.447765 29434 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:10.447906 29434 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:10.448307 29434 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:10.451516 29434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-2/data/instance:
uuid: "2fa76860383f4d10a5c89db28581b572"
format_stamp: "Formatted at 2026-08-11 18:47:10 on dist-test-slave-lgr5"
server_key: "2e642fa858ac64f01319b5d138673c53"
server_key_iv: "25989ff97cc14bf6ddef5ba9b67c3f07"
server_key_version: "encryptionkey@0"
I20260811 18:47:10.452425 29434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance:
uuid: "2fa76860383f4d10a5c89db28581b572"
format_stamp: "Formatted at 2026-08-11 18:47:10 on dist-test-slave-lgr5"
server_key: "2e642fa858ac64f01319b5d138673c53"
server_key_iv: "25989ff97cc14bf6ddef5ba9b67c3f07"
server_key_version: "encryptionkey@0"
I20260811 18:47:10.458158 29434 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 18:47:10.462235 29455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:10.463801 29434 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 18:47:10.464025 29434 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "2fa76860383f4d10a5c89db28581b572"
format_stamp: "Formatted at 2026-08-11 18:47:10 on dist-test-slave-lgr5"
server_key: "2e642fa858ac64f01319b5d138673c53"
server_key_iv: "25989ff97cc14bf6ddef5ba9b67c3f07"
server_key_version: "encryptionkey@0"
I20260811 18:47:10.464291 29434 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:10.492538 29434 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:10.497462 29434 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:10.497773 29434 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:10.500933 29434 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:10.501063 29434 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:10.501199 29434 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:10.501293 29434 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:47:10 dist-test-slave-lgr5 krb5kdc[28687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474030, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:10.528368 29472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:10.502183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43997 (local address 127.25.25.3:60273)
0811 18:47:10.503060 (+ 877us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:10.503113 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:10.505280 (+ 2167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:10.506163 (+ 883us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:10.506179 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:10.507103 (+ 924us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:10.508212 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:10.508251 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.510028 (+ 1777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.510037 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:10.512159 (+ 2122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:10.512196 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.513298 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.513307 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:10.513682 (+ 375us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:10.514733 (+ 1051us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:10.514777 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:10.518391 (+ 3614us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:10.522453 (+ 4062us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:10.522466 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:10.522492 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:10.523264 (+ 772us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:10.523836 (+ 572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:10.523841 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:10.523845 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:10.524248 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:10.525013 (+ 765us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:10.525025 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:10.525597 (+ 572us) client_negotiation.cc:769] Sending connection context
0811 18:47:10.525938 (+ 341us) client_negotiation.cc:240] Negotiation successful
0811 18:47:10.526578 (+ 640us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"thread_start_us":375,"threads_started":1}
I20260811 18:47:10.529083 29467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:10.501399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:60273 (local address 127.25.25.62:43997)
0811 18:47:10.502192 (+ 793us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:10.502196 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:10.503233 (+ 1037us) server_negotiation.cc:407] Connection header received
0811 18:47:10.505618 (+ 2385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:10.505623 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:10.505716 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:10.505826 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:10.508551 (+ 2725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.509817 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.512378 (+ 2561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.512968 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.513093 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:10.518740 (+ 5647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:10.518746 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:10.518749 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:10.518799 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:10.522272 (+ 3473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:10.523465 (+ 1193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:10.523471 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:10.523473 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:10.523663 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:10.524407 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:10.524412 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:10.524416 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:10.524760 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:10.524920 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:10.528325 (+ 3405us) server_negotiation.cc:299] Negotiation successful
0811 18:47:10.528633 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":680,"thread_start_us":593,"threads_started":1}
I20260811 18:47:10.546228 29434 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:36253
I20260811 18:47:10.546241 29669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:36253 every 8 connection(s)
I20260811 18:47:10.547582 29434 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:47:10.549926 29671 heartbeater.cc:347] Connected to a master server at 127.25.25.62:43997
I20260811 18:47:10.550181 29671 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:10.550701 29467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:10.535258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:54695 (local address 127.25.25.62:43997)
0811 18:47:10.535466 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:10.535473 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:10.536541 (+ 1068us) server_negotiation.cc:407] Connection header received
0811 18:47:10.536712 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:10.536718 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:10.536811 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:10.536939 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:10.538151 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.539076 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.541390 (+ 2314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.541919 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.542060 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:10.544601 (+ 2541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:10.544608 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:10.544612 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:10.544657 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:10.547535 (+ 2878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:10.548349 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:10.548355 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:10.548359 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:10.548557 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:10.549063 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:10.549068 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:10.549070 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:10.549481 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:10.549645 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:10.550098 (+ 453us) server_negotiation.cc:299] Negotiation successful
0811 18:47:10.550334 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 18:47:10.550839 29618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:10.535595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43997 (local address 127.25.25.3:54695)
0811 18:47:10.536409 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:10.536433 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:10.536580 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:10.536956 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:10.536960 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:10.537488 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:10.537970 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:10.537986 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.539259 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.539266 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:10.541161 (+ 1895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:10.541185 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.542322 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.542332 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:10.542542 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:10.543258 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:10.543290 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:10.544373 (+ 1083us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:10.547682 (+ 3309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:10.547689 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:10.547692 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:10.548203 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:10.548711 (+ 508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:10.548716 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:10.548724 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:10.548894 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:10.549591 (+ 697us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:10.549595 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:10.549816 (+ 221us) client_negotiation.cc:769] Sending connection context
0811 18:47:10.549961 (+ 145us) client_negotiation.cc:240] Negotiation successful
0811 18:47:10.550334 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":647,"thread_start_us":490,"threads_started":1}
I20260811 18:47:10.551067 29671 heartbeater.cc:511] Master 127.25.25.62:43997 requested a full tablet report, sending...
I20260811 18:47:10.552786 28770 ts_manager.cc:194] Registered new tserver with Master: 2fa76860383f4d10a5c89db28581b572 (127.25.25.3:36253)
I20260811 18:47:10.553871 28770 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.3@KRBTEST.COM'} at 127.25.25.3:60273
I20260811 18:47:10.555217 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 29434
I20260811 18:47:10.555537 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance
I20260811 18:47:10.556034 25700 external_mini_cluster.cc:1428] Setting key 044e058272864eda39339ffb124d1679
I20260811 18:47:10.559732 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 18:47:10 dist-test-slave-lgr5 krb5kdc[28687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474030, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 18:47:10 dist-test-slave-lgr5 krb5kdc[28687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474030, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:10.612258 29467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:10.597788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58244 (local address 127.25.25.62:43997)
0811 18:47:10.598067 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:10.598074 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:10.598403 (+ 329us) server_negotiation.cc:407] Connection header received
0811 18:47:10.598595 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:10.598599 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:10.598687 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:10.598769 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:10.600283 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.601042 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.602405 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.602858 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.602963 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:10.606953 (+ 3990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:10.606959 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:10.606963 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:10.607006 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:10.609663 (+ 2657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:10.610367 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:10.610372 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:10.610374 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:10.610528 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:10.610880 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:10.610884 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:10.610886 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:10.611199 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:10.611441 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:10.611681 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 18:47:10.611866 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260811 18:47:10.617086 28770 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58244:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:47:10.624863 28770 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:47:10.650358 29695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:10.638867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:44849 (local address 127.0.0.1:34160)
0811 18:47:10.641718 (+ 2851us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:10.641740 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:10.641893 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:10.642778 (+ 885us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:10.642787 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:10.642832 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:10.643274 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:10.643287 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.645196 (+ 1909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.645201 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:10.647300 (+ 2099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:10.647316 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.649209 (+ 1893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.649216 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:10.649428 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:10.649491 (+ 63us) client_negotiation.cc:769] Sending connection context
0811 18:47:10.649617 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 18:47:10.649863 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2715,"mutex_wait_us":1,"thread_start_us":2577,"threads_started":1}
I20260811 18:47:10.651453 29694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:10.638689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:36253 (local address 127.0.0.1:36390)
0811 18:47:10.639531 (+ 842us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:10.639590 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:10.639794 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:10.644130 (+ 4336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:10.644136 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:10.644167 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:10.644512 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:10.644523 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.646852 (+ 2329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.646858 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:10.648872 (+ 2014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:10.648887 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.650798 (+ 1911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.650805 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:10.651014 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:10.651049 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 18:47:10.651105 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 18:47:10.651202 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":334,"threads_started":1}
I20260811 18:47:10.651470 29705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:10.639399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34160 (local address 127.25.25.2:44849)
0811 18:47:10.641272 (+ 1873us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:10.641283 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:10.642037 (+ 754us) server_negotiation.cc:407] Connection header received
0811 18:47:10.642170 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:10.642180 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:10.642517 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:10.642734 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:10.643570 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.645036 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.647533 (+ 2497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.648934 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.650649 (+ 1715us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:10.650892 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:10.650983 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 18:47:10.651171 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1677,"thread_start_us":1525,"threads_started":1}
I20260811 18:47:10.652634 29704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:10.639038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36390 (local address 127.25.25.3:36253)
0811 18:47:10.643477 (+ 4439us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:10.643484 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:10.643519 (+ 35us) server_negotiation.cc:407] Connection header received
0811 18:47:10.643637 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:10.643647 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:10.643897 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:10.644146 (+ 249us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:10.644772 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.646676 (+ 1904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.649078 (+ 2402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.650564 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.651792 (+ 1228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:10.652025 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:10.652126 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 18:47:10.652301 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4273,"thread_start_us":4072,"threads_started":1}
I20260811 18:47:10.655532 29295 tablet_service.cc:1467] Processing CreateTablet for tablet 69958f766f6e4788800e2d123317b22d (DEFAULT_TABLE table=test-table [id=a3936bf7e8d3478a8ba7a4f4ea6798c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:10.656936 29295 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69958f766f6e4788800e2d123317b22d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:10.656412 29531 tablet_service.cc:1467] Processing CreateTablet for tablet 69958f766f6e4788800e2d123317b22d (DEFAULT_TABLE table=test-table [id=a3936bf7e8d3478a8ba7a4f4ea6798c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:10.657897 29531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69958f766f6e4788800e2d123317b22d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:10.658082 29708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:10.641586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51438 (local address 127.25.25.1:46177)
0811 18:47:10.647939 (+ 6353us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:10.647949 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:10.648546 (+ 597us) server_negotiation.cc:407] Connection header received
0811 18:47:10.648735 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:10.648744 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:10.649043 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:10.649267 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:10.650191 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.651831 (+ 1640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.655204 (+ 3373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.656775 (+ 1571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.656938 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:10.657165 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:10.657605 (+ 440us) server_negotiation.cc:299] Negotiation successful
0811 18:47:10.657780 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6157,"thread_start_us":6021,"threads_started":1}
I20260811 18:47:10.658293 29707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:10.640997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:46177 (local address 127.0.0.1:51438)
0811 18:47:10.648410 (+ 7413us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:10.648431 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:10.648575 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:10.649504 (+ 929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:10.649508 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:10.649534 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:10.649962 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:10.649974 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.651985 (+ 2011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.651990 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:10.654948 (+ 2958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:10.654968 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.657191 (+ 2223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.657201 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:10.657382 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:10.657418 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 18:47:10.657526 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 18:47:10.657681 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7286,"mutex_wait_us":24,"thread_start_us":7140,"threads_started":1}
I20260811 18:47:10.668020 29006 tablet_service.cc:1467] Processing CreateTablet for tablet 69958f766f6e4788800e2d123317b22d (DEFAULT_TABLE table=test-table [id=a3936bf7e8d3478a8ba7a4f4ea6798c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:10.669934 29006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69958f766f6e4788800e2d123317b22d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:10.670521 29710 tablet_bootstrap.cc:492] T 69958f766f6e4788800e2d123317b22d P 45671dc4f7184e85923005550b435cd3: Bootstrap starting.
I20260811 18:47:10.672904 29711 tablet_bootstrap.cc:492] T 69958f766f6e4788800e2d123317b22d P 2fa76860383f4d10a5c89db28581b572: Bootstrap starting.
I20260811 18:47:10.674314 29710 tablet_bootstrap.cc:654] T 69958f766f6e4788800e2d123317b22d P 45671dc4f7184e85923005550b435cd3: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:10.675707 29710 log.cc:824] T 69958f766f6e4788800e2d123317b22d P 45671dc4f7184e85923005550b435cd3: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:10.677410 29711 tablet_bootstrap.cc:654] T 69958f766f6e4788800e2d123317b22d P 2fa76860383f4d10a5c89db28581b572: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:10.678537 29711 log.cc:824] T 69958f766f6e4788800e2d123317b22d P 2fa76860383f4d10a5c89db28581b572: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:10.679857 29710 tablet_bootstrap.cc:492] T 69958f766f6e4788800e2d123317b22d P 45671dc4f7184e85923005550b435cd3: No bootstrap required, opened a new log
I20260811 18:47:10.680210 29710 ts_tablet_manager.cc:1397] T 69958f766f6e4788800e2d123317b22d P 45671dc4f7184e85923005550b435cd3: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260811 18:47:10.681308 29711 tablet_bootstrap.cc:492] T 69958f766f6e4788800e2d123317b22d P 2fa76860383f4d10a5c89db28581b572: No bootstrap required, opened a new log
I20260811 18:47:10.681593 29711 ts_tablet_manager.cc:1397] T 69958f766f6e4788800e2d123317b22d P 2fa76860383f4d10a5c89db28581b572: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260811 18:47:10.687583 29717 tablet_bootstrap.cc:492] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd: Bootstrap starting.
I20260811 18:47:10.691272 29710 raft_consensus.cc:348] T 69958f766f6e4788800e2d123317b22d P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } }
I20260811 18:47:10.691730 29710 raft_consensus.cc:374] T 69958f766f6e4788800e2d123317b22d P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:10.691833 29710 raft_consensus.cc:729] T 69958f766f6e4788800e2d123317b22d P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45671dc4f7184e85923005550b435cd3, State: Initialized, Role: FOLLOWER
I20260811 18:47:10.692215 29717 tablet_bootstrap.cc:654] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:10.692549 29710 consensus_queue.cc:260] T 69958f766f6e4788800e2d123317b22d P 45671dc4f7184e85923005550b435cd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } }
I20260811 18:47:10.692425 29711 raft_consensus.cc:348] T 69958f766f6e4788800e2d123317b22d P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } }
I20260811 18:47:10.692893 29711 raft_consensus.cc:374] T 69958f766f6e4788800e2d123317b22d P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:10.693005 29711 raft_consensus.cc:729] T 69958f766f6e4788800e2d123317b22d P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa76860383f4d10a5c89db28581b572, State: Initialized, Role: FOLLOWER
I20260811 18:47:10.693703 29717 log.cc:824] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:10.693661 29711 consensus_queue.cc:260] T 69958f766f6e4788800e2d123317b22d P 2fa76860383f4d10a5c89db28581b572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } }
I20260811 18:47:10.695118 29671 heartbeater.cc:503] Master 127.25.25.62:43997 was elected leader, sending a full tablet report...
I20260811 18:47:10.695894 29711 ts_tablet_manager.cc:1428] T 69958f766f6e4788800e2d123317b22d P 2fa76860383f4d10a5c89db28581b572: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260811 18:47:10.697926 29424 heartbeater.cc:503] Master 127.25.25.62:43997 was elected leader, sending a full tablet report...
I20260811 18:47:10.698706 29710 ts_tablet_manager.cc:1428] T 69958f766f6e4788800e2d123317b22d P 45671dc4f7184e85923005550b435cd3: Time spent starting tablet: real 0.018s user 0.014s sys 0.004s
I20260811 18:47:10.701922 29717 tablet_bootstrap.cc:492] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd: No bootstrap required, opened a new log
I20260811 18:47:10.702273 29717 ts_tablet_manager.cc:1397] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.003s
I20260811 18:47:10.709852 29717 raft_consensus.cc:348] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } }
I20260811 18:47:10.710304 29717 raft_consensus.cc:374] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:10.710388 29717 raft_consensus.cc:729] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ae515004de7466e9bff5b3268814dfd, State: Initialized, Role: FOLLOWER
I20260811 18:47:10.711045 29717 consensus_queue.cc:260] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } }
I20260811 18:47:10.713383 29717 ts_tablet_manager.cc:1428] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd: Time spent starting tablet: real 0.011s user 0.008s sys 0.004s
W20260811 18:47:10.730624 29428 tablet.cc:2369] T 69958f766f6e4788800e2d123317b22d P 45671dc4f7184e85923005550b435cd3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:47:10.757858 29723 raft_consensus.cc:482] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:47:10.758219 29723 raft_consensus.cc:504] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } }
I20260811 18:47:10.760296 29723 leader_election.cc:288] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa76860383f4d10a5c89db28581b572 (127.25.25.3:36253), 45671dc4f7184e85923005550b435cd3 (127.25.25.2:44849)
I20260811 18:47:10.766778 29704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:10.760844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:55959 (local address 127.25.25.3:36253)
0811 18:47:10.761096 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:10.761102 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:10.761449 (+ 347us) server_negotiation.cc:407] Connection header received
0811 18:47:10.761675 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:10.761679 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:10.761745 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:10.761822 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:10.762402 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.763138 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.765063 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.765842 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.765968 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:10.766080 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:10.766380 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 18:47:10.766515 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260811 18:47:10.766863 29724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:10.760617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:36253 (local address 127.25.25.1:55959)
0811 18:47:10.761313 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:10.761330 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:10.761519 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:10.761869 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:10.761874 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:10.761901 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:10.762244 (+ 343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:10.762254 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.763274 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.763278 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:10.764891 (+ 1613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:10.764908 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.766059 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.766066 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:10.766208 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:10.766234 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 18:47:10.766333 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 18:47:10.766477 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":376,"threads_started":1}
I20260811 18:47:10.767036 29705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:10.760786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:46611 (local address 127.25.25.2:44849)
0811 18:47:10.760996 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:10.761003 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:10.761916 (+ 913us) server_negotiation.cc:407] Connection header received
0811 18:47:10.762096 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:10.762102 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:10.762169 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:10.762247 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:10.762786 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.763508 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.765297 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.766095 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.766218 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:10.766330 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:10.766631 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 18:47:10.766769 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 18:47:10.767308 29727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:10.760617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:44849 (local address 127.25.25.1:46611)
0811 18:47:10.761792 (+ 1175us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:10.761807 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:10.761950 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:10.762280 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:10.762284 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:10.762310 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:10.762629 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:10.762639 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.763646 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.763651 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:10.765127 (+ 1476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:10.765140 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.766330 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.766337 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:10.766469 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:10.766502 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 18:47:10.766582 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 18:47:10.766721 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1050,"mutex_wait_us":496,"thread_start_us":319,"threads_started":1}
I20260811 18:47:10.768308 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69958f766f6e4788800e2d123317b22d" candidate_uuid: "3ae515004de7466e9bff5b3268814dfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa76860383f4d10a5c89db28581b572" is_pre_election: true
I20260811 18:47:10.768925 29335 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69958f766f6e4788800e2d123317b22d" candidate_uuid: "3ae515004de7466e9bff5b3268814dfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45671dc4f7184e85923005550b435cd3" is_pre_election: true
I20260811 18:47:10.769194 29563 raft_consensus.cc:2454] T 69958f766f6e4788800e2d123317b22d P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ae515004de7466e9bff5b3268814dfd in term 0.
I20260811 18:47:10.769490 29335 raft_consensus.cc:2454] T 69958f766f6e4788800e2d123317b22d P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ae515004de7466e9bff5b3268814dfd in term 0.
I20260811 18:47:10.770087 28918 leader_election.cc:302] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2fa76860383f4d10a5c89db28581b572, 3ae515004de7466e9bff5b3268814dfd, 45671dc4f7184e85923005550b435cd3; no voters:
I20260811 18:47:10.770579 29723 raft_consensus.cc:2781] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:47:10.770726 29723 raft_consensus.cc:482] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:47:10.770820 29723 raft_consensus.cc:3037] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:10.773392 29723 raft_consensus.cc:504] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } }
I20260811 18:47:10.774061 29723 leader_election.cc:288] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd [CANDIDATE]: Term 1 election: Requested vote from peers 2fa76860383f4d10a5c89db28581b572 (127.25.25.3:36253), 45671dc4f7184e85923005550b435cd3 (127.25.25.2:44849)
I20260811 18:47:10.774652 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69958f766f6e4788800e2d123317b22d" candidate_uuid: "3ae515004de7466e9bff5b3268814dfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa76860383f4d10a5c89db28581b572"
I20260811 18:47:10.774652 29335 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69958f766f6e4788800e2d123317b22d" candidate_uuid: "3ae515004de7466e9bff5b3268814dfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45671dc4f7184e85923005550b435cd3"
I20260811 18:47:10.774884 29563 raft_consensus.cc:3037] T 69958f766f6e4788800e2d123317b22d P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:10.774884 29335 raft_consensus.cc:3037] T 69958f766f6e4788800e2d123317b22d P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:10.778242 29563 raft_consensus.cc:2454] T 69958f766f6e4788800e2d123317b22d P 2fa76860383f4d10a5c89db28581b572 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ae515004de7466e9bff5b3268814dfd in term 1.
I20260811 18:47:10.778242 29335 raft_consensus.cc:2454] T 69958f766f6e4788800e2d123317b22d P 45671dc4f7184e85923005550b435cd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ae515004de7466e9bff5b3268814dfd in term 1.
I20260811 18:47:10.778831 28918 leader_election.cc:302] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2fa76860383f4d10a5c89db28581b572, 3ae515004de7466e9bff5b3268814dfd, 45671dc4f7184e85923005550b435cd3; no voters:
I20260811 18:47:10.779193 29723 raft_consensus.cc:2781] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:10.779673 29723 raft_consensus.cc:686] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd [term 1 LEADER]: Becoming Leader. State: Replica: 3ae515004de7466e9bff5b3268814dfd, State: Running, Role: LEADER
I20260811 18:47:10.780226 29723 consensus_queue.cc:237] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } }
I20260811 18:47:10.785526 28770 catalog_manager.cc:5495] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ae515004de7466e9bff5b3268814dfd (127.25.25.1). New cstate: current_term: 1 leader_uuid: "3ae515004de7466e9bff5b3268814dfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } health_report { overall_health: HEALTHY } } }
W20260811 18:47:10.799655 29674 tablet.cc:2369] T 69958f766f6e4788800e2d123317b22d P 2fa76860383f4d10a5c89db28581b572: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 18:47:10 dist-test-slave-lgr5 krb5kdc[28687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474028, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:10.861498 29741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:10.847117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43997 (local address 127.0.0.1:58254)
0811 18:47:10.847878 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:10.847899 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:10.848049 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:10.848416 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:10.848419 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:10.849165 (+ 746us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:10.849477 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:10.849488 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.850589 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.850594 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:10.851732 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:10.851754 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.852738 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.852744 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:10.852893 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:10.853667 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:10.853702 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:10.856110 (+ 2408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:10.858977 (+ 2867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:10.858990 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:10.858996 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:10.859577 (+ 581us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:10.859944 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:10.859947 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:10.859950 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:10.860128 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:10.860613 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:10.860620 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:10.860788 (+ 168us) client_negotiation.cc:769] Sending connection context
0811 18:47:10.860927 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 18:47:10.861155 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":602,"thread_start_us":445,"threads_started":1}
I20260811 18:47:10.861537 29467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:10.847110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58254 (local address 127.25.25.62:43997)
0811 18:47:10.847363 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:10.847370 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:10.847996 (+ 626us) server_negotiation.cc:407] Connection header received
0811 18:47:10.848190 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:10.848194 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:10.848260 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:10.848349 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:10.849646 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.850427 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.851897 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.852480 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.852582 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:10.856329 (+ 3747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:10.856334 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:10.856338 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:10.856370 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:10.858826 (+ 2456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:10.859687 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:10.859691 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:10.859693 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:10.859847 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:10.860228 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:10.860231 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:10.860234 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:10.860503 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:10.860611 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:10.861086 (+ 475us) server_negotiation.cc:299] Negotiation successful
0811 18:47:10.861261 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260811 18:47:10.866544 28770 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:58254:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 18:47:10.867573 28770 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:47:10.874832 29006 tablet_service.cc:1467] Processing CreateTablet for tablet 49e55740e37c4f8d8a59a678af8758d1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d7923c47fb0b4d0da4214039ba4e68e9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:47:10.875283 29295 tablet_service.cc:1467] Processing CreateTablet for tablet 49e55740e37c4f8d8a59a678af8758d1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d7923c47fb0b4d0da4214039ba4e68e9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:47:10.875283 29531 tablet_service.cc:1467] Processing CreateTablet for tablet 49e55740e37c4f8d8a59a678af8758d1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d7923c47fb0b4d0da4214039ba4e68e9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:47:10.875898 29006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49e55740e37c4f8d8a59a678af8758d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:10.876224 29531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49e55740e37c4f8d8a59a678af8758d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:10.876224 29295 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49e55740e37c4f8d8a59a678af8758d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:10.882516 29717 tablet_bootstrap.cc:492] T 49e55740e37c4f8d8a59a678af8758d1 P 3ae515004de7466e9bff5b3268814dfd: Bootstrap starting.
I20260811 18:47:10.883684 29710 tablet_bootstrap.cc:492] T 49e55740e37c4f8d8a59a678af8758d1 P 45671dc4f7184e85923005550b435cd3: Bootstrap starting.
I20260811 18:47:10.884371 29717 tablet_bootstrap.cc:654] T 49e55740e37c4f8d8a59a678af8758d1 P 3ae515004de7466e9bff5b3268814dfd: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:10.885558 29710 tablet_bootstrap.cc:654] T 49e55740e37c4f8d8a59a678af8758d1 P 45671dc4f7184e85923005550b435cd3: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:10.887008 29717 tablet_bootstrap.cc:492] T 49e55740e37c4f8d8a59a678af8758d1 P 3ae515004de7466e9bff5b3268814dfd: No bootstrap required, opened a new log
I20260811 18:47:10.887238 29711 tablet_bootstrap.cc:492] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572: Bootstrap starting.
I20260811 18:47:10.887359 29717 ts_tablet_manager.cc:1397] T 49e55740e37c4f8d8a59a678af8758d1 P 3ae515004de7466e9bff5b3268814dfd: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 18:47:10.888062 29717 raft_consensus.cc:348] T 49e55740e37c4f8d8a59a678af8758d1 P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:10.888484 29717 raft_consensus.cc:374] T 49e55740e37c4f8d8a59a678af8758d1 P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:10.888641 29717 raft_consensus.cc:729] T 49e55740e37c4f8d8a59a678af8758d1 P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ae515004de7466e9bff5b3268814dfd, State: Initialized, Role: FOLLOWER
I20260811 18:47:10.888984 29710 tablet_bootstrap.cc:492] T 49e55740e37c4f8d8a59a678af8758d1 P 45671dc4f7184e85923005550b435cd3: No bootstrap required, opened a new log
I20260811 18:47:10.889127 29711 tablet_bootstrap.cc:654] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:10.889149 29710 ts_tablet_manager.cc:1397] T 49e55740e37c4f8d8a59a678af8758d1 P 45671dc4f7184e85923005550b435cd3: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 18:47:10.888984 29717 consensus_queue.cc:260] T 49e55740e37c4f8d8a59a678af8758d1 P 3ae515004de7466e9bff5b3268814dfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:10.889698 29723 tablet_replica.cc:439] T 49e55740e37c4f8d8a59a678af8758d1 P 3ae515004de7466e9bff5b3268814dfd: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } } }
I20260811 18:47:10.890004 29723 tablet_replica.cc:442] T 49e55740e37c4f8d8a59a678af8758d1 P 3ae515004de7466e9bff5b3268814dfd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:47:10.890005 29710 raft_consensus.cc:348] T 49e55740e37c4f8d8a59a678af8758d1 P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:10.890237 29710 raft_consensus.cc:374] T 49e55740e37c4f8d8a59a678af8758d1 P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:10.890339 29710 raft_consensus.cc:729] T 49e55740e37c4f8d8a59a678af8758d1 P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45671dc4f7184e85923005550b435cd3, State: Initialized, Role: FOLLOWER
I20260811 18:47:10.890617 29710 consensus_queue.cc:260] T 49e55740e37c4f8d8a59a678af8758d1 P 45671dc4f7184e85923005550b435cd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:10.890787 29717 ts_tablet_manager.cc:1428] T 49e55740e37c4f8d8a59a678af8758d1 P 3ae515004de7466e9bff5b3268814dfd: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260811 18:47:10.891108 29718 tablet_replica.cc:439] T 49e55740e37c4f8d8a59a678af8758d1 P 45671dc4f7184e85923005550b435cd3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } } }
I20260811 18:47:10.891469 29718 tablet_replica.cc:442] T 49e55740e37c4f8d8a59a678af8758d1 P 45671dc4f7184e85923005550b435cd3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:47:10.892407 29710 ts_tablet_manager.cc:1428] T 49e55740e37c4f8d8a59a678af8758d1 P 45671dc4f7184e85923005550b435cd3: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 18:47:10.892668 29711 tablet_bootstrap.cc:492] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572: No bootstrap required, opened a new log
I20260811 18:47:10.892830 29711 ts_tablet_manager.cc:1397] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20260811 18:47:10.893679 29711 raft_consensus.cc:348] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:10.893924 29711 raft_consensus.cc:374] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:10.894121 29711 raft_consensus.cc:729] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa76860383f4d10a5c89db28581b572, State: Initialized, Role: FOLLOWER
I20260811 18:47:10.894366 29711 consensus_queue.cc:260] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:10.894827 29721 tablet_replica.cc:439] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } } }
I20260811 18:47:10.895133 29721 tablet_replica.cc:442] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:47:10.896027 29711 ts_tablet_manager.cc:1428] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
W20260811 18:47:10.904417 29150 tablet.cc:2369] T 49e55740e37c4f8d8a59a678af8758d1 P 3ae515004de7466e9bff5b3268814dfd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:47:10.911322 29721 raft_consensus.cc:482] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:47:10.911608 29721 raft_consensus.cc:504] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:10.913218 29721 leader_election.cc:288] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ae515004de7466e9bff5b3268814dfd (127.25.25.1:46177), 45671dc4f7184e85923005550b435cd3 (127.25.25.2:44849)
I20260811 18:47:10.919525 29708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:10.913686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:54575 (local address 127.25.25.1:46177)
0811 18:47:10.913891 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:10.913898 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:10.913946 (+ 48us) server_negotiation.cc:407] Connection header received
0811 18:47:10.914177 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:10.914183 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:10.914278 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:10.914380 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:10.914846 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.916016 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.917850 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.918611 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.918735 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:10.918840 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:10.919137 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 18:47:10.919275 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 18:47:10.919580 29472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:10.913532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:46177 (local address 127.25.25.3:54575)
0811 18:47:10.913851 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:10.913873 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:10.914001 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:10.914441 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:10.914445 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:10.914475 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:10.914700 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:10.914712 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.916174 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.916180 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:10.917673 (+ 1493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:10.917691 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.918775 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.918781 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:10.918974 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:10.919000 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 18:47:10.919084 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 18:47:10.919225 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":1}
I20260811 18:47:10.920423 29745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:10.913624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:44849 (local address 127.25.25.3:41753)
0811 18:47:10.914445 (+ 821us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:10.914463 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:10.914588 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:10.914942 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:10.914946 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:10.914974 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:10.915356 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:10.915370 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.916853 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.916857 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:10.918318 (+ 1461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:10.918334 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.919593 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.919599 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:10.919797 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:10.919840 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 18:47:10.919939 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 18:47:10.920111 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"mutex_wait_us":36,"thread_start_us":482,"threads_started":1}
I20260811 18:47:10.920423 29705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:10.913788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:41753 (local address 127.25.25.2:44849)
0811 18:47:10.913977 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:10.913983 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:10.914597 (+ 614us) server_negotiation.cc:407] Connection header received
0811 18:47:10.914728 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:10.914733 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:10.914835 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:10.914907 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:10.915581 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.916664 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.918499 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.919296 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.919427 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:10.919528 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:10.919975 (+ 447us) server_negotiation.cc:299] Negotiation successful
0811 18:47:10.920122 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 18:47:10.920653 29039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49e55740e37c4f8d8a59a678af8758d1" candidate_uuid: "2fa76860383f4d10a5c89db28581b572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ae515004de7466e9bff5b3268814dfd" is_pre_election: true
I20260811 18:47:10.921169 29039 raft_consensus.cc:2454] T 49e55740e37c4f8d8a59a678af8758d1 P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa76860383f4d10a5c89db28581b572 in term 0.
I20260811 18:47:10.921236 29335 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49e55740e37c4f8d8a59a678af8758d1" candidate_uuid: "2fa76860383f4d10a5c89db28581b572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45671dc4f7184e85923005550b435cd3" is_pre_election: true
I20260811 18:47:10.921502 29335 raft_consensus.cc:2454] T 49e55740e37c4f8d8a59a678af8758d1 P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa76860383f4d10a5c89db28581b572 in term 0.
I20260811 18:47:10.921842 29459 leader_election.cc:302] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa76860383f4d10a5c89db28581b572, 3ae515004de7466e9bff5b3268814dfd; no voters:
I20260811 18:47:10.922268 29721 raft_consensus.cc:2781] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:47:10.922389 29721 raft_consensus.cc:482] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:47:10.922477 29721 raft_consensus.cc:3037] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:10.924836 29721 raft_consensus.cc:504] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:10.925472 29721 leader_election.cc:288] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572 [CANDIDATE]: Term 1 election: Requested vote from peers 3ae515004de7466e9bff5b3268814dfd (127.25.25.1:46177), 45671dc4f7184e85923005550b435cd3 (127.25.25.2:44849)
I20260811 18:47:10.926024 29335 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49e55740e37c4f8d8a59a678af8758d1" candidate_uuid: "2fa76860383f4d10a5c89db28581b572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45671dc4f7184e85923005550b435cd3"
I20260811 18:47:10.926041 29039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49e55740e37c4f8d8a59a678af8758d1" candidate_uuid: "2fa76860383f4d10a5c89db28581b572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ae515004de7466e9bff5b3268814dfd"
I20260811 18:47:10.926239 29039 raft_consensus.cc:3037] T 49e55740e37c4f8d8a59a678af8758d1 P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:10.926254 29335 raft_consensus.cc:3037] T 49e55740e37c4f8d8a59a678af8758d1 P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:10.928665 29335 raft_consensus.cc:2454] T 49e55740e37c4f8d8a59a678af8758d1 P 45671dc4f7184e85923005550b435cd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa76860383f4d10a5c89db28581b572 in term 1.
I20260811 18:47:10.928673 29039 raft_consensus.cc:2454] T 49e55740e37c4f8d8a59a678af8758d1 P 3ae515004de7466e9bff5b3268814dfd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa76860383f4d10a5c89db28581b572 in term 1.
I20260811 18:47:10.929112 29459 leader_election.cc:302] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2fa76860383f4d10a5c89db28581b572, 3ae515004de7466e9bff5b3268814dfd, 45671dc4f7184e85923005550b435cd3; no voters:
I20260811 18:47:10.929456 29721 raft_consensus.cc:2781] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:10.929905 29721 raft_consensus.cc:686] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572 [term 1 LEADER]: Becoming Leader. State: Replica: 2fa76860383f4d10a5c89db28581b572, State: Running, Role: LEADER
I20260811 18:47:10.930413 29721 consensus_queue.cc:237] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:10.933990 29748 tablet_replica.cc:439] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572: TxnStatusTablet state changed. Reason: New leader 2fa76860383f4d10a5c89db28581b572. Latest consensus state: current_term: 1 leader_uuid: "2fa76860383f4d10a5c89db28581b572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } } }
I20260811 18:47:10.934391 29748 tablet_replica.cc:442] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:47:10.935043 29750 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 18:47:10.935279 29750 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 18:47:10.935454 28767 catalog_manager.cc:5495] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fa76860383f4d10a5c89db28581b572 (127.25.25.3). New cstate: current_term: 1 leader_uuid: "2fa76860383f4d10a5c89db28581b572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } health_report { overall_health: HEALTHY } } }
I20260811 18:47:10.956485 29704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:10.949569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36392 (local address 127.25.25.3:36253)
0811 18:47:10.949737 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:10.949742 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:10.949761 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:47:10.950116 (+ 355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:10.950121 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:10.950220 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:10.950344 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:47:10.950766 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.951626 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.953790 (+ 2164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.954332 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.954447 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:10.955086 (+ 639us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:47:10.955721 (+ 635us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:47:10.955831 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:10.955989 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 18:47:10.956067 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 18:47:10.956504 29741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:10.949382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:36253 (local address 127.0.0.1:36392)
0811 18:47:10.949667 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:10.949690 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:10.949860 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:10.950394 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:10.950400 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:10.950415 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:47:10.950627 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:10.950640 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.951771 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.951778 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:10.953481 (+ 1703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:10.953501 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:10.954527 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:10.954534 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:10.954743 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:10.954868 (+ 125us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:47:10.955844 (+ 976us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:47:10.955868 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 18:47:10.955958 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 18:47:10.956179 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83}
I20260811 18:47:10.965142 29335 raft_consensus.cc:1261] T 49e55740e37c4f8d8a59a678af8758d1 P 45671dc4f7184e85923005550b435cd3 [term 1 FOLLOWER]: Refusing update from remote peer 2fa76860383f4d10a5c89db28581b572: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:47:10.965224 29039 raft_consensus.cc:1261] T 49e55740e37c4f8d8a59a678af8758d1 P 3ae515004de7466e9bff5b3268814dfd [term 1 FOLLOWER]: Refusing update from remote peer 2fa76860383f4d10a5c89db28581b572: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:47:10.966239 29748 consensus_queue.cc:1035] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:47:10.966605 29721 consensus_queue.cc:1035] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:47:10.993233 29718 tablet_replica.cc:439] T 49e55740e37c4f8d8a59a678af8758d1 P 45671dc4f7184e85923005550b435cd3: TxnStatusTablet state changed. Reason: New leader 2fa76860383f4d10a5c89db28581b572. Latest consensus state: current_term: 1 leader_uuid: "2fa76860383f4d10a5c89db28581b572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } } }
I20260811 18:47:10.993571 29718 tablet_replica.cc:442] T 49e55740e37c4f8d8a59a678af8758d1 P 45671dc4f7184e85923005550b435cd3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:47:11.006268 29723 tablet_replica.cc:439] T 49e55740e37c4f8d8a59a678af8758d1 P 3ae515004de7466e9bff5b3268814dfd: TxnStatusTablet state changed. Reason: New leader 2fa76860383f4d10a5c89db28581b572. Latest consensus state: current_term: 1 leader_uuid: "2fa76860383f4d10a5c89db28581b572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } } }
I20260811 18:47:11.006665 29723 tablet_replica.cc:442] T 49e55740e37c4f8d8a59a678af8758d1 P 3ae515004de7466e9bff5b3268814dfd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:47:11.009272 29748 tablet_replica.cc:439] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2fa76860383f4d10a5c89db28581b572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } } }
I20260811 18:47:11.009588 29748 tablet_replica.cc:442] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:47:11.010337 29721 tablet_replica.cc:439] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2fa76860383f4d10a5c89db28581b572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } } }
I20260811 18:47:11.010696 29721 tablet_replica.cc:442] T 49e55740e37c4f8d8a59a678af8758d1 P 2fa76860383f4d10a5c89db28581b572: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:47:11.011252 29718 tablet_replica.cc:439] T 49e55740e37c4f8d8a59a678af8758d1 P 45671dc4f7184e85923005550b435cd3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2fa76860383f4d10a5c89db28581b572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } } }
I20260811 18:47:11.011502 29718 tablet_replica.cc:442] T 49e55740e37c4f8d8a59a678af8758d1 P 45671dc4f7184e85923005550b435cd3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:47:11.017427 29723 tablet_replica.cc:439] T 49e55740e37c4f8d8a59a678af8758d1 P 3ae515004de7466e9bff5b3268814dfd: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2fa76860383f4d10a5c89db28581b572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } } }
I20260811 18:47:11.017781 29723 tablet_replica.cc:442] T 49e55740e37c4f8d8a59a678af8758d1 P 3ae515004de7466e9bff5b3268814dfd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:47:11.026567 29708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:11.020269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51452 (local address 127.25.25.1:46177)
0811 18:47:11.020448 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:11.020455 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:11.020476 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:47:11.020576 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:11.020581 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:11.020706 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:11.020872 (+ 166us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:47:11.021222 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.022530 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.023902 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.024577 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.024714 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:11.025145 (+ 431us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:47:11.025924 (+ 779us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:47:11.026070 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:11.026151 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 18:47:11.026245 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 18:47:11.045058 29704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:11.039254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:49267 (local address 127.25.25.3:36253)
0811 18:47:11.039501 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:11.039509 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:11.039910 (+ 401us) server_negotiation.cc:407] Connection header received
0811 18:47:11.040145 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:11.040151 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:11.040268 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:11.040357 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:47:11.040871 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.041617 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.043037 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.043529 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.043657 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:11.044228 (+ 571us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:47:11.044354 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:47:11.044447 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:11.044615 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 18:47:11.044713 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 18:47:11.045244 29776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:11.039157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:36253 (local address 127.25.25.1:49267)
0811 18:47:11.039793 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:11.039809 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:11.039980 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:11.040384 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:11.040388 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:11.040401 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:47:11.040724 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:11.040734 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.041755 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.041759 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:11.042876 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:11.042889 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.043737 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.043742 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:11.043873 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:11.043961 (+ 88us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:47:11.044455 (+ 494us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:47:11.044469 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 18:47:11.044577 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 18:47:11.044746 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":311,"threads_started":1}
I20260811 18:47:11.057504 29335 raft_consensus.cc:1261] T 69958f766f6e4788800e2d123317b22d P 45671dc4f7184e85923005550b435cd3 [term 1 FOLLOWER]: Refusing update from remote peer 3ae515004de7466e9bff5b3268814dfd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:47:11.057809 29563 raft_consensus.cc:1261] T 69958f766f6e4788800e2d123317b22d P 2fa76860383f4d10a5c89db28581b572 [term 1 FOLLOWER]: Refusing update from remote peer 3ae515004de7466e9bff5b3268814dfd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:47:11.058215 29728 consensus_queue.cc:1035] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:47:11.058636 29723 consensus_queue.cc:1035] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:47:11.105723 29708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:11.099171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:59697 (local address 127.25.25.1:46177)
0811 18:47:11.099369 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:11.099377 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:11.099982 (+ 605us) server_negotiation.cc:407] Connection header received
0811 18:47:11.100216 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:11.100220 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:11.100307 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:11.100381 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:47:11.101020 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.101857 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.103766 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.104272 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.104391 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:11.104879 (+ 488us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:47:11.105049 (+ 170us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:47:11.105138 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:11.105318 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 18:47:11.105408 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 18:47:11.106065 29789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:11.099101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:46177 (local address 127.25.25.3:59697)
0811 18:47:11.099874 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:11.099894 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:11.100050 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:11.100418 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:11.100423 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:11.100436 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:47:11.100823 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:11.100836 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.102009 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.102015 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:11.103618 (+ 1603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:11.103633 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.104481 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.104489 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:11.104628 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:11.104698 (+ 70us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:47:11.105191 (+ 493us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:47:11.105201 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 18:47:11.105276 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 18:47:11.105431 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":357,"threads_started":1}
I20260811 18:47:11.150568 28769 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58244:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:47:11.150925 28769 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58244:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:47:11.155483 28769 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 838f080aecdb4ff392f5b285b334c79f: Sending DeleteTablet for 3 replicas of tablet 69958f766f6e4788800e2d123317b22d
I20260811 18:47:11.156896 29006 tablet_service.cc:1514] Processing DeleteTablet for tablet 69958f766f6e4788800e2d123317b22d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:11 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:51438
I20260811 18:47:11.157433 29295 tablet_service.cc:1514] Processing DeleteTablet for tablet 69958f766f6e4788800e2d123317b22d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:11 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:34160
I20260811 18:47:11.159686 28769 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58244:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:47:11.160784 28769 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:47:11.161664 29531 tablet_service.cc:1514] Processing DeleteTablet for tablet 69958f766f6e4788800e2d123317b22d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:11 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:36390
I20260811 18:47:11.168614 29796 tablet_replica.cc:330] T 69958f766f6e4788800e2d123317b22d P 2fa76860383f4d10a5c89db28581b572: stopping tablet replica
I20260811 18:47:11.169163 29796 raft_consensus.cc:2229] T 69958f766f6e4788800e2d123317b22d P 2fa76860383f4d10a5c89db28581b572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:47:11.169548 29796 raft_consensus.cc:2258] T 69958f766f6e4788800e2d123317b22d P 2fa76860383f4d10a5c89db28581b572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:11.170898 29005 tablet_service.cc:1467] Processing CreateTablet for tablet 13a0362ad23c4659a08ce9c1daf8c816 (DEFAULT_TABLE table=test-table [id=dd1f9b7877ec41da9f3c8e982f74efb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:11.171625 29005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13a0362ad23c4659a08ce9c1daf8c816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:11.172487 29531 tablet_service.cc:1467] Processing CreateTablet for tablet 13a0362ad23c4659a08ce9c1daf8c816 (DEFAULT_TABLE table=test-table [id=dd1f9b7877ec41da9f3c8e982f74efb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:11.173003 29531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13a0362ad23c4659a08ce9c1daf8c816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:11.176769 29293 tablet_service.cc:1467] Processing CreateTablet for tablet 13a0362ad23c4659a08ce9c1daf8c816 (DEFAULT_TABLE table=test-table [id=dd1f9b7877ec41da9f3c8e982f74efb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:11.177368 29293 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13a0362ad23c4659a08ce9c1daf8c816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:11.186474 29795 tablet_replica.cc:330] T 69958f766f6e4788800e2d123317b22d P 45671dc4f7184e85923005550b435cd3: stopping tablet replica
I20260811 18:47:11.187384 29711 tablet_bootstrap.cc:492] T 13a0362ad23c4659a08ce9c1daf8c816 P 2fa76860383f4d10a5c89db28581b572: Bootstrap starting.
I20260811 18:47:11.188494 29796 ts_tablet_manager.cc:1905] T 69958f766f6e4788800e2d123317b22d P 2fa76860383f4d10a5c89db28581b572: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:11.189278 29711 tablet_bootstrap.cc:654] T 13a0362ad23c4659a08ce9c1daf8c816 P 2fa76860383f4d10a5c89db28581b572: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:11.192458 29710 tablet_bootstrap.cc:492] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3: Bootstrap starting.
I20260811 18:47:11.194551 29710 tablet_bootstrap.cc:654] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:11.198503 29717 tablet_bootstrap.cc:492] T 13a0362ad23c4659a08ce9c1daf8c816 P 3ae515004de7466e9bff5b3268814dfd: Bootstrap starting.
I20260811 18:47:11.200673 29717 tablet_bootstrap.cc:654] T 13a0362ad23c4659a08ce9c1daf8c816 P 3ae515004de7466e9bff5b3268814dfd: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:11.203119 29711 tablet_bootstrap.cc:492] T 13a0362ad23c4659a08ce9c1daf8c816 P 2fa76860383f4d10a5c89db28581b572: No bootstrap required, opened a new log
I20260811 18:47:11.203121 29710 tablet_bootstrap.cc:492] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3: No bootstrap required, opened a new log
I20260811 18:47:11.203331 29710 ts_tablet_manager.cc:1397] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.006s
I20260811 18:47:11.203478 29711 ts_tablet_manager.cc:1397] T 13a0362ad23c4659a08ce9c1daf8c816 P 2fa76860383f4d10a5c89db28581b572: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.000s
I20260811 18:47:11.203779 29717 tablet_bootstrap.cc:492] T 13a0362ad23c4659a08ce9c1daf8c816 P 3ae515004de7466e9bff5b3268814dfd: No bootstrap required, opened a new log
I20260811 18:47:11.203967 29717 ts_tablet_manager.cc:1397] T 13a0362ad23c4659a08ce9c1daf8c816 P 3ae515004de7466e9bff5b3268814dfd: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.001s
I20260811 18:47:11.204248 29710 raft_consensus.cc:348] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:11.204512 29710 raft_consensus.cc:374] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:11.204605 29710 raft_consensus.cc:729] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45671dc4f7184e85923005550b435cd3, State: Initialized, Role: FOLLOWER
I20260811 18:47:11.204730 29711 raft_consensus.cc:348] T 13a0362ad23c4659a08ce9c1daf8c816 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:11.204757 29717 raft_consensus.cc:348] T 13a0362ad23c4659a08ce9c1daf8c816 P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:11.205004 29717 raft_consensus.cc:374] T 13a0362ad23c4659a08ce9c1daf8c816 P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:11.205085 29717 raft_consensus.cc:729] T 13a0362ad23c4659a08ce9c1daf8c816 P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ae515004de7466e9bff5b3268814dfd, State: Initialized, Role: FOLLOWER
I20260811 18:47:11.204973 29710 consensus_queue.cc:260] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:11.205123 29711 raft_consensus.cc:374] T 13a0362ad23c4659a08ce9c1daf8c816 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:11.205416 29711 raft_consensus.cc:729] T 13a0362ad23c4659a08ce9c1daf8c816 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa76860383f4d10a5c89db28581b572, State: Initialized, Role: FOLLOWER
I20260811 18:47:11.205322 29717 consensus_queue.cc:260] T 13a0362ad23c4659a08ce9c1daf8c816 P 3ae515004de7466e9bff5b3268814dfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:11.205780 29711 consensus_queue.cc:260] T 13a0362ad23c4659a08ce9c1daf8c816 P 2fa76860383f4d10a5c89db28581b572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:11.206277 29710 ts_tablet_manager.cc:1428] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:47:11.208364 29795 raft_consensus.cc:2229] T 69958f766f6e4788800e2d123317b22d P 45671dc4f7184e85923005550b435cd3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:47:11.208773 29795 raft_consensus.cc:2258] T 69958f766f6e4788800e2d123317b22d P 45671dc4f7184e85923005550b435cd3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:11.209107 29717 ts_tablet_manager.cc:1428] T 13a0362ad23c4659a08ce9c1daf8c816 P 3ae515004de7466e9bff5b3268814dfd: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260811 18:47:11.212154 29795 ts_tablet_manager.cc:1905] T 69958f766f6e4788800e2d123317b22d P 45671dc4f7184e85923005550b435cd3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:11.212705 29794 tablet_replica.cc:330] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd: stopping tablet replica
I20260811 18:47:11.213172 29794 raft_consensus.cc:2229] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:47:11.213869 29794 raft_consensus.cc:2258] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:11.215631 29711 ts_tablet_manager.cc:1428] T 13a0362ad23c4659a08ce9c1daf8c816 P 2fa76860383f4d10a5c89db28581b572: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260811 18:47:11.220449 29795 ts_tablet_manager.cc:1918] T 69958f766f6e4788800e2d123317b22d P 45671dc4f7184e85923005550b435cd3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:47:11.220662 29795 log.cc:1196] T 69958f766f6e4788800e2d123317b22d P 45671dc4f7184e85923005550b435cd3: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-1/wal/wals/69958f766f6e4788800e2d123317b22d
I20260811 18:47:11.221202 29795 ts_tablet_manager.cc:1939] T 69958f766f6e4788800e2d123317b22d P 45671dc4f7184e85923005550b435cd3: Deleting consensus metadata
I20260811 18:47:11.222954 29794 ts_tablet_manager.cc:1905] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:11.223217 29796 ts_tablet_manager.cc:1918] T 69958f766f6e4788800e2d123317b22d P 2fa76860383f4d10a5c89db28581b572: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:47:11.223496 29796 log.cc:1196] T 69958f766f6e4788800e2d123317b22d P 2fa76860383f4d10a5c89db28581b572: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-2/wal/wals/69958f766f6e4788800e2d123317b22d
I20260811 18:47:11.223456 28746 catalog_manager.cc:4841] TS 45671dc4f7184e85923005550b435cd3 (127.25.25.2:44849): tablet 69958f766f6e4788800e2d123317b22d (table test-table [id=a3936bf7e8d3478a8ba7a4f4ea6798c4]) successfully deleted
I20260811 18:47:11.224210 29796 ts_tablet_manager.cc:1939] T 69958f766f6e4788800e2d123317b22d P 2fa76860383f4d10a5c89db28581b572: Deleting consensus metadata
I20260811 18:47:11.226163 28745 catalog_manager.cc:4841] TS 2fa76860383f4d10a5c89db28581b572 (127.25.25.3:36253): tablet 69958f766f6e4788800e2d123317b22d (table test-table [id=a3936bf7e8d3478a8ba7a4f4ea6798c4]) successfully deleted
I20260811 18:47:11.228659 29718 raft_consensus.cc:482] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:47:11.228902 29718 raft_consensus.cc:504] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:11.230782 29718 leader_election.cc:288] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ae515004de7466e9bff5b3268814dfd (127.25.25.1:46177), 2fa76860383f4d10a5c89db28581b572 (127.25.25.3:36253)
I20260811 18:47:11.242509 29708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:11.231401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:41221 (local address 127.25.25.1:46177)
0811 18:47:11.231615 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:11.231622 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:11.232322 (+ 700us) server_negotiation.cc:407] Connection header received
0811 18:47:11.232619 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:11.232624 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:11.232699 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:11.232760 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:11.233542 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.234708 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.237674 (+ 2966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.239257 (+ 1583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.239405 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:11.239529 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:11.241988 (+ 2459us) server_negotiation.cc:299] Negotiation successful
0811 18:47:11.242169 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 18:47:11.242903 29794 ts_tablet_manager.cc:1918] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:47:11.243114 29794 log.cc:1196] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-0/wal/wals/69958f766f6e4788800e2d123317b22d
I20260811 18:47:11.243728 29794 ts_tablet_manager.cc:1939] T 69958f766f6e4788800e2d123317b22d P 3ae515004de7466e9bff5b3268814dfd: Deleting consensus metadata
I20260811 18:47:11.243743 29802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:11.231290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:46177 (local address 127.25.25.2:41221)
0811 18:47:11.232214 (+ 924us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:11.232234 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:11.232447 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:11.232965 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:11.232969 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:11.232997 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:11.233354 (+ 357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:11.233369 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.234922 (+ 1553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.234928 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:11.237402 (+ 2474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:11.237427 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.241484 (+ 4057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.241492 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:11.241715 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:11.241756 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 18:47:11.243089 (+ 1333us) client_negotiation.cc:240] Negotiation successful
0811 18:47:11.243361 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":673,"thread_start_us":500,"threads_started":1}
I20260811 18:47:11.248507 29039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13a0362ad23c4659a08ce9c1daf8c816" candidate_uuid: "45671dc4f7184e85923005550b435cd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ae515004de7466e9bff5b3268814dfd" is_pre_election: true
I20260811 18:47:11.248822 29039 raft_consensus.cc:2454] T 13a0362ad23c4659a08ce9c1daf8c816 P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45671dc4f7184e85923005550b435cd3 in term 0.
I20260811 18:47:11.249447 29188 leader_election.cc:302] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ae515004de7466e9bff5b3268814dfd, 45671dc4f7184e85923005550b435cd3; no voters:
I20260811 18:47:11.249867 29718 raft_consensus.cc:2781] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:47:11.249979 29718 raft_consensus.cc:482] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:47:11.250067 29718 raft_consensus.cc:3037] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:11.251987 29704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:11.233260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:45801 (local address 127.25.25.3:36253)
0811 18:47:11.233449 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:11.233454 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:11.244418 (+ 10964us) server_negotiation.cc:407] Connection header received
0811 18:47:11.244708 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:11.244714 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:11.244798 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:11.244877 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:11.245517 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.246707 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.249336 (+ 2629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.250652 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.250753 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:11.250874 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:11.251557 (+ 683us) server_negotiation.cc:299] Negotiation successful
0811 18:47:11.251694 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 18:47:11.253343 29718 raft_consensus.cc:504] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:11.254104 29718 leader_election.cc:288] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3 [CANDIDATE]: Term 1 election: Requested vote from peers 3ae515004de7466e9bff5b3268814dfd (127.25.25.1:46177), 2fa76860383f4d10a5c89db28581b572 (127.25.25.3:36253)
I20260811 18:47:11.254853 29039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13a0362ad23c4659a08ce9c1daf8c816" candidate_uuid: "45671dc4f7184e85923005550b435cd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ae515004de7466e9bff5b3268814dfd"
I20260811 18:47:11.255002 29802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:11.232273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:36253 (local address 127.25.25.2:45801)
0811 18:47:11.244310 (+ 12037us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:11.244332 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:11.244539 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:11.245109 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:11.245114 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:11.245142 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:11.245326 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:11.245356 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.246935 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.246940 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:11.249133 (+ 2193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:11.249152 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.251163 (+ 2011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.251169 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:11.251369 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:11.251402 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 18:47:11.252902 (+ 1500us) client_negotiation.cc:240] Negotiation successful
0811 18:47:11.254715 (+ 1813us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11922,"thread_start_us":15303,"threads_started":1}
I20260811 18:47:11.255131 29039 raft_consensus.cc:3037] T 13a0362ad23c4659a08ce9c1daf8c816 P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:11.256927 29562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13a0362ad23c4659a08ce9c1daf8c816" candidate_uuid: "45671dc4f7184e85923005550b435cd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa76860383f4d10a5c89db28581b572" is_pre_election: true
I20260811 18:47:11.257117 29563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13a0362ad23c4659a08ce9c1daf8c816" candidate_uuid: "45671dc4f7184e85923005550b435cd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa76860383f4d10a5c89db28581b572"
I20260811 18:47:11.257324 29562 raft_consensus.cc:2454] T 13a0362ad23c4659a08ce9c1daf8c816 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45671dc4f7184e85923005550b435cd3 in term 0.
I20260811 18:47:11.258373 29039 raft_consensus.cc:2454] T 13a0362ad23c4659a08ce9c1daf8c816 P 3ae515004de7466e9bff5b3268814dfd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45671dc4f7184e85923005550b435cd3 in term 1.
I20260811 18:47:11.258899 29188 leader_election.cc:302] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ae515004de7466e9bff5b3268814dfd, 45671dc4f7184e85923005550b435cd3; no voters: 2fa76860383f4d10a5c89db28581b572
I20260811 18:47:11.259375 29718 raft_consensus.cc:2781] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:11.260368 28745 catalog_manager.cc:4841] TS 3ae515004de7466e9bff5b3268814dfd (127.25.25.1:46177): tablet 69958f766f6e4788800e2d123317b22d (table test-table [id=a3936bf7e8d3478a8ba7a4f4ea6798c4]) successfully deleted
I20260811 18:47:11.263269 29718 raft_consensus.cc:686] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3 [term 1 LEADER]: Becoming Leader. State: Replica: 45671dc4f7184e85923005550b435cd3, State: Running, Role: LEADER
I20260811 18:47:11.263801 29718 consensus_queue.cc:237] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:11.268158 28769 catalog_manager.cc:5495] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45671dc4f7184e85923005550b435cd3 (127.25.25.2). New cstate: current_term: 1 leader_uuid: "45671dc4f7184e85923005550b435cd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } health_report { overall_health: UNKNOWN } } }
I20260811 18:47:11.317986 29705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:11.310443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34162 (local address 127.25.25.2:44849)
0811 18:47:11.310652 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:11.310658 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:11.310679 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:47:11.310792 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:11.310797 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:11.310902 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:11.311083 (+ 181us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:47:11.311546 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.312755 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.314912 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.315670 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.315816 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:11.316504 (+ 688us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:47:11.317289 (+ 785us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:47:11.317447 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:11.317585 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 18:47:11.317687 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 18:47:11.339416 29704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:11.331535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:45129 (local address 127.25.25.3:36253)
0811 18:47:11.331756 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:11.331763 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:11.332465 (+ 702us) server_negotiation.cc:407] Connection header received
0811 18:47:11.332805 (+ 340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:11.332811 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:11.332912 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:11.333048 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:47:11.333648 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.334853 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.337034 (+ 2181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.337785 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.337938 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:11.338547 (+ 609us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:47:11.338719 (+ 172us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:47:11.338820 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:11.338999 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 18:47:11.339095 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 18:47:11.339872 29816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:11.331526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:36253 (local address 127.25.25.2:45129)
0811 18:47:11.332293 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:11.332314 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:11.332612 (+ 298us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:11.333061 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:11.333067 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:11.333081 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:47:11.333466 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:11.333482 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.335018 (+ 1536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.335037 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:11.336826 (+ 1789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:11.336848 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.338012 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.338020 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:11.338221 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:11.338315 (+ 94us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:47:11.338856 (+ 541us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:47:11.338869 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 18:47:11.338962 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 18:47:11.339123 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":398,"threads_started":1}
I20260811 18:47:11.353731 29562 raft_consensus.cc:3037] T 13a0362ad23c4659a08ce9c1daf8c816 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:11.354368 29038 raft_consensus.cc:1261] T 13a0362ad23c4659a08ce9c1daf8c816 P 3ae515004de7466e9bff5b3268814dfd [term 1 FOLLOWER]: Refusing update from remote peer 45671dc4f7184e85923005550b435cd3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:47:11.357756 29562 raft_consensus.cc:1261] T 13a0362ad23c4659a08ce9c1daf8c816 P 2fa76860383f4d10a5c89db28581b572 [term 1 FOLLOWER]: Refusing update from remote peer 45671dc4f7184e85923005550b435cd3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:47:11.358407 29718 consensus_queue.cc:1035] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:47:11.358883 29807 consensus_queue.cc:1035] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:47:11.417765 29756 mvcc.cc:205] Tried to move back new op lower bound from 7317397632417148928 to 7317397632061837312. Current Snapshot: MvccSnapshot[applied={T|T < 7317397632417148928}]
I20260811 18:47:11.442216 29789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:11.433237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:44849 (local address 127.25.25.3:58451)
0811 18:47:11.433475 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:11.433497 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:11.433629 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:11.434290 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:11.434296 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:11.434310 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:47:11.434525 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:11.434535 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.436163 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.436169 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:11.437780 (+ 1611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:11.437799 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.440826 (+ 3027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.440832 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:11.441046 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:11.441102 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:47:11.441603 (+ 501us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:47:11.441616 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 18:47:11.441691 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 18:47:11.441864 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 18:47:11.443022 29705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:11.433685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:58451 (local address 127.25.25.2:44849)
0811 18:47:11.433886 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:11.433891 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:11.433910 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:47:11.433984 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:11.433988 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:11.434074 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:11.434164 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:47:11.434691 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.435782 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.438341 (+ 2559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:11.438974 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:11.439096 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:11.441306 (+ 2210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:47:11.441463 (+ 157us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:47:11.441547 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:11.442620 (+ 1073us) server_negotiation.cc:299] Negotiation successful
0811 18:47:11.442723 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
W20260811 18:47:11.448750 29760 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 18:47:13.076557 28769 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58244:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:47:13.076813 28769 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58244:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:47:13.081662 28769 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 838f080aecdb4ff392f5b285b334c79f: Sending DeleteTablet for 3 replicas of tablet 13a0362ad23c4659a08ce9c1daf8c816
I20260811 18:47:13.082705 29006 tablet_service.cc:1514] Processing DeleteTablet for tablet 13a0362ad23c4659a08ce9c1daf8c816 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:13 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:51438
I20260811 18:47:13.082765 29531 tablet_service.cc:1514] Processing DeleteTablet for tablet 13a0362ad23c4659a08ce9c1daf8c816 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:13 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:36390
I20260811 18:47:13.082856 29293 tablet_service.cc:1514] Processing DeleteTablet for tablet 13a0362ad23c4659a08ce9c1daf8c816 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:13 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:34160
I20260811 18:47:13.095635 29874 tablet_replica.cc:330] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3: stopping tablet replica
I20260811 18:47:13.096175 29874 raft_consensus.cc:2229] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:47:13.097031 29874 raft_consensus.cc:2258] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:13.097885 29873 tablet_replica.cc:330] T 13a0362ad23c4659a08ce9c1daf8c816 P 3ae515004de7466e9bff5b3268814dfd: stopping tablet replica
I20260811 18:47:13.097921 29876 tablet_replica.cc:330] T 13a0362ad23c4659a08ce9c1daf8c816 P 2fa76860383f4d10a5c89db28581b572: stopping tablet replica
I20260811 18:47:13.098150 29876 raft_consensus.cc:2229] T 13a0362ad23c4659a08ce9c1daf8c816 P 2fa76860383f4d10a5c89db28581b572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:47:13.098510 29876 raft_consensus.cc:2258] T 13a0362ad23c4659a08ce9c1daf8c816 P 2fa76860383f4d10a5c89db28581b572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:13.098237 29873 raft_consensus.cc:2229] T 13a0362ad23c4659a08ce9c1daf8c816 P 3ae515004de7466e9bff5b3268814dfd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:47:13.099143 29874 ts_tablet_manager.cc:1905] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:13.099212 29873 raft_consensus.cc:2258] T 13a0362ad23c4659a08ce9c1daf8c816 P 3ae515004de7466e9bff5b3268814dfd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:13.099857 29876 ts_tablet_manager.cc:1905] T 13a0362ad23c4659a08ce9c1daf8c816 P 2fa76860383f4d10a5c89db28581b572: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:13.100216 29873 ts_tablet_manager.cc:1905] T 13a0362ad23c4659a08ce9c1daf8c816 P 3ae515004de7466e9bff5b3268814dfd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:13.105650 29873 ts_tablet_manager.cc:1918] T 13a0362ad23c4659a08ce9c1daf8c816 P 3ae515004de7466e9bff5b3268814dfd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 18:47:13.105891 29873 log.cc:1196] T 13a0362ad23c4659a08ce9c1daf8c816 P 3ae515004de7466e9bff5b3268814dfd: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-0/wal/wals/13a0362ad23c4659a08ce9c1daf8c816
I20260811 18:47:13.106424 29873 ts_tablet_manager.cc:1939] T 13a0362ad23c4659a08ce9c1daf8c816 P 3ae515004de7466e9bff5b3268814dfd: Deleting consensus metadata
I20260811 18:47:13.106415 29874 ts_tablet_manager.cc:1918] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 18:47:13.106673 29874 log.cc:1196] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-1/wal/wals/13a0362ad23c4659a08ce9c1daf8c816
I20260811 18:47:13.106910 29876 ts_tablet_manager.cc:1918] T 13a0362ad23c4659a08ce9c1daf8c816 P 2fa76860383f4d10a5c89db28581b572: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 18:47:13.107128 29876 log.cc:1196] T 13a0362ad23c4659a08ce9c1daf8c816 P 2fa76860383f4d10a5c89db28581b572: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-2/wal/wals/13a0362ad23c4659a08ce9c1daf8c816
I20260811 18:47:13.107254 29874 ts_tablet_manager.cc:1939] T 13a0362ad23c4659a08ce9c1daf8c816 P 45671dc4f7184e85923005550b435cd3: Deleting consensus metadata
I20260811 18:47:13.107899 28745 catalog_manager.cc:4841] TS 3ae515004de7466e9bff5b3268814dfd (127.25.25.1:46177): tablet 13a0362ad23c4659a08ce9c1daf8c816 (table test-table [id=dd1f9b7877ec41da9f3c8e982f74efb0]) successfully deleted
I20260811 18:47:13.107990 29876 ts_tablet_manager.cc:1939] T 13a0362ad23c4659a08ce9c1daf8c816 P 2fa76860383f4d10a5c89db28581b572: Deleting consensus metadata
I20260811 18:47:13.108789 28746 catalog_manager.cc:4841] TS 45671dc4f7184e85923005550b435cd3 (127.25.25.2:44849): tablet 13a0362ad23c4659a08ce9c1daf8c816 (table test-table [id=dd1f9b7877ec41da9f3c8e982f74efb0]) successfully deleted
I20260811 18:47:13.109218 28745 catalog_manager.cc:4841] TS 2fa76860383f4d10a5c89db28581b572 (127.25.25.3:36253): tablet 13a0362ad23c4659a08ce9c1daf8c816 (table test-table [id=dd1f9b7877ec41da9f3c8e982f74efb0]) successfully deleted
Aug 11 18:47:13 dist-test-slave-lgr5 krb5kdc[28687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474033, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 18:47:13 dist-test-slave-lgr5 krb5kdc[28687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474033, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:13.152576 29889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:13.137539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58266 (local address 127.25.25.62:43997)
0811 18:47:13.138206 (+ 667us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:13.138211 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:13.138240 (+ 29us) server_negotiation.cc:407] Connection header received
0811 18:47:13.138319 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:13.138323 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:13.138393 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:13.138502 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:13.139929 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:13.140841 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:13.142153 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:13.142616 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:13.142726 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:13.146871 (+ 4145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:13.146877 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:13.146881 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:13.146936 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:13.149816 (+ 2880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:13.150538 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:13.150543 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:13.150545 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:13.150708 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:13.151076 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:13.151079 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:13.151081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:13.151413 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:13.151616 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:13.151941 (+ 325us) server_negotiation.cc:299] Negotiation successful
0811 18:47:13.152187 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":317,"threads_started":1}
I20260811 18:47:13.156822 28769 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58266:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:47:13.157568 28769 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:47:13.165032 29006 tablet_service.cc:1467] Processing CreateTablet for tablet 75169e7328a446eea4ac904efc53c7c9 (DEFAULT_TABLE table=test-table [id=1ec885c4ebac454690899aff62f6c28f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:13.165135 29293 tablet_service.cc:1467] Processing CreateTablet for tablet 75169e7328a446eea4ac904efc53c7c9 (DEFAULT_TABLE table=test-table [id=1ec885c4ebac454690899aff62f6c28f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:13.165581 29006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75169e7328a446eea4ac904efc53c7c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:13.165645 29293 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75169e7328a446eea4ac904efc53c7c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:13.168195 29531 tablet_service.cc:1467] Processing CreateTablet for tablet 75169e7328a446eea4ac904efc53c7c9 (DEFAULT_TABLE table=test-table [id=1ec885c4ebac454690899aff62f6c28f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:13.168708 29531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75169e7328a446eea4ac904efc53c7c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:13.172863 29890 tablet_bootstrap.cc:492] T 75169e7328a446eea4ac904efc53c7c9 P 3ae515004de7466e9bff5b3268814dfd: Bootstrap starting.
I20260811 18:47:13.173677 29891 tablet_bootstrap.cc:492] T 75169e7328a446eea4ac904efc53c7c9 P 45671dc4f7184e85923005550b435cd3: Bootstrap starting.
I20260811 18:47:13.174808 29890 tablet_bootstrap.cc:654] T 75169e7328a446eea4ac904efc53c7c9 P 3ae515004de7466e9bff5b3268814dfd: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:13.175575 29891 tablet_bootstrap.cc:654] T 75169e7328a446eea4ac904efc53c7c9 P 45671dc4f7184e85923005550b435cd3: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:13.177016 29892 tablet_bootstrap.cc:492] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572: Bootstrap starting.
I20260811 18:47:13.178759 29891 tablet_bootstrap.cc:492] T 75169e7328a446eea4ac904efc53c7c9 P 45671dc4f7184e85923005550b435cd3: No bootstrap required, opened a new log
I20260811 18:47:13.178927 29891 ts_tablet_manager.cc:1397] T 75169e7328a446eea4ac904efc53c7c9 P 45671dc4f7184e85923005550b435cd3: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260811 18:47:13.178946 29890 tablet_bootstrap.cc:492] T 75169e7328a446eea4ac904efc53c7c9 P 3ae515004de7466e9bff5b3268814dfd: No bootstrap required, opened a new log
I20260811 18:47:13.179066 29892 tablet_bootstrap.cc:654] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:13.179107 29890 ts_tablet_manager.cc:1397] T 75169e7328a446eea4ac904efc53c7c9 P 3ae515004de7466e9bff5b3268814dfd: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.003s
I20260811 18:47:13.179723 29891 raft_consensus.cc:348] T 75169e7328a446eea4ac904efc53c7c9 P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:13.180150 29891 raft_consensus.cc:374] T 75169e7328a446eea4ac904efc53c7c9 P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:13.180055 29890 raft_consensus.cc:348] T 75169e7328a446eea4ac904efc53c7c9 P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:13.180342 29891 raft_consensus.cc:729] T 75169e7328a446eea4ac904efc53c7c9 P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45671dc4f7184e85923005550b435cd3, State: Initialized, Role: FOLLOWER
I20260811 18:47:13.180529 29890 raft_consensus.cc:374] T 75169e7328a446eea4ac904efc53c7c9 P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:13.180725 29890 raft_consensus.cc:729] T 75169e7328a446eea4ac904efc53c7c9 P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ae515004de7466e9bff5b3268814dfd, State: Initialized, Role: FOLLOWER
I20260811 18:47:13.180698 29891 consensus_queue.cc:260] T 75169e7328a446eea4ac904efc53c7c9 P 45671dc4f7184e85923005550b435cd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:13.181152 29890 consensus_queue.cc:260] T 75169e7328a446eea4ac904efc53c7c9 P 3ae515004de7466e9bff5b3268814dfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:13.182972 29890 ts_tablet_manager.cc:1428] T 75169e7328a446eea4ac904efc53c7c9 P 3ae515004de7466e9bff5b3268814dfd: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260811 18:47:13.182634 29891 ts_tablet_manager.cc:1428] T 75169e7328a446eea4ac904efc53c7c9 P 45671dc4f7184e85923005550b435cd3: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 18:47:13.186038 29892 tablet_bootstrap.cc:492] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572: No bootstrap required, opened a new log
I20260811 18:47:13.186321 29892 ts_tablet_manager.cc:1397] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260811 18:47:13.187351 29892 raft_consensus.cc:348] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:13.187750 29892 raft_consensus.cc:374] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:13.187892 29892 raft_consensus.cc:729] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa76860383f4d10a5c89db28581b572, State: Initialized, Role: FOLLOWER
I20260811 18:47:13.188191 29892 consensus_queue.cc:260] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:13.188764 29892 ts_tablet_manager.cc:1428] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:47:13.233548 29839 raft_consensus.cc:482] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:47:13.233764 29839 raft_consensus.cc:504] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:13.234539 29839 leader_election.cc:288] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ae515004de7466e9bff5b3268814dfd (127.25.25.1:46177), 45671dc4f7184e85923005550b435cd3 (127.25.25.2:44849)
I20260811 18:47:13.235128 29038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75169e7328a446eea4ac904efc53c7c9" candidate_uuid: "2fa76860383f4d10a5c89db28581b572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ae515004de7466e9bff5b3268814dfd" is_pre_election: true
I20260811 18:47:13.235318 29333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75169e7328a446eea4ac904efc53c7c9" candidate_uuid: "2fa76860383f4d10a5c89db28581b572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45671dc4f7184e85923005550b435cd3" is_pre_election: true
I20260811 18:47:13.235435 29038 raft_consensus.cc:2454] T 75169e7328a446eea4ac904efc53c7c9 P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa76860383f4d10a5c89db28581b572 in term 0.
I20260811 18:47:13.235625 29333 raft_consensus.cc:2454] T 75169e7328a446eea4ac904efc53c7c9 P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa76860383f4d10a5c89db28581b572 in term 0.
I20260811 18:47:13.235991 29459 leader_election.cc:302] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa76860383f4d10a5c89db28581b572, 3ae515004de7466e9bff5b3268814dfd; no voters:
I20260811 18:47:13.236296 29839 raft_consensus.cc:2781] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:47:13.236438 29839 raft_consensus.cc:482] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:47:13.236531 29839 raft_consensus.cc:3037] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:13.238684 29839 raft_consensus.cc:504] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:13.239269 29839 leader_election.cc:288] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572 [CANDIDATE]: Term 1 election: Requested vote from peers 3ae515004de7466e9bff5b3268814dfd (127.25.25.1:46177), 45671dc4f7184e85923005550b435cd3 (127.25.25.2:44849)
I20260811 18:47:13.239779 29038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75169e7328a446eea4ac904efc53c7c9" candidate_uuid: "2fa76860383f4d10a5c89db28581b572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ae515004de7466e9bff5b3268814dfd"
I20260811 18:47:13.239847 29333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75169e7328a446eea4ac904efc53c7c9" candidate_uuid: "2fa76860383f4d10a5c89db28581b572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45671dc4f7184e85923005550b435cd3"
I20260811 18:47:13.240049 29038 raft_consensus.cc:3037] T 75169e7328a446eea4ac904efc53c7c9 P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:13.240060 29333 raft_consensus.cc:3037] T 75169e7328a446eea4ac904efc53c7c9 P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:13.243103 29333 raft_consensus.cc:2454] T 75169e7328a446eea4ac904efc53c7c9 P 45671dc4f7184e85923005550b435cd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa76860383f4d10a5c89db28581b572 in term 1.
I20260811 18:47:13.243088 29038 raft_consensus.cc:2454] T 75169e7328a446eea4ac904efc53c7c9 P 3ae515004de7466e9bff5b3268814dfd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa76860383f4d10a5c89db28581b572 in term 1.
I20260811 18:47:13.243600 29461 leader_election.cc:302] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa76860383f4d10a5c89db28581b572, 45671dc4f7184e85923005550b435cd3; no voters:
I20260811 18:47:13.243929 29839 raft_consensus.cc:2781] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:13.244119 29839 raft_consensus.cc:686] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572 [term 1 LEADER]: Becoming Leader. State: Replica: 2fa76860383f4d10a5c89db28581b572, State: Running, Role: LEADER
I20260811 18:47:13.244436 29839 consensus_queue.cc:237] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:13.247340 28770 catalog_manager.cc:5495] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fa76860383f4d10a5c89db28581b572 (127.25.25.3). New cstate: current_term: 1 leader_uuid: "2fa76860383f4d10a5c89db28581b572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } health_report { overall_health: HEALTHY } } }
I20260811 18:47:13.292486 29902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:13.286383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36402 (local address 127.25.25.3:36253)
0811 18:47:13.287071 (+ 688us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:13.287075 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:13.287098 (+ 23us) server_negotiation.cc:407] Connection header received
0811 18:47:13.287162 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:13.287166 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:13.287249 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:13.287361 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:47:13.287844 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:13.288753 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:13.290354 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:13.290827 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:13.290969 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:13.291547 (+ 578us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:47:13.291699 (+ 152us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:47:13.291792 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:13.291980 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 18:47:13.292128 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":331,"threads_started":1}
I20260811 18:47:13.309083 29902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:13.302735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:43307 (local address 127.25.25.3:36253)
0811 18:47:13.302941 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:13.302947 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:13.303155 (+ 208us) server_negotiation.cc:407] Connection header received
0811 18:47:13.303320 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:13.303326 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:13.303428 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:13.303544 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:47:13.304040 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:13.305194 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:13.306813 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:13.307474 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:13.307629 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:13.308072 (+ 443us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:47:13.308259 (+ 187us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:47:13.308351 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:13.308600 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 18:47:13.308734 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":66}
I20260811 18:47:13.309087 29907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:13.302446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:36253 (local address 127.25.25.3:43307)
0811 18:47:13.303056 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:13.303074 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:13.303204 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:13.303563 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:13.303566 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:13.303577 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:47:13.303871 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:13.303880 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:13.305432 (+ 1552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:13.305438 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:13.306651 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:13.306667 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:13.307708 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:13.307714 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:13.307861 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:13.307906 (+ 45us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:47:13.308408 (+ 502us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:47:13.308421 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 18:47:13.308576 (+ 155us) client_negotiation.cc:240] Negotiation successful
0811 18:47:13.308738 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"mutex_wait_us":41,"thread_start_us":299,"threads_started":1}
I20260811 18:47:13.319075 29038 raft_consensus.cc:1261] T 75169e7328a446eea4ac904efc53c7c9 P 3ae515004de7466e9bff5b3268814dfd [term 1 FOLLOWER]: Refusing update from remote peer 2fa76860383f4d10a5c89db28581b572: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:47:13.319209 29333 raft_consensus.cc:1261] T 75169e7328a446eea4ac904efc53c7c9 P 45671dc4f7184e85923005550b435cd3 [term 1 FOLLOWER]: Refusing update from remote peer 2fa76860383f4d10a5c89db28581b572: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:47:13.319790 29865 consensus_queue.cc:1035] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:47:13.320179 29839 consensus_queue.cc:1035] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:47:13.328946 29841 mvcc.cc:205] Tried to move back new op lower bound from 7317397640469704704 to 7317397640171675648. Current Snapshot: MvccSnapshot[applied={T|T < 7317397640469704704}]
I20260811 18:47:13.377353 28770 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58266:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:47:13.377628 28770 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58266:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:47:13.381130 28770 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 838f080aecdb4ff392f5b285b334c79f: Sending DeleteTablet for 3 replicas of tablet 75169e7328a446eea4ac904efc53c7c9
I20260811 18:47:13.382141 29293 tablet_service.cc:1514] Processing DeleteTablet for tablet 75169e7328a446eea4ac904efc53c7c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:13 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:34160
I20260811 18:47:13.382191 29006 tablet_service.cc:1514] Processing DeleteTablet for tablet 75169e7328a446eea4ac904efc53c7c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:13 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:51438
I20260811 18:47:13.382448 29874 tablet_replica.cc:330] T 75169e7328a446eea4ac904efc53c7c9 P 45671dc4f7184e85923005550b435cd3: stopping tablet replica
I20260811 18:47:13.382660 29874 raft_consensus.cc:2229] T 75169e7328a446eea4ac904efc53c7c9 P 45671dc4f7184e85923005550b435cd3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:47:13.382916 29874 raft_consensus.cc:2258] T 75169e7328a446eea4ac904efc53c7c9 P 45671dc4f7184e85923005550b435cd3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:13.382858 29531 tablet_service.cc:1514] Processing DeleteTablet for tablet 75169e7328a446eea4ac904efc53c7c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:13 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:36390
I20260811 18:47:13.383188 29876 tablet_replica.cc:330] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572: stopping tablet replica
I20260811 18:47:13.383249 29873 tablet_replica.cc:330] T 75169e7328a446eea4ac904efc53c7c9 P 3ae515004de7466e9bff5b3268814dfd: stopping tablet replica
I20260811 18:47:13.383411 29876 raft_consensus.cc:2229] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:47:13.383461 29873 raft_consensus.cc:2229] T 75169e7328a446eea4ac904efc53c7c9 P 3ae515004de7466e9bff5b3268814dfd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:47:13.383658 29873 raft_consensus.cc:2258] T 75169e7328a446eea4ac904efc53c7c9 P 3ae515004de7466e9bff5b3268814dfd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:13.383467 28770 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58266:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 18:47:13.384016 29876 raft_consensus.cc:2258] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 18:47:13.384173 28770 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:47:13.385437 29873 ts_tablet_manager.cc:1905] T 75169e7328a446eea4ac904efc53c7c9 P 3ae515004de7466e9bff5b3268814dfd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:13.385444 29876 ts_tablet_manager.cc:1905] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:13.386297 29874 ts_tablet_manager.cc:1905] T 75169e7328a446eea4ac904efc53c7c9 P 45671dc4f7184e85923005550b435cd3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:13.393440 29874 ts_tablet_manager.cc:1918] T 75169e7328a446eea4ac904efc53c7c9 P 45671dc4f7184e85923005550b435cd3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:47:13.393875 29874 log.cc:1196] T 75169e7328a446eea4ac904efc53c7c9 P 45671dc4f7184e85923005550b435cd3: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-1/wal/wals/75169e7328a446eea4ac904efc53c7c9
I20260811 18:47:13.394057 29876 ts_tablet_manager.cc:1918] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:47:13.394273 29876 log.cc:1196] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-2/wal/wals/75169e7328a446eea4ac904efc53c7c9
I20260811 18:47:13.394375 29874 ts_tablet_manager.cc:1939] T 75169e7328a446eea4ac904efc53c7c9 P 45671dc4f7184e85923005550b435cd3: Deleting consensus metadata
I20260811 18:47:13.394790 29876 ts_tablet_manager.cc:1939] T 75169e7328a446eea4ac904efc53c7c9 P 2fa76860383f4d10a5c89db28581b572: Deleting consensus metadata
I20260811 18:47:13.396097 28746 catalog_manager.cc:4841] TS 45671dc4f7184e85923005550b435cd3 (127.25.25.2:44849): tablet 75169e7328a446eea4ac904efc53c7c9 (table test-table [id=1ec885c4ebac454690899aff62f6c28f]) successfully deleted
I20260811 18:47:13.396281 28745 catalog_manager.cc:4841] TS 2fa76860383f4d10a5c89db28581b572 (127.25.25.3:36253): tablet 75169e7328a446eea4ac904efc53c7c9 (table test-table [id=1ec885c4ebac454690899aff62f6c28f]) successfully deleted
I20260811 18:47:13.397284 29873 ts_tablet_manager.cc:1918] T 75169e7328a446eea4ac904efc53c7c9 P 3ae515004de7466e9bff5b3268814dfd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:47:13.397508 29873 log.cc:1196] T 75169e7328a446eea4ac904efc53c7c9 P 3ae515004de7466e9bff5b3268814dfd: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-0/wal/wals/75169e7328a446eea4ac904efc53c7c9
I20260811 18:47:13.397974 29873 ts_tablet_manager.cc:1939] T 75169e7328a446eea4ac904efc53c7c9 P 3ae515004de7466e9bff5b3268814dfd: Deleting consensus metadata
I20260811 18:47:13.399132 29006 tablet_service.cc:1467] Processing CreateTablet for tablet 9a374903be0445dc82b8ad737180c532 (DEFAULT_TABLE table=test-table [id=bb725b4fcd4340b7b12184879ca63ba3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:13.399598 29006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a374903be0445dc82b8ad737180c532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:13.400348 29293 tablet_service.cc:1467] Processing CreateTablet for tablet 9a374903be0445dc82b8ad737180c532 (DEFAULT_TABLE table=test-table [id=bb725b4fcd4340b7b12184879ca63ba3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:13.400808 29293 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a374903be0445dc82b8ad737180c532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:13.404475 28745 catalog_manager.cc:4841] TS 3ae515004de7466e9bff5b3268814dfd (127.25.25.1:46177): tablet 75169e7328a446eea4ac904efc53c7c9 (table test-table [id=1ec885c4ebac454690899aff62f6c28f]) successfully deleted
I20260811 18:47:13.405364 29531 tablet_service.cc:1467] Processing CreateTablet for tablet 9a374903be0445dc82b8ad737180c532 (DEFAULT_TABLE table=test-table [id=bb725b4fcd4340b7b12184879ca63ba3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:13.406008 29531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a374903be0445dc82b8ad737180c532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:13.406636 29890 tablet_bootstrap.cc:492] T 9a374903be0445dc82b8ad737180c532 P 3ae515004de7466e9bff5b3268814dfd: Bootstrap starting.
I20260811 18:47:13.408457 29890 tablet_bootstrap.cc:654] T 9a374903be0445dc82b8ad737180c532 P 3ae515004de7466e9bff5b3268814dfd: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:13.417639 29891 tablet_bootstrap.cc:492] T 9a374903be0445dc82b8ad737180c532 P 45671dc4f7184e85923005550b435cd3: Bootstrap starting.
I20260811 18:47:13.419548 29891 tablet_bootstrap.cc:654] T 9a374903be0445dc82b8ad737180c532 P 45671dc4f7184e85923005550b435cd3: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:13.423538 29892 tablet_bootstrap.cc:492] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572: Bootstrap starting.
I20260811 18:47:13.423696 29890 tablet_bootstrap.cc:492] T 9a374903be0445dc82b8ad737180c532 P 3ae515004de7466e9bff5b3268814dfd: No bootstrap required, opened a new log
I20260811 18:47:13.423870 29890 ts_tablet_manager.cc:1397] T 9a374903be0445dc82b8ad737180c532 P 3ae515004de7466e9bff5b3268814dfd: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.009s
I20260811 18:47:13.424638 29890 raft_consensus.cc:348] T 9a374903be0445dc82b8ad737180c532 P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:13.424909 29890 raft_consensus.cc:374] T 9a374903be0445dc82b8ad737180c532 P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:13.424983 29890 raft_consensus.cc:729] T 9a374903be0445dc82b8ad737180c532 P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ae515004de7466e9bff5b3268814dfd, State: Initialized, Role: FOLLOWER
I20260811 18:47:13.425531 29892 tablet_bootstrap.cc:654] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:13.426522 29890 consensus_queue.cc:260] T 9a374903be0445dc82b8ad737180c532 P 3ae515004de7466e9bff5b3268814dfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:13.429768 29890 ts_tablet_manager.cc:1428] T 9a374903be0445dc82b8ad737180c532 P 3ae515004de7466e9bff5b3268814dfd: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260811 18:47:13.434132 29891 tablet_bootstrap.cc:492] T 9a374903be0445dc82b8ad737180c532 P 45671dc4f7184e85923005550b435cd3: No bootstrap required, opened a new log
I20260811 18:47:13.434417 29891 ts_tablet_manager.cc:1397] T 9a374903be0445dc82b8ad737180c532 P 45671dc4f7184e85923005550b435cd3: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.000s
I20260811 18:47:13.435470 29892 tablet_bootstrap.cc:492] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572: No bootstrap required, opened a new log
I20260811 18:47:13.435360 29891 raft_consensus.cc:348] T 9a374903be0445dc82b8ad737180c532 P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:13.435659 29891 raft_consensus.cc:374] T 9a374903be0445dc82b8ad737180c532 P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:13.435760 29891 raft_consensus.cc:729] T 9a374903be0445dc82b8ad737180c532 P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45671dc4f7184e85923005550b435cd3, State: Initialized, Role: FOLLOWER
I20260811 18:47:13.435891 29892 ts_tablet_manager.cc:1397] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.006s
I20260811 18:47:13.436046 29891 consensus_queue.cc:260] T 9a374903be0445dc82b8ad737180c532 P 45671dc4f7184e85923005550b435cd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:13.436734 29891 ts_tablet_manager.cc:1428] T 9a374903be0445dc82b8ad737180c532 P 45671dc4f7184e85923005550b435cd3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:47:13.436861 29892 raft_consensus.cc:348] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:13.437224 29892 raft_consensus.cc:374] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:13.437373 29892 raft_consensus.cc:729] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa76860383f4d10a5c89db28581b572, State: Initialized, Role: FOLLOWER
I20260811 18:47:13.437719 29892 consensus_queue.cc:260] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:13.439009 29892 ts_tablet_manager.cc:1428] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 18:47:13.666898 29839 raft_consensus.cc:482] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:47:13.667203 29839 raft_consensus.cc:504] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:13.668072 29839 leader_election.cc:288] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ae515004de7466e9bff5b3268814dfd (127.25.25.1:46177), 45671dc4f7184e85923005550b435cd3 (127.25.25.2:44849)
I20260811 18:47:13.668869 29333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a374903be0445dc82b8ad737180c532" candidate_uuid: "2fa76860383f4d10a5c89db28581b572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45671dc4f7184e85923005550b435cd3" is_pre_election: true
I20260811 18:47:13.668860 29038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a374903be0445dc82b8ad737180c532" candidate_uuid: "2fa76860383f4d10a5c89db28581b572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ae515004de7466e9bff5b3268814dfd" is_pre_election: true
I20260811 18:47:13.669145 29333 raft_consensus.cc:2454] T 9a374903be0445dc82b8ad737180c532 P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa76860383f4d10a5c89db28581b572 in term 0.
I20260811 18:47:13.669178 29038 raft_consensus.cc:2454] T 9a374903be0445dc82b8ad737180c532 P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa76860383f4d10a5c89db28581b572 in term 0.
I20260811 18:47:13.669680 29459 leader_election.cc:302] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa76860383f4d10a5c89db28581b572, 3ae515004de7466e9bff5b3268814dfd; no voters:
I20260811 18:47:13.670012 29839 raft_consensus.cc:2781] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:47:13.670145 29839 raft_consensus.cc:482] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:47:13.670239 29839 raft_consensus.cc:3037] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:13.672729 29839 raft_consensus.cc:504] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:13.673358 29839 leader_election.cc:288] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572 [CANDIDATE]: Term 1 election: Requested vote from peers 3ae515004de7466e9bff5b3268814dfd (127.25.25.1:46177), 45671dc4f7184e85923005550b435cd3 (127.25.25.2:44849)
I20260811 18:47:13.673985 29038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a374903be0445dc82b8ad737180c532" candidate_uuid: "2fa76860383f4d10a5c89db28581b572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ae515004de7466e9bff5b3268814dfd"
I20260811 18:47:13.674011 29333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a374903be0445dc82b8ad737180c532" candidate_uuid: "2fa76860383f4d10a5c89db28581b572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45671dc4f7184e85923005550b435cd3"
I20260811 18:47:13.674209 29038 raft_consensus.cc:3037] T 9a374903be0445dc82b8ad737180c532 P 3ae515004de7466e9bff5b3268814dfd [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:13.674254 29333 raft_consensus.cc:3037] T 9a374903be0445dc82b8ad737180c532 P 45671dc4f7184e85923005550b435cd3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:13.676360 29038 raft_consensus.cc:2454] T 9a374903be0445dc82b8ad737180c532 P 3ae515004de7466e9bff5b3268814dfd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa76860383f4d10a5c89db28581b572 in term 1.
I20260811 18:47:13.676847 29459 leader_election.cc:302] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa76860383f4d10a5c89db28581b572, 3ae515004de7466e9bff5b3268814dfd; no voters:
I20260811 18:47:13.677156 29839 raft_consensus.cc:2781] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:13.677317 29839 raft_consensus.cc:686] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572 [term 1 LEADER]: Becoming Leader. State: Replica: 2fa76860383f4d10a5c89db28581b572, State: Running, Role: LEADER
I20260811 18:47:13.677359 29333 raft_consensus.cc:2454] T 9a374903be0445dc82b8ad737180c532 P 45671dc4f7184e85923005550b435cd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa76860383f4d10a5c89db28581b572 in term 1.
I20260811 18:47:13.677649 29839 consensus_queue.cc:237] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } }
I20260811 18:47:13.680720 28770 catalog_manager.cc:5495] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fa76860383f4d10a5c89db28581b572 (127.25.25.3). New cstate: current_term: 1 leader_uuid: "2fa76860383f4d10a5c89db28581b572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa76860383f4d10a5c89db28581b572" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 36253 } health_report { overall_health: HEALTHY } } }
I20260811 18:47:13.733716 29335 raft_consensus.cc:1261] T 9a374903be0445dc82b8ad737180c532 P 45671dc4f7184e85923005550b435cd3 [term 1 FOLLOWER]: Refusing update from remote peer 2fa76860383f4d10a5c89db28581b572: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:47:13.734400 29039 raft_consensus.cc:1261] T 9a374903be0445dc82b8ad737180c532 P 3ae515004de7466e9bff5b3268814dfd [term 1 FOLLOWER]: Refusing update from remote peer 2fa76860383f4d10a5c89db28581b572: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:47:13.734375 29865 consensus_queue.cc:1035] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45671dc4f7184e85923005550b435cd3" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:47:13.735216 29865 consensus_queue.cc:1035] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ae515004de7466e9bff5b3268814dfd" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 46177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:47:13.759531 29840 mvcc.cc:205] Tried to move back new op lower bound from 7317397642164224000 to 7317397641946173440. Current Snapshot: MvccSnapshot[applied={T|T < 7317397642164224000}]
W20260811 18:47:13.776175 29836 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 18:47:15.378588 28769 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58266:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:47:15.378918 28769 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58266:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:47:15.383678 28769 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 838f080aecdb4ff392f5b285b334c79f: Sending DeleteTablet for 3 replicas of tablet 9a374903be0445dc82b8ad737180c532
I20260811 18:47:15.384641 29006 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a374903be0445dc82b8ad737180c532 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:15 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:51438
I20260811 18:47:15.384656 29531 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a374903be0445dc82b8ad737180c532 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:15 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:36390
I20260811 18:47:15.384750 29293 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a374903be0445dc82b8ad737180c532 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:15 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:34160
I20260811 18:47:15.385511 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 28892
I20260811 18:47:15.393954 29958 tablet_replica.cc:330] T 9a374903be0445dc82b8ad737180c532 P 45671dc4f7184e85923005550b435cd3: stopping tablet replica
I20260811 18:47:15.394215 29958 raft_consensus.cc:2229] T 9a374903be0445dc82b8ad737180c532 P 45671dc4f7184e85923005550b435cd3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:47:15.394521 29958 raft_consensus.cc:2258] T 9a374903be0445dc82b8ad737180c532 P 45671dc4f7184e85923005550b435cd3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:15.395779 29958 ts_tablet_manager.cc:1905] T 9a374903be0445dc82b8ad737180c532 P 45671dc4f7184e85923005550b435cd3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:15.397240 29957 tablet_replica.cc:330] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572: stopping tablet replica
I20260811 18:47:15.397529 29957 raft_consensus.cc:2229] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:47:15.398025 29957 raft_consensus.cc:2258] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:15.399550 29957 ts_tablet_manager.cc:1905] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:15.403059 29958 ts_tablet_manager.cc:1918] T 9a374903be0445dc82b8ad737180c532 P 45671dc4f7184e85923005550b435cd3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 18:47:15.403201 29958 log.cc:1196] T 9a374903be0445dc82b8ad737180c532 P 45671dc4f7184e85923005550b435cd3: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-1/wal/wals/9a374903be0445dc82b8ad737180c532
I20260811 18:47:15.403580 29958 ts_tablet_manager.cc:1939] T 9a374903be0445dc82b8ad737180c532 P 45671dc4f7184e85923005550b435cd3: Deleting consensus metadata
I20260811 18:47:15.404757 28746 catalog_manager.cc:4841] TS 45671dc4f7184e85923005550b435cd3 (127.25.25.2:44849): tablet 9a374903be0445dc82b8ad737180c532 (table test-table [id=bb725b4fcd4340b7b12184879ca63ba3]) successfully deleted
I20260811 18:47:15.405493 29955 tablet_replica.cc:330] T 9a374903be0445dc82b8ad737180c532 P 3ae515004de7466e9bff5b3268814dfd: stopping tablet replica
I20260811 18:47:15.405679 29955 raft_consensus.cc:2229] T 9a374903be0445dc82b8ad737180c532 P 3ae515004de7466e9bff5b3268814dfd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:47:15.405925 29955 raft_consensus.cc:2258] T 9a374903be0445dc82b8ad737180c532 P 3ae515004de7466e9bff5b3268814dfd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:15.406772 29955 ts_tablet_manager.cc:1905] T 9a374903be0445dc82b8ad737180c532 P 3ae515004de7466e9bff5b3268814dfd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:15.407024 29957 ts_tablet_manager.cc:1918] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 18:47:15.407163 29957 log.cc:1196] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-2/wal/wals/9a374903be0445dc82b8ad737180c532
I20260811 18:47:15.407635 29957 ts_tablet_manager.cc:1939] T 9a374903be0445dc82b8ad737180c532 P 2fa76860383f4d10a5c89db28581b572: Deleting consensus metadata
I20260811 18:47:15.408906 28745 catalog_manager.cc:4841] TS 2fa76860383f4d10a5c89db28581b572 (127.25.25.3:36253): tablet 9a374903be0445dc82b8ad737180c532 (table test-table [id=bb725b4fcd4340b7b12184879ca63ba3]) successfully deleted
Aug 11 18:47:15 dist-test-slave-lgr5 krb5kdc[28687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474033, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.25.1@KRBTEST.COM
I20260811 18:47:15.414053 29955 ts_tablet_manager.cc:1918] T 9a374903be0445dc82b8ad737180c532 P 3ae515004de7466e9bff5b3268814dfd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 18:47:15.414232 29955 log.cc:1196] T 9a374903be0445dc82b8ad737180c532 P 3ae515004de7466e9bff5b3268814dfd: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474012733352-25700-0/minicluster-data/ts-0/wal/wals/9a374903be0445dc82b8ad737180c532
I20260811 18:47:15.414750 29955 ts_tablet_manager.cc:1939] T 9a374903be0445dc82b8ad737180c532 P 3ae515004de7466e9bff5b3268814dfd: Deleting consensus metadata
I20260811 18:47:15.416029 28745 catalog_manager.cc:4841] TS 3ae515004de7466e9bff5b3268814dfd (127.25.25.1:46177): tablet 9a374903be0445dc82b8ad737180c532 (table test-table [id=bb725b4fcd4340b7b12184879ca63ba3]) successfully deleted
I20260811 18:47:15.419420 29961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:15.388816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51464 (local address 127.25.25.1:46177)
0811 18:47:15.393697 (+ 4881us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:15.393705 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:15.393749 (+ 44us) server_negotiation.cc:407] Connection header received
0811 18:47:15.393842 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:15.393849 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:15.393967 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:15.394142 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:15.396408 (+ 2266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:15.397776 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:15.400713 (+ 2937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:15.401399 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:15.401538 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:15.412221 (+ 10683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:15.412245 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:15.412272 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:15.412317 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:15.416579 (+ 4262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:15.417328 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:15.417337 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:15.417339 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:15.417490 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:15.417885 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:15.417889 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:15.417891 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:15.418255 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:15.418563 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:15.418863 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 18:47:15.419091 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4655,"thread_start_us":4559,"threads_started":1}
W20260811 18:47:15.420164 29128 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51464
W20260811 18:47:15.420763 25700 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 28892: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:47:15.420990 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 28892
I20260811 18:47:15.459470 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 29155
Aug 11 18:47:15 dist-test-slave-lgr5 krb5kdc[28687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474033, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.25.2@KRBTEST.COM
I20260811 18:47:15.476171 29964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:15.460374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34166 (local address 127.25.25.2:44849)
0811 18:47:15.460930 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:15.460935 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:15.460953 (+ 18us) server_negotiation.cc:407] Connection header received
0811 18:47:15.461014 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:15.461018 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:15.461080 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:15.461181 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:15.462527 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:15.463305 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:15.464802 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:15.465256 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:15.465366 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:15.469847 (+ 4481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:15.469875 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:15.469894 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:15.469948 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:15.473050 (+ 3102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:15.473954 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:15.473965 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:15.473969 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:15.474188 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:15.474668 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:15.474672 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:15.474674 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:15.475112 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:15.475363 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:15.475639 (+ 276us) server_negotiation.cc:299] Negotiation successful
0811 18:47:15.475843 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":276,"threads_started":1}
W20260811 18:47:15.476863 29409 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34166
W20260811 18:47:15.477555 25700 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 29155: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:47:15.477710 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 29155
I20260811 18:47:15.512526 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 29434
Aug 11 18:47:15 dist-test-slave-lgr5 krb5kdc[28687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474033, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.25.3@KRBTEST.COM
I20260811 18:47:15.528059 29967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:15.513328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36412 (local address 127.25.25.3:36253)
0811 18:47:15.513849 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:15.513853 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:15.513870 (+ 17us) server_negotiation.cc:407] Connection header received
0811 18:47:15.513929 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:15.513934 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:15.514002 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:15.514092 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:15.515381 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:15.516193 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:15.517376 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:15.517792 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:15.517884 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:15.522210 (+ 4326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:15.522228 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:15.522246 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:15.522285 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:15.525199 (+ 2914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:15.525927 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:15.525937 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:15.525940 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:15.526079 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:15.526468 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:15.526472 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:15.526474 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:15.526856 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:15.527150 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:15.527469 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 18:47:15.527718 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":259,"threads_started":1}
W20260811 18:47:15.528770 29660 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36412
W20260811 18:47:15.529410 25700 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 29434: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:47:15.529582 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 29434
I20260811 18:47:15.570668 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 28711
I20260811 18:47:15.572149 28838 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:15.694154 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 28711
2026-08-11T18:47:15Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (8914 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:47:15 dist-test-slave-lgr5 krb5kdc[29979](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:47:15 dist-test-slave-lgr5 krb5kdc[29979](info): set up 2 sockets
Aug 11 18:47:15 dist-test-slave-lgr5 krb5kdc[29979](info): commencing operation
krb5kdc: starting...
W20260811 18:47:16.960194 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.212s user 0.007s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:47:17 dist-test-slave-lgr5 krb5kdc[29979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474037, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:47:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:47:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:47:17.192741 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:46497
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:39751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:46497
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:17.542142 30002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:17.542501 30002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:17.542650 30002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:17.550141 30002 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:47:17.550284 30002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:17.550369 30002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:17.550452 30002 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:47:17.550514 30002 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:47:17.560807 30002 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:39751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:46497
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:46497
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:17.562234 30002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:17.563659 30002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:17.576180 30020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:17.576244 30015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:17.576347 30014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:17.576897 30002 server_base.cc:1034] running on GCE node
I20260811 18:47:17.577754 30002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:17.579291 30002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:17.580523 30002 hybrid_clock.cc:648] HybridClock initialized: now 1786474037580458 us; error 56 us; skew 500 ppm
I20260811 18:47:17.580873 30002 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:17 dist-test-slave-lgr5 krb5kdc[29979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474037, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:17.584028 30002 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:47:17.585698 30002 webserver.cc:460] Webserver started at http://127.25.25.62:40525/ using document root <none> and password file <none>
I20260811 18:47:17.586450 30002 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:17.586565 30002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:17.586843 30002 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:17.590165 30002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "eef87be905e1410b9988c7a1fdcd89c7"
format_stamp: "Formatted at 2026-08-11 18:47:17 on dist-test-slave-lgr5"
server_key: "99b96104f9bddc5dd51d6efddbdfeb35"
server_key_iv: "8b78119724cd4342e0191f2c8847d26b"
server_key_version: "encryptionkey@0"
I20260811 18:47:17.590986 30002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "eef87be905e1410b9988c7a1fdcd89c7"
format_stamp: "Formatted at 2026-08-11 18:47:17 on dist-test-slave-lgr5"
server_key: "99b96104f9bddc5dd51d6efddbdfeb35"
server_key_iv: "8b78119724cd4342e0191f2c8847d26b"
server_key_version: "encryptionkey@0"
I20260811 18:47:17.596666 30002 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 18:47:17.600337 30030 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:17.602013 30002 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:47:17.602205 30002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "eef87be905e1410b9988c7a1fdcd89c7"
format_stamp: "Formatted at 2026-08-11 18:47:17 on dist-test-slave-lgr5"
server_key: "99b96104f9bddc5dd51d6efddbdfeb35"
server_key_iv: "8b78119724cd4342e0191f2c8847d26b"
server_key_version: "encryptionkey@0"
I20260811 18:47:17.602412 30002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:17.620896 30002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:17.625999 30002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:17.626276 30002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:17.646878 30002 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:46497
I20260811 18:47:17.646924 30132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:46497 every 8 connection(s)
I20260811 18:47:17.648814 30002 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:47:17.656406 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 30002
I20260811 18:47:17.656677 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:47:17.657336 25700 external_mini_cluster.cc:1428] Setting key b3934b2ed397f677ff3744d7f1f5c11f
I20260811 18:47:17.657577 30134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:17.671598 30134 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eef87be905e1410b9988c7a1fdcd89c7: Bootstrap starting.
Aug 11 18:47:17 dist-test-slave-lgr5 krb5kdc[29979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474037, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:17.675563 30134 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eef87be905e1410b9988c7a1fdcd89c7: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:17.676913 30134 log.cc:824] T 00000000000000000000000000000000 P eef87be905e1410b9988c7a1fdcd89c7: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:17.680879 30134 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eef87be905e1410b9988c7a1fdcd89c7: No bootstrap required, opened a new log
I20260811 18:47:17.683406 30140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:17.659523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36222 (local address 127.25.25.62:46497)
0811 18:47:17.660529 (+ 1006us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:17.660542 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:17.660591 (+ 49us) server_negotiation.cc:407] Connection header received
0811 18:47:17.662771 (+ 2180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:17.662800 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:17.663323 (+ 523us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:17.663784 (+ 461us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:17.665564 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:17.666988 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:17.668445 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:17.669274 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:17.669509 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:17.674178 (+ 4669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:17.674188 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:17.674205 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:17.674259 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:17.678036 (+ 3777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:17.679233 (+ 1197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:17.679241 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:17.679249 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:17.679488 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:17.680051 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:17.680056 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:17.680058 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:17.680745 (+ 687us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:17.681032 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:17.681606 (+ 574us) server_negotiation.cc:299] Negotiation successful
0811 18:47:17.682015 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":721,"thread_start_us":428,"threads_started":1}
I20260811 18:47:17.690798 30134 raft_consensus.cc:348] T 00000000000000000000000000000000 P eef87be905e1410b9988c7a1fdcd89c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eef87be905e1410b9988c7a1fdcd89c7" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46497 } }
I20260811 18:47:17.691282 30134 raft_consensus.cc:374] T 00000000000000000000000000000000 P eef87be905e1410b9988c7a1fdcd89c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:17.691407 30134 raft_consensus.cc:729] T 00000000000000000000000000000000 P eef87be905e1410b9988c7a1fdcd89c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eef87be905e1410b9988c7a1fdcd89c7, State: Initialized, Role: FOLLOWER
I20260811 18:47:17.692160 30134 consensus_queue.cc:260] T 00000000000000000000000000000000 P eef87be905e1410b9988c7a1fdcd89c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eef87be905e1410b9988c7a1fdcd89c7" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46497 } }
I20260811 18:47:17.692451 30134 raft_consensus.cc:388] T 00000000000000000000000000000000 P eef87be905e1410b9988c7a1fdcd89c7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:47:17.692615 30134 raft_consensus.cc:482] T 00000000000000000000000000000000 P eef87be905e1410b9988c7a1fdcd89c7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:47:17.692818 30134 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eef87be905e1410b9988c7a1fdcd89c7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:17.695513 30134 raft_consensus.cc:504] T 00000000000000000000000000000000 P eef87be905e1410b9988c7a1fdcd89c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eef87be905e1410b9988c7a1fdcd89c7" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46497 } }
I20260811 18:47:17.696171 30134 leader_election.cc:302] T 00000000000000000000000000000000 P eef87be905e1410b9988c7a1fdcd89c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eef87be905e1410b9988c7a1fdcd89c7; no voters:
I20260811 18:47:17.696874 30134 leader_election.cc:288] T 00000000000000000000000000000000 P eef87be905e1410b9988c7a1fdcd89c7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:47:17.697021 30143 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eef87be905e1410b9988c7a1fdcd89c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:17.697710 30143 raft_consensus.cc:686] T 00000000000000000000000000000000 P eef87be905e1410b9988c7a1fdcd89c7 [term 1 LEADER]: Becoming Leader. State: Replica: eef87be905e1410b9988c7a1fdcd89c7, State: Running, Role: LEADER
I20260811 18:47:17.698294 30143 consensus_queue.cc:237] T 00000000000000000000000000000000 P eef87be905e1410b9988c7a1fdcd89c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eef87be905e1410b9988c7a1fdcd89c7" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46497 } }
I20260811 18:47:17.699127 30134 sys_catalog.cc:564] T 00000000000000000000000000000000 P eef87be905e1410b9988c7a1fdcd89c7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:47:17.701412 30146 sys_catalog.cc:455] T 00000000000000000000000000000000 P eef87be905e1410b9988c7a1fdcd89c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eef87be905e1410b9988c7a1fdcd89c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eef87be905e1410b9988c7a1fdcd89c7" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46497 } } }
I20260811 18:47:17.701937 30146 sys_catalog.cc:458] T 00000000000000000000000000000000 P eef87be905e1410b9988c7a1fdcd89c7 [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:17.701970 30148 sys_catalog.cc:455] T 00000000000000000000000000000000 P eef87be905e1410b9988c7a1fdcd89c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eef87be905e1410b9988c7a1fdcd89c7. Latest consensus state: current_term: 1 leader_uuid: "eef87be905e1410b9988c7a1fdcd89c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eef87be905e1410b9988c7a1fdcd89c7" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46497 } } }
I20260811 18:47:17.702299 30148 sys_catalog.cc:458] T 00000000000000000000000000000000 P eef87be905e1410b9988c7a1fdcd89c7 [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:17.704172 30154 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:47:17.709555 30154 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:47:17.719545 30154 catalog_manager.cc:1347] Generated new cluster ID: 5521437d65eb400cbaaab30e6d21a8a8
I20260811 18:47:17.719694 30154 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:47:17.755149 30154 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:47:17.757475 30154 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:47:17.778625 30154 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eef87be905e1410b9988c7a1fdcd89c7: Generated new TSK 0
I20260811 18:47:17.779814 30154 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.25.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
I20260811 18:47:17.840725 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:0
--local_ip_for_outbound_sockets=127.25.25.1
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:46497
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:39751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:18.198928 30179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:18.199283 30179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:18.199431 30179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:18.207171 30179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:18.207321 30179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:18.207497 30179 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:47:18.218205 30179 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:39751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:46497
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:18.219684 30179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:18.221169 30179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:18.235456 30193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:18.235468 30188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:18.235491 30187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:18.237087 30179 server_base.cc:1034] running on GCE node
I20260811 18:47:18.237886 30179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:18.239008 30179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:18.240239 30179 hybrid_clock.cc:648] HybridClock initialized: now 1786474038240170 us; error 44 us; skew 500 ppm
I20260811 18:47:18.240669 30179 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:18 dist-test-slave-lgr5 krb5kdc[29979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474038, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:18.244499 30179 init.cc:377] Logged in from keytab as kudu/127.25.25.1@KRBTEST.COM (short username kudu)
I20260811 18:47:18.246265 30179 webserver.cc:460] Webserver started at http://127.25.25.1:42067/ using document root <none> and password file <none>
I20260811 18:47:18.247080 30179 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:18.247210 30179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:18.247563 30179 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:18.251187 30179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/data/instance:
uuid: "8169d0a5d2ff42368b03036408684ee7"
format_stamp: "Formatted at 2026-08-11 18:47:18 on dist-test-slave-lgr5"
server_key: "450196ba859ee8a421d8ce2d961c6dd0"
server_key_iv: "a7502e1cddf17c93ef2e5b6fb82c083a"
server_key_version: "encryptionkey@0"
I20260811 18:47:18.252287 30179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance:
uuid: "8169d0a5d2ff42368b03036408684ee7"
format_stamp: "Formatted at 2026-08-11 18:47:18 on dist-test-slave-lgr5"
server_key: "450196ba859ee8a421d8ce2d961c6dd0"
server_key_iv: "a7502e1cddf17c93ef2e5b6fb82c083a"
server_key_version: "encryptionkey@0"
I20260811 18:47:18.258857 30179 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 18:47:18.263442 30203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:18.265235 30179 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 18:47:18.265493 30179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "8169d0a5d2ff42368b03036408684ee7"
format_stamp: "Formatted at 2026-08-11 18:47:18 on dist-test-slave-lgr5"
server_key: "450196ba859ee8a421d8ce2d961c6dd0"
server_key_iv: "a7502e1cddf17c93ef2e5b6fb82c083a"
server_key_version: "encryptionkey@0"
I20260811 18:47:18.265748 30179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:18.286540 30179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:18.292799 30179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:18.293148 30179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:18.294314 30179 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:47:18.296068 30179 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:18.296217 30179 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260811 18:47:18.296370 30179 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:18.296428 30179 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:18.329663 30179 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:45961
I20260811 18:47:18.329708 30394 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:45961 every 8 connection(s)
I20260811 18:47:18.331024 30179 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:47:18.336591 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 30179
I20260811 18:47:18.336815 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance
I20260811 18:47:18.337455 25700 external_mini_cluster.cc:1428] Setting key 6f2bbc90afb4c28e0bf2e407bc3647fa
Aug 11 18:47:18 dist-test-slave-lgr5 krb5kdc[29979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474038, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:18.353041 30400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:18.334066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:60915 (local address 127.25.25.62:46497)
0811 18:47:18.334552 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:18.334557 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:18.335760 (+ 1203us) server_negotiation.cc:407] Connection header received
0811 18:47:18.337945 (+ 2185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:18.337951 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:18.338047 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:18.338163 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:18.340202 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:18.341019 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:18.342672 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:18.343094 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:18.343215 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:18.347001 (+ 3786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:18.347007 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:18.347010 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:18.347049 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:18.349715 (+ 2666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:18.350538 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:18.350543 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:18.350546 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:18.350677 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:18.351132 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:18.351136 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:18.351138 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:18.351421 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:18.351564 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:18.352388 (+ 824us) server_negotiation.cc:299] Negotiation successful
0811 18:47:18.352647 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":241,"threads_started":1}
I20260811 18:47:18.354120 30401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:18.334731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:46497 (local address 127.25.25.1:60915)
0811 18:47:18.335567 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:18.335611 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:18.337590 (+ 1979us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:18.338471 (+ 881us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:18.338485 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:18.339343 (+ 858us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:18.340001 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:18.340021 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:18.341186 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:18.341191 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:18.342513 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:18.342528 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:18.343352 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:18.343360 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:18.343610 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:18.344343 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:18.344375 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:18.346710 (+ 2335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:18.349886 (+ 3176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:18.349897 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:18.349917 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:18.350386 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:18.350789 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:18.350795 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:18.350798 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:18.351008 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:18.351556 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:18.351565 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:18.351942 (+ 377us) client_negotiation.cc:769] Sending connection context
0811 18:47:18.352254 (+ 312us) client_negotiation.cc:240] Negotiation successful
0811 18:47:18.352866 (+ 612us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":312,"threads_started":1}
I20260811 18:47:18.355966 30396 heartbeater.cc:347] Connected to a master server at 127.25.25.62:46497
I20260811 18:47:18.356360 30396 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:18.357360 30396 heartbeater.cc:511] Master 127.25.25.62:46497 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.25.25.2@KRBTEST.COM; defaulting to no policy
I20260811 18:47:18.359797 30059 ts_manager.cc:194] Registered new tserver with Master: 8169d0a5d2ff42368b03036408684ee7 (127.25.25.1:45961)
I20260811 18:47:18.361478 30059 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.1@KRBTEST.COM'} at 127.25.25.1:60915
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
I20260811 18:47:18.392401 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:0
--local_ip_for_outbound_sockets=127.25.25.2
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:46497
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:39751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:18.750263 30405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:18.750602 30405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:18.750742 30405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:18.758203 30405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:18.758349 30405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:18.758522 30405 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:47:18.768776 30405 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:39751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:46497
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:18.770229 30405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:18.771727 30405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:18.785887 30414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:18.785951 30419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:18.785928 30412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:18.786671 30405 server_base.cc:1034] running on GCE node
I20260811 18:47:18.787434 30405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:18.788573 30405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:18.789800 30405 hybrid_clock.cc:648] HybridClock initialized: now 1786474038789746 us; error 56 us; skew 500 ppm
I20260811 18:47:18.790154 30405 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:18 dist-test-slave-lgr5 krb5kdc[29979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474038, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:18.793552 30405 init.cc:377] Logged in from keytab as kudu/127.25.25.2@KRBTEST.COM (short username kudu)
I20260811 18:47:18.795192 30405 webserver.cc:460] Webserver started at http://127.25.25.2:39481/ using document root <none> and password file <none>
I20260811 18:47:18.795987 30405 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:18.796144 30405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:18.796489 30405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:18.799804 30405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/data/instance:
uuid: "77e87f08af6348e5979a36796f8c0de8"
format_stamp: "Formatted at 2026-08-11 18:47:18 on dist-test-slave-lgr5"
server_key: "a3f904b232f92ce18d666d369b573f43"
server_key_iv: "14d710ce4fec0d83d509bbbd5dd684b8"
server_key_version: "encryptionkey@0"
I20260811 18:47:18.800792 30405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance:
uuid: "77e87f08af6348e5979a36796f8c0de8"
format_stamp: "Formatted at 2026-08-11 18:47:18 on dist-test-slave-lgr5"
server_key: "a3f904b232f92ce18d666d369b573f43"
server_key_iv: "14d710ce4fec0d83d509bbbd5dd684b8"
server_key_version: "encryptionkey@0"
I20260811 18:47:18.807588 30405 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.001s
I20260811 18:47:18.811913 30429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:18.813638 30405 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260811 18:47:18.813848 30405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "77e87f08af6348e5979a36796f8c0de8"
format_stamp: "Formatted at 2026-08-11 18:47:18 on dist-test-slave-lgr5"
server_key: "a3f904b232f92ce18d666d369b573f43"
server_key_iv: "14d710ce4fec0d83d509bbbd5dd684b8"
server_key_version: "encryptionkey@0"
I20260811 18:47:18.814078 30405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:18.830288 30405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:18.835326 30405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:18.835630 30405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:18.836814 30405 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:47:18.838361 30405 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:18.838441 30405 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:18.838552 30405 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:18.838613 30405 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:18.871227 30405 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:42907
I20260811 18:47:18.871282 30631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:42907 every 8 connection(s)
I20260811 18:47:18.872699 30405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:47:18.876106 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 30405
I20260811 18:47:18.876322 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance
I20260811 18:47:18.876762 25700 external_mini_cluster.cc:1428] Setting key 89d32e9818d306cba74c471cb17d1569
Aug 11 18:47:18 dist-test-slave-lgr5 krb5kdc[29979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474038, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:18.896546 30637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:18.875436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:36305 (local address 127.25.25.62:46497)
0811 18:47:18.876275 (+ 839us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:18.876282 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:18.877249 (+ 967us) server_negotiation.cc:407] Connection header received
0811 18:47:18.879380 (+ 2131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:18.879385 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:18.879465 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:18.879560 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:18.881783 (+ 2223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:18.882561 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:18.884846 (+ 2285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:18.885301 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:18.885402 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:18.889455 (+ 4053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:18.889462 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:18.889467 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:18.889513 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:18.892882 (+ 3369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:18.893775 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:18.893781 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:18.893785 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:18.893989 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:18.894489 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:18.894494 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:18.894497 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:18.894845 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:18.895012 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:18.895830 (+ 818us) server_negotiation.cc:299] Negotiation successful
0811 18:47:18.896140 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":694,"thread_start_us":542,"threads_started":1}
I20260811 18:47:18.897451 30638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:18.876149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:46497 (local address 127.25.25.2:36305)
0811 18:47:18.877035 (+ 886us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:18.877086 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:18.879035 (+ 1949us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:18.879864 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:18.879877 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:18.880691 (+ 814us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:18.881573 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:18.881601 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:18.882741 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:18.882746 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:18.884704 (+ 1958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:18.884720 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:18.885579 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:18.885588 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:18.885905 (+ 317us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:18.886664 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:18.886694 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:18.889140 (+ 2446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:18.893086 (+ 3946us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:18.893095 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:18.893115 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:18.893617 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:18.894102 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:18.894106 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:18.894108 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:18.894361 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:18.894952 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:18.894958 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:18.895396 (+ 438us) client_negotiation.cc:769] Sending connection context
0811 18:47:18.895669 (+ 273us) client_negotiation.cc:240] Negotiation successful
0811 18:47:18.896233 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":349,"threads_started":1}
I20260811 18:47:18.899132 30634 heartbeater.cc:347] Connected to a master server at 127.25.25.62:46497
I20260811 18:47:18.899533 30634 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.25.25.3@KRBTEST.COM; defaulting to no policy
I20260811 18:47:18.900420 30634 heartbeater.cc:511] Master 127.25.25.62:46497 requested a full tablet report, sending...
I20260811 18:47:18.902149 30059 ts_manager.cc:194] Registered new tserver with Master: 77e87f08af6348e5979a36796f8c0de8 (127.25.25.2:42907)
I20260811 18:47:18.903002 30059 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.2@KRBTEST.COM'} at 127.25.25.2:36305
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
I20260811 18:47:18.932869 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:0
--local_ip_for_outbound_sockets=127.25.25.3
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:46497
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:39751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:19.283325 30642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:19.283695 30642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:19.283850 30642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:19.291612 30642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:19.291770 30642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:19.291929 30642 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:47:19.302493 30642 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:39751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:46497
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:19.303939 30642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:19.305491 30642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:19.319754 30650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:19.319836 30656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:19.319926 30653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:19.320410 30642 server_base.cc:1034] running on GCE node
I20260811 18:47:19.321221 30642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:19.322292 30642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:19.323531 30642 hybrid_clock.cc:648] HybridClock initialized: now 1786474039323472 us; error 52 us; skew 500 ppm
I20260811 18:47:19.323863 30642 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:19 dist-test-slave-lgr5 krb5kdc[29979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474039, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:19.327484 30642 init.cc:377] Logged in from keytab as kudu/127.25.25.3@KRBTEST.COM (short username kudu)
I20260811 18:47:19.329401 30642 webserver.cc:460] Webserver started at http://127.25.25.3:36851/ using document root <none> and password file <none>
I20260811 18:47:19.330405 30642 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:19.330576 30642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:19.330958 30642 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:19.335495 30642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/data/instance:
uuid: "c5915ff7279a4029b113b275681a293c"
format_stamp: "Formatted at 2026-08-11 18:47:19 on dist-test-slave-lgr5"
server_key: "04c87e4e27f3f7667ce11dbb21963206"
server_key_iv: "9de14d77d724a3368ff3c3d183225824"
server_key_version: "encryptionkey@0"
I20260811 18:47:19.336634 30642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance:
uuid: "c5915ff7279a4029b113b275681a293c"
format_stamp: "Formatted at 2026-08-11 18:47:19 on dist-test-slave-lgr5"
server_key: "04c87e4e27f3f7667ce11dbb21963206"
server_key_iv: "9de14d77d724a3368ff3c3d183225824"
server_key_version: "encryptionkey@0"
I20260811 18:47:19.342464 30642 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260811 18:47:19.346436 30670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:19.348171 30642 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:47:19.348366 30642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "c5915ff7279a4029b113b275681a293c"
format_stamp: "Formatted at 2026-08-11 18:47:19 on dist-test-slave-lgr5"
server_key: "04c87e4e27f3f7667ce11dbb21963206"
server_key_iv: "9de14d77d724a3368ff3c3d183225824"
server_key_version: "encryptionkey@0"
I20260811 18:47:19.348595 30642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:19.365629 30396 heartbeater.cc:503] Master 127.25.25.62:46497 was elected leader, sending a full tablet report...
I20260811 18:47:19.367343 30642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:19.372006 30642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:19.372328 30642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:19.373412 30642 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:47:19.375113 30642 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:19.375212 30642 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:19.375342 30642 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:19.375397 30642 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:19.408746 30642 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:46051
I20260811 18:47:19.408782 30882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:46051 every 8 connection(s)
I20260811 18:47:19.410143 30642 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:47:19.416186 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 30642
I20260811 18:47:19.416405 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance
I20260811 18:47:19.416972 25700 external_mini_cluster.cc:1428] Setting key 2ee254640dd9dd4c56cb37910bbc182c
Aug 11 18:47:19 dist-test-slave-lgr5 krb5kdc[29979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474039, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:19.432765 30885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:19.412869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:38249 (local address 127.25.25.62:46497)
0811 18:47:19.413331 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:19.413335 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:19.414529 (+ 1194us) server_negotiation.cc:407] Connection header received
0811 18:47:19.416977 (+ 2448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:19.416982 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:19.417112 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:19.417212 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:19.419377 (+ 2165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:19.420302 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:19.421993 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:19.422417 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:19.422548 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:19.426381 (+ 3833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:19.426387 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:19.426390 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:19.426430 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:19.429126 (+ 2696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:19.430027 (+ 901us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:19.430032 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:19.430034 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:19.430171 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:19.430662 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:19.430667 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:19.430669 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:19.430978 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:19.431130 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:19.432046 (+ 916us) server_negotiation.cc:299] Negotiation successful
0811 18:47:19.432349 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":228,"threads_started":1}
I20260811 18:47:19.433892 30886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:19.413508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:46497 (local address 127.25.25.3:38249)
0811 18:47:19.414307 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:19.414350 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:19.416566 (+ 2216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:19.417589 (+ 1023us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:19.417599 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:19.418312 (+ 713us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:19.419185 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:19.419210 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:19.420491 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:19.420496 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:19.421830 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:19.421846 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:19.422695 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:19.422703 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:19.422945 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:19.423684 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:19.423716 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:19.426120 (+ 2404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:19.429320 (+ 3200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:19.429330 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:19.429346 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:19.429860 (+ 514us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:19.430294 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:19.430299 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:19.430303 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:19.430538 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:19.431128 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:19.431137 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:19.431546 (+ 409us) client_negotiation.cc:769] Sending connection context
0811 18:47:19.431851 (+ 305us) client_negotiation.cc:240] Negotiation successful
0811 18:47:19.432517 (+ 666us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":312,"threads_started":1}
I20260811 18:47:19.435781 30883 heartbeater.cc:347] Connected to a master server at 127.25.25.62:46497
I20260811 18:47:19.436239 30883 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:19.437151 30883 heartbeater.cc:511] Master 127.25.25.62:46497 requested a full tablet report, sending...
I20260811 18:47:19.438930 30059 ts_manager.cc:194] Registered new tserver with Master: c5915ff7279a4029b113b275681a293c (127.25.25.3:46051)
I20260811 18:47:19.439796 30059 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.3@KRBTEST.COM'} at 127.25.25.3:38249
I20260811 18:47:19.446283 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 18:47:19.484930 30885 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:47:19.482261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36228 (local address 127.25.25.62:46497)
0811 18:47:19.482497 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:19.482504 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:19.482887 (+ 383us) server_negotiation.cc:407] Connection header received
0811 18:47:19.483071 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:19.483075 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:19.483164 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:19.483252 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:19.484724 (+ 1472us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36228: BlockingRecv error: recv got EOF from 127.0.0.1:36228 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 18:47:19.488384 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 30179
W20260811 18:47:19.491369 25700 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 30179: Not authorized: Client connection negotiation failed: client connection to 127.25.25.1:45961: server requires authentication, but client does not have Kerberos credentials available
I20260811 18:47:19.491611 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 30179
I20260811 18:47:19.520761 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 30405
W20260811 18:47:19.523618 25700 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 30405: Not authorized: Client connection negotiation failed: client connection to 127.25.25.2:42907: server requires authentication, but client does not have Kerberos credentials available
I20260811 18:47:19.523814 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 30405
I20260811 18:47:19.551003 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 30642
W20260811 18:47:19.554705 25700 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 30642: Not authorized: Client connection negotiation failed: client connection to 127.25.25.3:46051: server requires authentication, but client does not have Kerberos credentials available
I20260811 18:47:19.554860 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 30642
I20260811 18:47:19.581061 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 30002
I20260811 18:47:19.582327 30123 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:19.690060 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 30002
2026-08-11T18:47:19Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3991 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:47:19 dist-test-slave-lgr5 krb5kdc[30916](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:47:19 dist-test-slave-lgr5 krb5kdc[30916](info): set up 2 sockets
Aug 11 18:47:19 dist-test-slave-lgr5 krb5kdc[30916](info): commencing operation
krb5kdc: starting...
W20260811 18:47:20.950438 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.210s user 0.003s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:47:21 dist-test-slave-lgr5 krb5kdc[30916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474041, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:47:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:47:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:47:21.181797 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:38307
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:41907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:38307
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:21.533360 30939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:21.533690 30939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:21.533833 30939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:21.541491 30939 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:47:21.541632 30939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:21.541692 30939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:21.541777 30939 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:47:21.541842 30939 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:47:21.552237 30939 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:41907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:38307
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:38307
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:21.553922 30939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:21.555503 30939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:21.568377 30946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:21.568315 30947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:21.568290 30949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:21.568768 30939 server_base.cc:1034] running on GCE node
I20260811 18:47:21.569893 30939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:21.571434 30939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:21.572656 30939 hybrid_clock.cc:648] HybridClock initialized: now 1786474041572601 us; error 49 us; skew 500 ppm
I20260811 18:47:21.573035 30939 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:21 dist-test-slave-lgr5 krb5kdc[30916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474041, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:21.582580 30939 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:47:21.584460 30939 webserver.cc:460] Webserver started at http://127.25.25.62:46681/ using document root <none> and password file <none>
I20260811 18:47:21.585276 30939 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:21.585425 30939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:21.585765 30939 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:21.589257 30939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "e77df3d50cf846d4b06cc81281b1e3b3"
format_stamp: "Formatted at 2026-08-11 18:47:21 on dist-test-slave-lgr5"
server_key: "07f171fdb805deb319bea8efa7efb1ae"
server_key_iv: "999ec35ec82eeb5e6a9516064b111a09"
server_key_version: "encryptionkey@0"
I20260811 18:47:21.590215 30939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "e77df3d50cf846d4b06cc81281b1e3b3"
format_stamp: "Formatted at 2026-08-11 18:47:21 on dist-test-slave-lgr5"
server_key: "07f171fdb805deb319bea8efa7efb1ae"
server_key_iv: "999ec35ec82eeb5e6a9516064b111a09"
server_key_version: "encryptionkey@0"
I20260811 18:47:21.596220 30939 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260811 18:47:21.600481 30958 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:21.602011 30939 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:47:21.602208 30939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "e77df3d50cf846d4b06cc81281b1e3b3"
format_stamp: "Formatted at 2026-08-11 18:47:21 on dist-test-slave-lgr5"
server_key: "07f171fdb805deb319bea8efa7efb1ae"
server_key_iv: "999ec35ec82eeb5e6a9516064b111a09"
server_key_version: "encryptionkey@0"
I20260811 18:47:21.602415 30939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:21.630713 30939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:21.635901 30939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:21.636281 30939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:21.655058 30939 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:38307
I20260811 18:47:21.655104 31051 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:38307 every 8 connection(s)
I20260811 18:47:21.656601 30939 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:47:21.661056 31052 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:21.666160 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 30939
I20260811 18:47:21.666442 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:47:21.667336 25700 external_mini_cluster.cc:1428] Setting key 2ddb5bd7922ff499339482c58dc59b84
I20260811 18:47:21.676157 31052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e77df3d50cf846d4b06cc81281b1e3b3: Bootstrap starting.
I20260811 18:47:21.679541 31052 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e77df3d50cf846d4b06cc81281b1e3b3: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:21.680718 31052 log.cc:824] T 00000000000000000000000000000000 P e77df3d50cf846d4b06cc81281b1e3b3: Log is configured to *not* fsync() on all Append() calls
Aug 11 18:47:21 dist-test-slave-lgr5 krb5kdc[30916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474041, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:21.683857 31052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e77df3d50cf846d4b06cc81281b1e3b3: No bootstrap required, opened a new log
I20260811 18:47:21.690687 31059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:21.669636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54234 (local address 127.25.25.62:38307)
0811 18:47:21.670567 (+ 931us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:21.670580 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:21.670625 (+ 45us) server_negotiation.cc:407] Connection header received
0811 18:47:21.672488 (+ 1863us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:21.672517 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:21.672966 (+ 449us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:21.673380 (+ 414us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:21.674931 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:21.676400 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:21.677752 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:21.678512 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:21.678688 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:21.682932 (+ 4244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:21.682941 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:21.682960 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:21.683007 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:21.686213 (+ 3206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:21.687004 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:21.687012 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:21.687019 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:21.687199 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:21.687602 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:21.687607 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:21.687609 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:21.688291 (+ 682us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:21.688610 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:21.689109 (+ 499us) server_negotiation.cc:299] Negotiation successful
0811 18:47:21.689555 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":684,"thread_start_us":417,"threads_started":1}
I20260811 18:47:21.691977 31052 raft_consensus.cc:348] T 00000000000000000000000000000000 P e77df3d50cf846d4b06cc81281b1e3b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e77df3d50cf846d4b06cc81281b1e3b3" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38307 } }
I20260811 18:47:21.692392 31052 raft_consensus.cc:374] T 00000000000000000000000000000000 P e77df3d50cf846d4b06cc81281b1e3b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:21.692497 31052 raft_consensus.cc:729] T 00000000000000000000000000000000 P e77df3d50cf846d4b06cc81281b1e3b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e77df3d50cf846d4b06cc81281b1e3b3, State: Initialized, Role: FOLLOWER
I20260811 18:47:21.693145 31052 consensus_queue.cc:260] T 00000000000000000000000000000000 P e77df3d50cf846d4b06cc81281b1e3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e77df3d50cf846d4b06cc81281b1e3b3" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38307 } }
I20260811 18:47:21.693396 31052 raft_consensus.cc:388] T 00000000000000000000000000000000 P e77df3d50cf846d4b06cc81281b1e3b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:47:21.693527 31052 raft_consensus.cc:482] T 00000000000000000000000000000000 P e77df3d50cf846d4b06cc81281b1e3b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:47:21.693681 31052 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e77df3d50cf846d4b06cc81281b1e3b3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:21.694787 25700 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:47:21.696061 31052 raft_consensus.cc:504] T 00000000000000000000000000000000 P e77df3d50cf846d4b06cc81281b1e3b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e77df3d50cf846d4b06cc81281b1e3b3" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38307 } }
I20260811 18:47:21.696605 31052 leader_election.cc:302] T 00000000000000000000000000000000 P e77df3d50cf846d4b06cc81281b1e3b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e77df3d50cf846d4b06cc81281b1e3b3; no voters:
I20260811 18:47:21.697237 31052 leader_election.cc:288] T 00000000000000000000000000000000 P e77df3d50cf846d4b06cc81281b1e3b3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:47:21.697345 31061 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e77df3d50cf846d4b06cc81281b1e3b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:21.699574 31052 sys_catalog.cc:564] T 00000000000000000000000000000000 P e77df3d50cf846d4b06cc81281b1e3b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:47:21.700345 31061 raft_consensus.cc:686] T 00000000000000000000000000000000 P e77df3d50cf846d4b06cc81281b1e3b3 [term 1 LEADER]: Becoming Leader. State: Replica: e77df3d50cf846d4b06cc81281b1e3b3, State: Running, Role: LEADER
I20260811 18:47:21.700963 31061 consensus_queue.cc:237] T 00000000000000000000000000000000 P e77df3d50cf846d4b06cc81281b1e3b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e77df3d50cf846d4b06cc81281b1e3b3" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38307 } }
I20260811 18:47:21.703976 31066 sys_catalog.cc:455] T 00000000000000000000000000000000 P e77df3d50cf846d4b06cc81281b1e3b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e77df3d50cf846d4b06cc81281b1e3b3. Latest consensus state: current_term: 1 leader_uuid: "e77df3d50cf846d4b06cc81281b1e3b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e77df3d50cf846d4b06cc81281b1e3b3" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38307 } } }
I20260811 18:47:21.704432 31066 sys_catalog.cc:458] T 00000000000000000000000000000000 P e77df3d50cf846d4b06cc81281b1e3b3 [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:21.704401 31065 sys_catalog.cc:455] T 00000000000000000000000000000000 P e77df3d50cf846d4b06cc81281b1e3b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e77df3d50cf846d4b06cc81281b1e3b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e77df3d50cf846d4b06cc81281b1e3b3" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38307 } } }
I20260811 18:47:21.704793 31065 sys_catalog.cc:458] T 00000000000000000000000000000000 P e77df3d50cf846d4b06cc81281b1e3b3 [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:21.715657 31074 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:47:21.722394 31074 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:47:21.735517 31074 catalog_manager.cc:1347] Generated new cluster ID: 9080f71198d447efa1330266e1d0677d
I20260811 18:47:21.735669 31074 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:47:21.755990 31059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:21.746047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54246 (local address 127.25.25.62:38307)
0811 18:47:21.746270 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:21.746278 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:21.747131 (+ 853us) server_negotiation.cc:407] Connection header received
0811 18:47:21.747326 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:21.747332 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:21.747425 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:21.747537 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:21.748935 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:21.750064 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:21.752030 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:21.752738 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:21.752886 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:21.754220 (+ 1334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:21.754227 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:21.754232 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:47:21.755137 (+ 905us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:21.755206 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:47:21.755236 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:21.755349 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:21.755522 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 18:47:21.755632 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 18:47:21.771315 31074 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:47:21.773479 31074 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:47:21.781363 31074 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e77df3d50cf846d4b06cc81281b1e3b3: Generated new TSK 0
I20260811 18:47:21.782624 31074 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:47:21.793224 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 30939
I20260811 18:47:21.794411 31042 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:21.889168 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 30939
2026-08-11T18:47:21Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2191 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:47:21 dist-test-slave-lgr5 krb5kdc[31112](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:47:21 dist-test-slave-lgr5 krb5kdc[31112](info): set up 2 sockets
Aug 11 18:47:21 dist-test-slave-lgr5 krb5kdc[31112](info): commencing operation
krb5kdc: starting...
W20260811 18:47:23.137454 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.206s user 0.000s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:47:23 dist-test-slave-lgr5 krb5kdc[31112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:47:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:47:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:47:23.375699 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:37201
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:35515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:37201
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:23.732483 31138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:23.732796 31138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:23.732896 31138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:23.740396 31138 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:47:23.740526 31138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:23.740581 31138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:23.740638 31138 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:47:23.740679 31138 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:47:23.750932 31138 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:35515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:37201
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:37201
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:23.752385 31138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:23.753772 31138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:23.766182 31146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:23.766183 31147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:23.766160 31150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:23.767086 31138 server_base.cc:1034] running on GCE node
I20260811 18:47:23.767941 31138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:23.769572 31138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:23.770808 31138 hybrid_clock.cc:648] HybridClock initialized: now 1786474043770750 us; error 46 us; skew 500 ppm
I20260811 18:47:23.771183 31138 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:23 dist-test-slave-lgr5 krb5kdc[31112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474043, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:23.774490 31138 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:47:23.776306 31138 webserver.cc:460] Webserver started at http://127.25.25.62:40463/ using document root <none> and password file <none>
I20260811 18:47:23.777046 31138 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:23.777158 31138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:23.777448 31138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:23.780763 31138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "eaf40b6a4dc3442eb5ec61b6cfe84b05"
format_stamp: "Formatted at 2026-08-11 18:47:23 on dist-test-slave-lgr5"
server_key: "056ebd91f30a3623017438e2068c3976"
server_key_iv: "a779ecf2b74444a9932b91febefa845b"
server_key_version: "encryptionkey@0"
I20260811 18:47:23.781566 31138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "eaf40b6a4dc3442eb5ec61b6cfe84b05"
format_stamp: "Formatted at 2026-08-11 18:47:23 on dist-test-slave-lgr5"
server_key: "056ebd91f30a3623017438e2068c3976"
server_key_iv: "a779ecf2b74444a9932b91febefa845b"
server_key_version: "encryptionkey@0"
I20260811 18:47:23.787358 31138 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 18:47:23.791253 31160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:23.792785 31138 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:47:23.792958 31138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "eaf40b6a4dc3442eb5ec61b6cfe84b05"
format_stamp: "Formatted at 2026-08-11 18:47:23 on dist-test-slave-lgr5"
server_key: "056ebd91f30a3623017438e2068c3976"
server_key_iv: "a779ecf2b74444a9932b91febefa845b"
server_key_version: "encryptionkey@0"
I20260811 18:47:23.793159 31138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:23.813980 31138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:23.818557 31138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:23.818856 31138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:23.837760 31138 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:37201
I20260811 18:47:23.837805 31247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:37201 every 8 connection(s)
I20260811 18:47:23.839367 31138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:47:23.840461 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 31138
I20260811 18:47:23.840726 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:47:23.841406 25700 external_mini_cluster.cc:1428] Setting key 2f4497bbd9201c092b5e12c82ca6135c
I20260811 18:47:23.844594 31250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 18:47:23 dist-test-slave-lgr5 krb5kdc[31112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:23.859699 31250 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eaf40b6a4dc3442eb5ec61b6cfe84b05: Bootstrap starting.
I20260811 18:47:23.864585 31250 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eaf40b6a4dc3442eb5ec61b6cfe84b05: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:23.866119 31250 log.cc:824] T 00000000000000000000000000000000 P eaf40b6a4dc3442eb5ec61b6cfe84b05: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:23.869091 31257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:23.843840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38332 (local address 127.25.25.62:37201)
0811 18:47:23.844947 (+ 1107us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:23.844960 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:23.845010 (+ 50us) server_negotiation.cc:407] Connection header received
0811 18:47:23.846761 (+ 1751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:23.846789 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:23.847251 (+ 462us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:23.847669 (+ 418us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:23.849590 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:23.851046 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:23.852979 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:23.853757 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:23.853918 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:23.859136 (+ 5218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:23.859153 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:23.859177 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:23.859247 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:23.863620 (+ 4373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:23.864645 (+ 1025us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:23.864657 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:23.864667 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:23.864943 (+ 276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:23.865378 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:23.865384 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:23.865388 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:23.866257 (+ 869us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:23.866627 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:23.867074 (+ 447us) server_negotiation.cc:299] Negotiation successful
0811 18:47:23.867576 (+ 502us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":866,"thread_start_us":419,"threads_started":1}
I20260811 18:47:23.870237 31250 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eaf40b6a4dc3442eb5ec61b6cfe84b05: No bootstrap required, opened a new log
I20260811 18:47:23.878948 31250 raft_consensus.cc:348] T 00000000000000000000000000000000 P eaf40b6a4dc3442eb5ec61b6cfe84b05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaf40b6a4dc3442eb5ec61b6cfe84b05" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 37201 } }
I20260811 18:47:23.879438 31250 raft_consensus.cc:374] T 00000000000000000000000000000000 P eaf40b6a4dc3442eb5ec61b6cfe84b05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:23.879534 31250 raft_consensus.cc:729] T 00000000000000000000000000000000 P eaf40b6a4dc3442eb5ec61b6cfe84b05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaf40b6a4dc3442eb5ec61b6cfe84b05, State: Initialized, Role: FOLLOWER
I20260811 18:47:23.880172 31250 consensus_queue.cc:260] T 00000000000000000000000000000000 P eaf40b6a4dc3442eb5ec61b6cfe84b05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaf40b6a4dc3442eb5ec61b6cfe84b05" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 37201 } }
I20260811 18:47:23.880445 31250 raft_consensus.cc:388] T 00000000000000000000000000000000 P eaf40b6a4dc3442eb5ec61b6cfe84b05 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:47:23.880568 31250 raft_consensus.cc:482] T 00000000000000000000000000000000 P eaf40b6a4dc3442eb5ec61b6cfe84b05 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:47:23.880717 31250 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eaf40b6a4dc3442eb5ec61b6cfe84b05 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:23.883358 31250 raft_consensus.cc:504] T 00000000000000000000000000000000 P eaf40b6a4dc3442eb5ec61b6cfe84b05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaf40b6a4dc3442eb5ec61b6cfe84b05" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 37201 } }
I20260811 18:47:23.884030 31250 leader_election.cc:302] T 00000000000000000000000000000000 P eaf40b6a4dc3442eb5ec61b6cfe84b05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eaf40b6a4dc3442eb5ec61b6cfe84b05; no voters:
I20260811 18:47:23.884732 31250 leader_election.cc:288] T 00000000000000000000000000000000 P eaf40b6a4dc3442eb5ec61b6cfe84b05 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:47:23.884871 31260 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eaf40b6a4dc3442eb5ec61b6cfe84b05 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:23.885643 31260 raft_consensus.cc:686] T 00000000000000000000000000000000 P eaf40b6a4dc3442eb5ec61b6cfe84b05 [term 1 LEADER]: Becoming Leader. State: Replica: eaf40b6a4dc3442eb5ec61b6cfe84b05, State: Running, Role: LEADER
I20260811 18:47:23.886363 31260 consensus_queue.cc:237] T 00000000000000000000000000000000 P eaf40b6a4dc3442eb5ec61b6cfe84b05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaf40b6a4dc3442eb5ec61b6cfe84b05" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 37201 } }
I20260811 18:47:23.887454 31250 sys_catalog.cc:564] T 00000000000000000000000000000000 P eaf40b6a4dc3442eb5ec61b6cfe84b05 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:47:23.890038 31262 sys_catalog.cc:455] T 00000000000000000000000000000000 P eaf40b6a4dc3442eb5ec61b6cfe84b05 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eaf40b6a4dc3442eb5ec61b6cfe84b05. Latest consensus state: current_term: 1 leader_uuid: "eaf40b6a4dc3442eb5ec61b6cfe84b05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaf40b6a4dc3442eb5ec61b6cfe84b05" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 37201 } } }
I20260811 18:47:23.890131 31261 sys_catalog.cc:455] T 00000000000000000000000000000000 P eaf40b6a4dc3442eb5ec61b6cfe84b05 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eaf40b6a4dc3442eb5ec61b6cfe84b05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaf40b6a4dc3442eb5ec61b6cfe84b05" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 37201 } } }
I20260811 18:47:23.890594 31262 sys_catalog.cc:458] T 00000000000000000000000000000000 P eaf40b6a4dc3442eb5ec61b6cfe84b05 [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:23.890595 31261 sys_catalog.cc:458] T 00000000000000000000000000000000 P eaf40b6a4dc3442eb5ec61b6cfe84b05 [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:23.893194 31270 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:47:23.898929 31270 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:47:23.910735 31270 catalog_manager.cc:1347] Generated new cluster ID: 4e956fac906f4f97baf167d85b2dca82
I20260811 18:47:23.910863 31270 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:47:23.927413 31270 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:47:23.928900 31270 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:47:23.943951 31270 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eaf40b6a4dc3442eb5ec61b6cfe84b05: Generated new TSK 0
I20260811 18:47:23.945129 31270 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.25.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
I20260811 18:47:24.017899 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:0
--local_ip_for_outbound_sockets=127.25.25.1
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:37201
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:35515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:24.393494 31303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:24.393800 31303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:24.393939 31303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:24.401790 31303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:24.401932 31303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:24.402097 31303 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:47:24.412576 31303 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:35515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:37201
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:24.414026 31303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:24.415462 31303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:24.429375 31313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:24.429994 31314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:24.430029 31318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:24.430305 31303 server_base.cc:1034] running on GCE node
I20260811 18:47:24.431128 31303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:24.432348 31303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:24.433598 31303 hybrid_clock.cc:648] HybridClock initialized: now 1786474044433527 us; error 58 us; skew 500 ppm
I20260811 18:47:24.433960 31303 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:24 dist-test-slave-lgr5 krb5kdc[31112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474044, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:24.437525 31303 init.cc:377] Logged in from keytab as kudu/127.25.25.1@KRBTEST.COM (short username kudu)
I20260811 18:47:24.439184 31303 webserver.cc:460] Webserver started at http://127.25.25.1:34041/ using document root <none> and password file <none>
I20260811 18:47:24.439958 31303 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:24.440135 31303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:24.440495 31303 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:24.444013 31303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/data/instance:
uuid: "184fc9f6cd2c438ea61281bc83791d3a"
format_stamp: "Formatted at 2026-08-11 18:47:24 on dist-test-slave-lgr5"
server_key: "00230930137d91b3de92f28428a05a75"
server_key_iv: "c3213836962d93c7e0eed3eb934f21b3"
server_key_version: "encryptionkey@0"
I20260811 18:47:24.445034 31303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance:
uuid: "184fc9f6cd2c438ea61281bc83791d3a"
format_stamp: "Formatted at 2026-08-11 18:47:24 on dist-test-slave-lgr5"
server_key: "00230930137d91b3de92f28428a05a75"
server_key_iv: "c3213836962d93c7e0eed3eb934f21b3"
server_key_version: "encryptionkey@0"
I20260811 18:47:24.451186 31303 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260811 18:47:24.455428 31335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:24.457134 31303 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:47:24.457341 31303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "184fc9f6cd2c438ea61281bc83791d3a"
format_stamp: "Formatted at 2026-08-11 18:47:24 on dist-test-slave-lgr5"
server_key: "00230930137d91b3de92f28428a05a75"
server_key_iv: "c3213836962d93c7e0eed3eb934f21b3"
server_key_version: "encryptionkey@0"
I20260811 18:47:24.457576 31303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:24.482686 31303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:24.487874 31303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:24.488246 31303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:24.489334 31303 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:47:24.490824 31303 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:24.490911 31303 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:24.491050 31303 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:24.491106 31303 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:24.525956 31303 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:38027
I20260811 18:47:24.526021 31550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:38027 every 8 connection(s)
I20260811 18:47:24.527330 31303 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:47:24.534571 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 31303
I20260811 18:47:24.534761 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance
I20260811 18:47:24.535400 25700 external_mini_cluster.cc:1428] Setting key 2a09231a3957bb99f4b8d8ae028a705f
Aug 11 18:47:24 dist-test-slave-lgr5 krb5kdc[31112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474044, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:24.548739 31555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:24.530053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:37851 (local address 127.25.25.62:37201)
0811 18:47:24.530593 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:24.530597 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:24.531571 (+ 974us) server_negotiation.cc:407] Connection header received
0811 18:47:24.533512 (+ 1941us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:24.533517 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:24.533604 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:24.533702 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:24.535324 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:24.536190 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:24.538156 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:24.538571 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:24.538683 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:24.542651 (+ 3968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:24.542656 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:24.542660 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:24.542695 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:24.545310 (+ 2615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:24.546281 (+ 971us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:24.546285 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:24.546287 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:24.546415 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:24.546906 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:24.546911 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:24.546914 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:24.547202 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:24.547342 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:24.548122 (+ 780us) server_negotiation.cc:299] Negotiation successful
0811 18:47:24.548369 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":253,"threads_started":1}
I20260811 18:47:24.549782 31556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:24.530619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:37201 (local address 127.25.25.1:37851)
0811 18:47:24.531406 (+ 787us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:24.531452 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:24.533223 (+ 1771us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:24.533967 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:24.533976 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:24.534506 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:24.535153 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:24.535172 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:24.536361 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:24.536366 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:24.538008 (+ 1642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:24.538021 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:24.538800 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:24.538808 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:24.539052 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:24.539719 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:24.539743 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:24.542380 (+ 2637us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:24.545476 (+ 3096us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:24.545486 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:24.545513 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:24.546161 (+ 648us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:24.546573 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:24.546578 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:24.546580 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:24.546789 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:24.547344 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:24.547353 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:24.547705 (+ 352us) client_negotiation.cc:769] Sending connection context
0811 18:47:24.547973 (+ 268us) client_negotiation.cc:240] Negotiation successful
0811 18:47:24.548580 (+ 607us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":318,"threads_started":1}
I20260811 18:47:24.551399 31551 heartbeater.cc:347] Connected to a master server at 127.25.25.62:37201
I20260811 18:47:24.551721 31551 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:24.552536 31551 heartbeater.cc:511] Master 127.25.25.62:37201 requested a full tablet report, sending...
I20260811 18:47:24.554876 31191 ts_manager.cc:194] Registered new tserver with Master: 184fc9f6cd2c438ea61281bc83791d3a (127.25.25.1:38027)
WARNING: no policy specified for kudu/127.25.25.2@KRBTEST.COM; defaulting to no policy
I20260811 18:47:24.556576 31191 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.1@KRBTEST.COM'} at 127.25.25.1:37851
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
I20260811 18:47:24.587158 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:0
--local_ip_for_outbound_sockets=127.25.25.2
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:37201
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:35515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:24.941612 31561 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:24.941942 31561 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:24.942082 31561 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:24.949975 31561 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:24.950110 31561 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:24.950268 31561 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:47:24.960755 31561 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:35515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:37201
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:24.962251 31561 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:24.963732 31561 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:24.978199 31572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:24.978266 31581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:24.978238 31573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:24.979282 31561 server_base.cc:1034] running on GCE node
I20260811 18:47:24.980036 31561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:24.981141 31561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:24.982388 31561 hybrid_clock.cc:648] HybridClock initialized: now 1786474044982303 us; error 68 us; skew 500 ppm
I20260811 18:47:24.982766 31561 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:24 dist-test-slave-lgr5 krb5kdc[31112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474044, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:24.986469 31561 init.cc:377] Logged in from keytab as kudu/127.25.25.2@KRBTEST.COM (short username kudu)
I20260811 18:47:24.988204 31561 webserver.cc:460] Webserver started at http://127.25.25.2:43745/ using document root <none> and password file <none>
I20260811 18:47:24.989068 31561 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:24.989200 31561 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:24.989524 31561 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:24.992730 31561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/data/instance:
uuid: "5ddb6ba160ea4628b4eb2b99f4aefb99"
format_stamp: "Formatted at 2026-08-11 18:47:24 on dist-test-slave-lgr5"
server_key: "36a2666f1e9652dcf45d12aceb4d3c69"
server_key_iv: "5fd7983bb23ac51079aadfe4b8ccb46a"
server_key_version: "encryptionkey@0"
I20260811 18:47:24.993603 31561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance:
uuid: "5ddb6ba160ea4628b4eb2b99f4aefb99"
format_stamp: "Formatted at 2026-08-11 18:47:24 on dist-test-slave-lgr5"
server_key: "36a2666f1e9652dcf45d12aceb4d3c69"
server_key_iv: "5fd7983bb23ac51079aadfe4b8ccb46a"
server_key_version: "encryptionkey@0"
I20260811 18:47:24.999717 31561 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.003s
I20260811 18:47:25.003844 31593 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:25.005563 31561 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:47:25.005785 31561 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "5ddb6ba160ea4628b4eb2b99f4aefb99"
format_stamp: "Formatted at 2026-08-11 18:47:24 on dist-test-slave-lgr5"
server_key: "36a2666f1e9652dcf45d12aceb4d3c69"
server_key_iv: "5fd7983bb23ac51079aadfe4b8ccb46a"
server_key_version: "encryptionkey@0"
I20260811 18:47:25.006032 31561 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:25.032823 31561 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:25.037281 31561 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:25.037623 31561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:25.038720 31561 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:47:25.040220 31561 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:25.040304 31561 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:25.040444 31561 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:25.040501 31561 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:25.072758 31561 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:34673
I20260811 18:47:25.072803 31789 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:34673 every 8 connection(s)
I20260811 18:47:25.074236 31561 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:47:25.081642 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 31561
I20260811 18:47:25.081827 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance
I20260811 18:47:25.082252 25700 external_mini_cluster.cc:1428] Setting key 1c884c4534bc78f6de773886c1671643
Aug 11 18:47:25 dist-test-slave-lgr5 krb5kdc[31112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474044, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:25.096992 31795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:25.077120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:54063 (local address 127.25.25.62:37201)
0811 18:47:25.077608 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:25.077613 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:25.078645 (+ 1032us) server_negotiation.cc:407] Connection header received
0811 18:47:25.080723 (+ 2078us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:25.080729 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:25.080822 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:25.080931 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:25.082793 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:25.083657 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:25.085385 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:25.086027 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:25.086164 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:25.090359 (+ 4195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:25.090365 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:25.090369 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:25.090410 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:25.093189 (+ 2779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:25.094224 (+ 1035us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:25.094231 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:25.094235 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:25.094421 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:25.094866 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:25.094870 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:25.094874 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:25.095280 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:25.095437 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:25.096329 (+ 892us) server_negotiation.cc:299] Negotiation successful
0811 18:47:25.096614 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":248,"threads_started":1}
I20260811 18:47:25.098121 31796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:25.077631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:37201 (local address 127.25.25.2:54063)
0811 18:47:25.078446 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:25.078491 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:25.080393 (+ 1902us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:25.081220 (+ 827us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:25.081230 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:25.081856 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:25.082590 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:25.082614 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:25.083823 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:25.083827 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:25.085226 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:25.085242 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:25.086239 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:25.086244 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:25.086459 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:25.087148 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:25.087173 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:25.090023 (+ 2850us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:25.093397 (+ 3374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:25.093410 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:25.093443 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:25.094064 (+ 621us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:25.094535 (+ 471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:25.094538 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:25.094540 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:25.094752 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:25.095422 (+ 670us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:25.095435 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:25.095819 (+ 384us) client_negotiation.cc:769] Sending connection context
0811 18:47:25.096134 (+ 315us) client_negotiation.cc:240] Negotiation successful
0811 18:47:25.096693 (+ 559us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":315,"threads_started":1}
I20260811 18:47:25.099949 31791 heartbeater.cc:347] Connected to a master server at 127.25.25.62:37201
I20260811 18:47:25.100387 31791 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:25.101461 31791 heartbeater.cc:511] Master 127.25.25.62:37201 requested a full tablet report, sending...
I20260811 18:47:25.103586 31191 ts_manager.cc:194] Registered new tserver with Master: 5ddb6ba160ea4628b4eb2b99f4aefb99 (127.25.25.2:34673)
I20260811 18:47:25.104625 31191 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.2@KRBTEST.COM'} at 127.25.25.2:54063
WARNING: no policy specified for kudu/127.25.25.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
I20260811 18:47:25.139557 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:0
--local_ip_for_outbound_sockets=127.25.25.3
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:37201
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:35515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:25.500465 31802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:25.500801 31802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:25.500921 31802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:25.508810 31802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:25.508953 31802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:25.509089 31802 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:47:25.519534 31802 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:35515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:37201
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:25.520994 31802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:25.522678 31802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:25.537533 31816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:25.537612 31812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:25.537577 31814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:25.538476 31802 server_base.cc:1034] running on GCE node
I20260811 18:47:25.539219 31802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:25.540359 31802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:25.541615 31802 hybrid_clock.cc:648] HybridClock initialized: now 1786474045541541 us; error 62 us; skew 500 ppm
I20260811 18:47:25.541991 31802 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:25 dist-test-slave-lgr5 krb5kdc[31112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474045, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:25.545481 31802 init.cc:377] Logged in from keytab as kudu/127.25.25.3@KRBTEST.COM (short username kudu)
I20260811 18:47:25.547129 31802 webserver.cc:460] Webserver started at http://127.25.25.3:37371/ using document root <none> and password file <none>
I20260811 18:47:25.547849 31802 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:25.547963 31802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:25.548370 31802 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:25.551638 31802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/data/instance:
uuid: "16c1c5c449a4400a935e8d29ee157e51"
format_stamp: "Formatted at 2026-08-11 18:47:25 on dist-test-slave-lgr5"
server_key: "02d324486cc81315db18a37a246bf8e2"
server_key_iv: "d9751f57b0bf8851982dd8fbf9e4e574"
server_key_version: "encryptionkey@0"
I20260811 18:47:25.552518 31802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance:
uuid: "16c1c5c449a4400a935e8d29ee157e51"
format_stamp: "Formatted at 2026-08-11 18:47:25 on dist-test-slave-lgr5"
server_key: "02d324486cc81315db18a37a246bf8e2"
server_key_iv: "d9751f57b0bf8851982dd8fbf9e4e574"
server_key_version: "encryptionkey@0"
I20260811 18:47:25.558269 31802 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 18:47:25.560127 31551 heartbeater.cc:503] Master 127.25.25.62:37201 was elected leader, sending a full tablet report...
I20260811 18:47:25.562595 31828 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:25.564142 31802 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 18:47:25.564359 31802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "16c1c5c449a4400a935e8d29ee157e51"
format_stamp: "Formatted at 2026-08-11 18:47:25 on dist-test-slave-lgr5"
server_key: "02d324486cc81315db18a37a246bf8e2"
server_key_iv: "d9751f57b0bf8851982dd8fbf9e4e574"
server_key_version: "encryptionkey@0"
I20260811 18:47:25.564572 31802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:25.578841 31802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:25.583490 31802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:25.583788 31802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:25.584890 31802 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:47:25.586290 31802 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:25.586382 31802 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:25.586504 31802 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:25.586571 31802 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:25.618947 31802 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:39199
I20260811 18:47:25.618988 32014 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:39199 every 8 connection(s)
I20260811 18:47:25.620401 31802 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:47:25.624185 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 31802
I20260811 18:47:25.624426 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance
I20260811 18:47:25.625097 25700 external_mini_cluster.cc:1428] Setting key 28f90e6246e2393ff13289500e41d2c8
Aug 11 18:47:25 dist-test-slave-lgr5 krb5kdc[31112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474045, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:25.642591 32018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:25.623261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:56227 (local address 127.25.25.62:37201)
0811 18:47:25.623728 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:25.623732 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:25.625046 (+ 1314us) server_negotiation.cc:407] Connection header received
0811 18:47:25.627587 (+ 2541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:25.627594 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:25.627686 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:25.627781 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:25.629614 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:25.630382 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:25.632045 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:25.632515 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:25.632639 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:25.636627 (+ 3988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:25.636633 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:25.636637 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:25.636678 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:25.639131 (+ 2453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:25.639983 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:25.639987 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:25.639990 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:25.640162 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:25.640635 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:25.640639 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:25.640642 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:25.640983 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:25.641138 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:25.641920 (+ 782us) server_negotiation.cc:299] Negotiation successful
0811 18:47:25.642174 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":223,"threads_started":1}
I20260811 18:47:25.643638 32021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:25.623786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:37201 (local address 127.25.25.3:56227)
0811 18:47:25.624840 (+ 1054us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:25.624894 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:25.627246 (+ 2352us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:25.628072 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:25.628107 (+ 35us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:25.628753 (+ 646us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:25.629418 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:25.629442 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:25.630565 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:25.630569 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:25.631877 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:25.631891 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:25.632780 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:25.632789 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:25.633050 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:25.633773 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:25.633800 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:25.636330 (+ 2530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:25.639315 (+ 2985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:25.639326 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:25.639349 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:25.639837 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:25.640276 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:25.640281 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:25.640285 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:25.640508 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:25.641124 (+ 616us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:25.641133 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:25.641523 (+ 390us) client_negotiation.cc:769] Sending connection context
0811 18:47:25.641783 (+ 260us) client_negotiation.cc:240] Negotiation successful
0811 18:47:25.642403 (+ 620us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":777,"thread_start_us":501,"threads_started":1}
I20260811 18:47:25.645134 32015 heartbeater.cc:347] Connected to a master server at 127.25.25.62:37201
I20260811 18:47:25.645535 32015 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:25.646363 32015 heartbeater.cc:511] Master 127.25.25.62:37201 requested a full tablet report, sending...
I20260811 18:47:25.647889 31191 ts_manager.cc:194] Registered new tserver with Master: 16c1c5c449a4400a935e8d29ee157e51 (127.25.25.3:39199)
I20260811 18:47:25.648782 31191 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.3@KRBTEST.COM'} at 127.25.25.3:56227
I20260811 18:47:25.653453 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 18:47:25 dist-test-slave-lgr5 krb5kdc[31112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474045, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 18:47:25 dist-test-slave-lgr5 krb5kdc[31112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474045, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:25.712916 32018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:25.698203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38338 (local address 127.25.25.62:37201)
0811 18:47:25.698441 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:25.698448 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:25.698896 (+ 448us) server_negotiation.cc:407] Connection header received
0811 18:47:25.699057 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:25.699062 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:25.699139 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:25.699230 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:25.700659 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:25.701424 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:25.702795 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:25.703234 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:25.703354 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:25.707515 (+ 4161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:25.707521 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:25.707524 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:25.707566 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:25.710246 (+ 2680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:25.711000 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:25.711005 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:25.711008 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:25.711157 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:25.711603 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:25.711607 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:25.711610 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:25.711968 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:25.712236 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:25.712450 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 18:47:25.712642 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
W20260811 18:47:25.713554 31191 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:38338
I20260811 18:47:25.715700 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 31303
Aug 11 18:47:25 dist-test-slave-lgr5 krb5kdc[31112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474045, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.25.25.1@KRBTEST.COM
I20260811 18:47:25.732770 32038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:25.716911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57640 (local address 127.25.25.1:38027)
0811 18:47:25.717546 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:25.717553 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:25.717584 (+ 31us) server_negotiation.cc:407] Connection header received
0811 18:47:25.717655 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:25.717663 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:25.717893 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:25.718050 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:25.719185 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:25.720418 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:25.721647 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:25.722274 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:25.722388 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:25.726565 (+ 4177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:25.726580 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:25.726597 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:25.726644 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:25.729728 (+ 3084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:25.730532 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:25.730541 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:25.730544 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:25.730692 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:25.731074 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:25.731078 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:25.731080 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:25.731513 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:25.731811 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:25.732150 (+ 339us) server_negotiation.cc:299] Negotiation successful
0811 18:47:25.732427 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":298,"threads_started":1}
W20260811 18:47:25.734189 31542 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:57640
W20260811 18:47:25.735349 25700 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 31303: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:47:25.735591 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 31303
I20260811 18:47:25.762553 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 31561
Aug 11 18:47:25 dist-test-slave-lgr5 krb5kdc[31112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474045, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.25.25.2@KRBTEST.COM
I20260811 18:47:25.780884 32040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:25.763629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53738 (local address 127.25.25.2:34673)
0811 18:47:25.764273 (+ 644us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:25.764282 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:25.764309 (+ 27us) server_negotiation.cc:407] Connection header received
0811 18:47:25.764373 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:25.764379 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:25.764598 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:25.764726 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:25.765957 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:25.767028 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:25.768429 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:25.769085 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:25.769204 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:25.773935 (+ 4731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:25.773954 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:25.773972 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:25.774031 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:25.777372 (+ 3341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:25.778407 (+ 1035us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:25.778417 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:25.778419 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:25.778591 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:25.779058 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:25.779064 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:25.779066 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:25.779529 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:25.779830 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:25.780283 (+ 453us) server_negotiation.cc:299] Negotiation successful
0811 18:47:25.780563 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":495,"thread_start_us":318,"threads_started":1}
W20260811 18:47:25.782313 31781 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:53738
W20260811 18:47:25.783535 25700 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 31561: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:47:25.783715 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 31561
I20260811 18:47:25.816334 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 31802
Aug 11 18:47:25 dist-test-slave-lgr5 krb5kdc[31112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474045, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.25.25.3@KRBTEST.COM
I20260811 18:47:25.835016 32044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:25.817534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54428 (local address 127.25.25.3:39199)
0811 18:47:25.818383 (+ 849us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:25.818391 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:25.818421 (+ 30us) server_negotiation.cc:407] Connection header received
0811 18:47:25.818486 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:25.818492 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:25.818736 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:25.818867 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:25.820432 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:25.821556 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:25.822894 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:25.823494 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:25.823624 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:25.828598 (+ 4974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:25.828617 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:25.828636 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:25.828684 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:25.831772 (+ 3088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:25.832654 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:25.832663 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:25.832665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:25.832818 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:25.833242 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:25.833247 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:25.833249 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:25.833652 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:25.833994 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:25.834331 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 18:47:25.834637 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":696,"thread_start_us":536,"threads_started":1}
W20260811 18:47:25.836577 32007 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:54428
W20260811 18:47:25.837886 25700 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 31802: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:47:25.838079 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 31802
I20260811 18:47:25.865149 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 31138
I20260811 18:47:25.866608 31241 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:25.981407 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 31138
2026-08-11T18:47:26Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (4111 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:47:26 dist-test-slave-lgr5 krb5kdc[32049](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:47:26 dist-test-slave-lgr5 krb5kdc[32049](info): set up 2 sockets
Aug 11 18:47:26 dist-test-slave-lgr5 krb5kdc[32049](info): commencing operation
krb5kdc: starting...
W20260811 18:47:27.264663 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.222s user 0.000s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:47:27 dist-test-slave-lgr5 krb5kdc[32049](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:47:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:47:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:47:27.504012 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:41145
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:41181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:41145
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:27.854141 32070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:27.854525 32070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:27.854673 32070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:27.862282 32070 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:47:27.862437 32070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:27.862552 32070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:27.862639 32070 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:47:27.862706 32070 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:47:27.873044 32070 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:41181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:41145
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:41145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:27.874532 32070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:27.876039 32070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:27.888849 32077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:27.888907 32076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:27.888875 32081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:27.889878 32070 server_base.cc:1034] running on GCE node
I20260811 18:47:27.890761 32070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:27.892446 32070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:27.893694 32070 hybrid_clock.cc:648] HybridClock initialized: now 1786474047893635 us; error 44 us; skew 500 ppm
I20260811 18:47:27.894104 32070 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:27 dist-test-slave-lgr5 krb5kdc[32049](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474047, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:27.904843 32070 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:47:27.906744 32070 webserver.cc:460] Webserver started at http://127.25.25.62:40661/ using document root <none> and password file <none>
I20260811 18:47:27.907543 32070 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:27.907675 32070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:27.908048 32070 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:27.911505 32070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "2bdff85a4f2848d2b4efb1fcd58c06ce"
format_stamp: "Formatted at 2026-08-11 18:47:27 on dist-test-slave-lgr5"
server_key: "4081f08c7c0fcf4f3df240eb511cdeae"
server_key_iv: "3433b5b67296fbb2b6e53bab30643136"
server_key_version: "encryptionkey@0"
I20260811 18:47:27.912477 32070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "2bdff85a4f2848d2b4efb1fcd58c06ce"
format_stamp: "Formatted at 2026-08-11 18:47:27 on dist-test-slave-lgr5"
server_key: "4081f08c7c0fcf4f3df240eb511cdeae"
server_key_iv: "3433b5b67296fbb2b6e53bab30643136"
server_key_version: "encryptionkey@0"
I20260811 18:47:27.918594 32070 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.005s
I20260811 18:47:27.922914 32092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:27.924670 32070 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260811 18:47:27.924881 32070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "2bdff85a4f2848d2b4efb1fcd58c06ce"
format_stamp: "Formatted at 2026-08-11 18:47:27 on dist-test-slave-lgr5"
server_key: "4081f08c7c0fcf4f3df240eb511cdeae"
server_key_iv: "3433b5b67296fbb2b6e53bab30643136"
server_key_version: "encryptionkey@0"
I20260811 18:47:27.925110 32070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:27.941999 32070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:27.946966 32070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:27.947279 32070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:27.966331 32070 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:41145
I20260811 18:47:27.966352 32179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:41145 every 8 connection(s)
I20260811 18:47:27.967970 32070 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:47:27.968490 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 32070
I20260811 18:47:27.968715 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:47:27.969561 25700 external_mini_cluster.cc:1428] Setting key 6aabdaa65625e56517d86ac17b36f484
I20260811 18:47:27.973330 32180 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:27.989782 32180 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2bdff85a4f2848d2b4efb1fcd58c06ce: Bootstrap starting.
Aug 11 18:47:27 dist-test-slave-lgr5 krb5kdc[32049](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:27.993687 32180 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2bdff85a4f2848d2b4efb1fcd58c06ce: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:27.994902 32180 log.cc:824] T 00000000000000000000000000000000 P 2bdff85a4f2848d2b4efb1fcd58c06ce: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:27.998279 32180 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2bdff85a4f2848d2b4efb1fcd58c06ce: No bootstrap required, opened a new log
I20260811 18:47:27.999531 32184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:27.972039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36590 (local address 127.25.25.62:41145)
0811 18:47:27.976064 (+ 4025us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:27.976101 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:27.976454 (+ 353us) server_negotiation.cc:407] Connection header received
0811 18:47:27.979388 (+ 2934us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:27.979427 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:27.980074 (+ 647us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:27.980644 (+ 570us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:27.982165 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:27.984226 (+ 2061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:27.985715 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:27.986944 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:27.987179 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:27.991509 (+ 4330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:27.991523 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:27.991550 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:27.991619 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:27.995040 (+ 3421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:27.995877 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:27.995885 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:27.995892 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:27.996130 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:27.996588 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:27.996594 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:27.996597 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:27.997186 (+ 589us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:27.997466 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:27.997958 (+ 492us) server_negotiation.cc:299] Negotiation successful
0811 18:47:27.998447 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3688,"thread_start_us":3304,"threads_started":1}
I20260811 18:47:28.007522 32180 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2bdff85a4f2848d2b4efb1fcd58c06ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bdff85a4f2848d2b4efb1fcd58c06ce" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41145 } }
I20260811 18:47:28.007987 32180 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2bdff85a4f2848d2b4efb1fcd58c06ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:28.008147 32180 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2bdff85a4f2848d2b4efb1fcd58c06ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bdff85a4f2848d2b4efb1fcd58c06ce, State: Initialized, Role: FOLLOWER
I20260811 18:47:28.008798 32180 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2bdff85a4f2848d2b4efb1fcd58c06ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bdff85a4f2848d2b4efb1fcd58c06ce" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41145 } }
I20260811 18:47:28.009110 32180 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2bdff85a4f2848d2b4efb1fcd58c06ce [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:47:28.009281 32180 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2bdff85a4f2848d2b4efb1fcd58c06ce [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:47:28.009490 32180 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2bdff85a4f2848d2b4efb1fcd58c06ce [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:28.011937 32180 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2bdff85a4f2848d2b4efb1fcd58c06ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bdff85a4f2848d2b4efb1fcd58c06ce" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41145 } }
I20260811 18:47:28.012527 32180 leader_election.cc:302] T 00000000000000000000000000000000 P 2bdff85a4f2848d2b4efb1fcd58c06ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2bdff85a4f2848d2b4efb1fcd58c06ce; no voters:
I20260811 18:47:28.013136 32180 leader_election.cc:288] T 00000000000000000000000000000000 P 2bdff85a4f2848d2b4efb1fcd58c06ce [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:47:28.013286 32187 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2bdff85a4f2848d2b4efb1fcd58c06ce [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:28.013939 32187 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2bdff85a4f2848d2b4efb1fcd58c06ce [term 1 LEADER]: Becoming Leader. State: Replica: 2bdff85a4f2848d2b4efb1fcd58c06ce, State: Running, Role: LEADER
I20260811 18:47:28.014540 32187 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2bdff85a4f2848d2b4efb1fcd58c06ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bdff85a4f2848d2b4efb1fcd58c06ce" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41145 } }
I20260811 18:47:28.015247 32180 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2bdff85a4f2848d2b4efb1fcd58c06ce [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:47:28.017756 32188 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2bdff85a4f2848d2b4efb1fcd58c06ce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2bdff85a4f2848d2b4efb1fcd58c06ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bdff85a4f2848d2b4efb1fcd58c06ce" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41145 } } }
I20260811 18:47:28.018152 32188 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2bdff85a4f2848d2b4efb1fcd58c06ce [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:28.018613 32189 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2bdff85a4f2848d2b4efb1fcd58c06ce [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2bdff85a4f2848d2b4efb1fcd58c06ce. Latest consensus state: current_term: 1 leader_uuid: "2bdff85a4f2848d2b4efb1fcd58c06ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bdff85a4f2848d2b4efb1fcd58c06ce" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41145 } } }
I20260811 18:47:28.019006 32189 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2bdff85a4f2848d2b4efb1fcd58c06ce [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:28.019493 32195 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:47:28.024228 32195 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:47:28.034204 32195 catalog_manager.cc:1347] Generated new cluster ID: a1fe371cf4b8457fac49f7f924d8bdb2
I20260811 18:47:28.034343 32195 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:47:28.053249 32195 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:47:28.054643 32195 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:47:28.061995 32195 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2bdff85a4f2848d2b4efb1fcd58c06ce: Generated new TSK 0
I20260811 18:47:28.063273 32195 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.25.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
I20260811 18:47:28.121901 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:0
--local_ip_for_outbound_sockets=127.25.25.1
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:41145
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:41181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:28.483870 32228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:28.484272 32228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:28.484452 32228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:28.492252 32228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:28.492388 32228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:28.492535 32228 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:47:28.503400 32228 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:41181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:41145
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:28.504978 32228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:28.506456 32228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:28.522059 32234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:28.522029 32236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:28.521991 32238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:28.523106 32228 server_base.cc:1034] running on GCE node
I20260811 18:47:28.523831 32228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:28.525059 32228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:28.526283 32228 hybrid_clock.cc:648] HybridClock initialized: now 1786474048526206 us; error 83 us; skew 500 ppm
I20260811 18:47:28.526618 32228 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:28 dist-test-slave-lgr5 krb5kdc[32049](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474048, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:28.530259 32228 init.cc:377] Logged in from keytab as kudu/127.25.25.1@KRBTEST.COM (short username kudu)
I20260811 18:47:28.531908 32228 webserver.cc:460] Webserver started at http://127.25.25.1:34799/ using document root <none> and password file <none>
I20260811 18:47:28.532702 32228 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:28.532825 32228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:28.533111 32228 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:28.536417 32228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-0/data/instance:
uuid: "3df996b474e5490ca9ebd6689c0d04e4"
format_stamp: "Formatted at 2026-08-11 18:47:28 on dist-test-slave-lgr5"
server_key: "5cf126b606162537ca560de99bd327cf"
server_key_iv: "b2de9d897fb8f2d3cf2a2c545f22091c"
server_key_version: "encryptionkey@0"
I20260811 18:47:28.537274 32228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance:
uuid: "3df996b474e5490ca9ebd6689c0d04e4"
format_stamp: "Formatted at 2026-08-11 18:47:28 on dist-test-slave-lgr5"
server_key: "5cf126b606162537ca560de99bd327cf"
server_key_iv: "b2de9d897fb8f2d3cf2a2c545f22091c"
server_key_version: "encryptionkey@0"
I20260811 18:47:28.543311 32228 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 18:47:28.547642 32250 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:28.549425 32228 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 18:47:28.549649 32228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "3df996b474e5490ca9ebd6689c0d04e4"
format_stamp: "Formatted at 2026-08-11 18:47:28 on dist-test-slave-lgr5"
server_key: "5cf126b606162537ca560de99bd327cf"
server_key_iv: "b2de9d897fb8f2d3cf2a2c545f22091c"
server_key_version: "encryptionkey@0"
I20260811 18:47:28.549883 32228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:28.576326 32228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:28.581029 32228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:28.581326 32228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:28.582381 32228 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:47:28.583841 32228 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:28.583921 32228 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:28.584045 32228 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:28.584123 32228 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260811 18:47:28.616873 32228 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:38931
I20260811 18:47:28.616925 32448 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:38931 every 8 connection(s)
I20260811 18:47:28.618233 32228 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:47:28.627743 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 32228
I20260811 18:47:28.627960 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance
I20260811 18:47:28.628638 25700 external_mini_cluster.cc:1428] Setting key 76db0c9c2c3c0f1de07c27c3b1f90de5
Aug 11 18:47:28 dist-test-slave-lgr5 krb5kdc[32049](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474048, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:28.639727 32452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:28.620922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:52995 (local address 127.25.25.62:41145)
0811 18:47:28.621404 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:28.621411 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:28.622495 (+ 1084us) server_negotiation.cc:407] Connection header received
0811 18:47:28.624461 (+ 1966us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:28.624466 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:28.624550 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:28.624643 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:28.626243 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:28.626990 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:28.628818 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:28.629269 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:28.629452 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:28.633254 (+ 3802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:28.633261 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:28.633266 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:28.633309 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:28.636463 (+ 3154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:28.637353 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:28.637359 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:28.637362 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:28.637565 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:28.637987 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:28.637991 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:28.637994 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:28.638333 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:28.638490 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:28.639263 (+ 773us) server_negotiation.cc:299] Negotiation successful
0811 18:47:28.639472 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":233,"threads_started":1}
I20260811 18:47:28.641312 32457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:28.621541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:41145 (local address 127.25.25.1:52995)
0811 18:47:28.622320 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:28.622361 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:28.624130 (+ 1769us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:28.624856 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:28.624865 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:28.625446 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:28.626077 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:28.626098 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:28.627171 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:28.627176 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:28.628629 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:28.628644 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:28.629572 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:28.629580 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:28.629803 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:28.630596 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:28.630623 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:28.632975 (+ 2352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:28.636652 (+ 3677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:28.636663 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:28.636679 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:28.637200 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:28.637664 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:28.637667 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:28.637670 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:28.637874 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:28.638451 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:28.638457 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:28.638859 (+ 402us) client_negotiation.cc:769] Sending connection context
0811 18:47:28.639125 (+ 266us) client_negotiation.cc:240] Negotiation successful
0811 18:47:28.639810 (+ 685us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":312,"threads_started":1}
I20260811 18:47:28.643097 32449 heartbeater.cc:347] Connected to a master server at 127.25.25.62:41145
I20260811 18:47:28.643414 32449 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:28.644260 32449 heartbeater.cc:511] Master 127.25.25.62:41145 requested a full tablet report, sending...
I20260811 18:47:28.646678 32124 ts_manager.cc:194] Registered new tserver with Master: 3df996b474e5490ca9ebd6689c0d04e4 (127.25.25.1:38931)
I20260811 18:47:28.648416 32124 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.1@KRBTEST.COM'} at 127.25.25.1:52995
WARNING: no policy specified for kudu/127.25.25.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
I20260811 18:47:28.681180 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:0
--local_ip_for_outbound_sockets=127.25.25.2
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:41145
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:41181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:29.043660 32462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:29.043982 32462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:29.044135 32462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:29.051556 32462 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:29.051699 32462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:29.051858 32462 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:47:29.062228 32462 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:41181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:41145
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:29.063692 32462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:29.065201 32462 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:29.079759 32474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:29.079794 32471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:29.080153 32470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:29.080528 32462 server_base.cc:1034] running on GCE node
I20260811 18:47:29.081284 32462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:29.082355 32462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:29.083580 32462 hybrid_clock.cc:648] HybridClock initialized: now 1786474049083511 us; error 58 us; skew 500 ppm
I20260811 18:47:29.083909 32462 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:29 dist-test-slave-lgr5 krb5kdc[32049](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474049, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:29.087342 32462 init.cc:377] Logged in from keytab as kudu/127.25.25.2@KRBTEST.COM (short username kudu)
I20260811 18:47:29.089105 32462 webserver.cc:460] Webserver started at http://127.25.25.2:43713/ using document root <none> and password file <none>
I20260811 18:47:29.089854 32462 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:29.089972 32462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:29.090273 32462 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:29.093755 32462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-1/data/instance:
uuid: "2bcddc227a6c4cc7b55393454b7e88eb"
format_stamp: "Formatted at 2026-08-11 18:47:29 on dist-test-slave-lgr5"
server_key: "9e6c12df1a0bebe58e5f991007ae2fb7"
server_key_iv: "99d1bb8c88f28d1142884d8642960013"
server_key_version: "encryptionkey@0"
I20260811 18:47:29.094651 32462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance:
uuid: "2bcddc227a6c4cc7b55393454b7e88eb"
format_stamp: "Formatted at 2026-08-11 18:47:29 on dist-test-slave-lgr5"
server_key: "9e6c12df1a0bebe58e5f991007ae2fb7"
server_key_iv: "99d1bb8c88f28d1142884d8642960013"
server_key_version: "encryptionkey@0"
I20260811 18:47:29.100870 32462 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260811 18:47:29.104892 32495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:29.106618 32462 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:47:29.106820 32462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "2bcddc227a6c4cc7b55393454b7e88eb"
format_stamp: "Formatted at 2026-08-11 18:47:29 on dist-test-slave-lgr5"
server_key: "9e6c12df1a0bebe58e5f991007ae2fb7"
server_key_iv: "99d1bb8c88f28d1142884d8642960013"
server_key_version: "encryptionkey@0"
I20260811 18:47:29.107062 32462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:29.124783 32462 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:29.129629 32462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:29.130008 32462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:29.131106 32462 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:47:29.132714 32462 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:29.132802 32462 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:29.132930 32462 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:29.132983 32462 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:29.166633 32462 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:33915
I20260811 18:47:29.166666 32732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:33915 every 8 connection(s)
I20260811 18:47:29.168052 32462 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:47:29.177122 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 32462
I20260811 18:47:29.177323 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance
I20260811 18:47:29.177860 25700 external_mini_cluster.cc:1428] Setting key b44638f53021c1cfa475b33a2d84059d
Aug 11 18:47:29 dist-test-slave-lgr5 krb5kdc[32049](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474049, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:29.192410 32736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:29.171016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:51069 (local address 127.25.25.62:41145)
0811 18:47:29.171532 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:29.171537 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:29.172653 (+ 1116us) server_negotiation.cc:407] Connection header received
0811 18:47:29.174594 (+ 1941us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:29.174600 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:29.174687 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:29.174788 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:29.176540 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:29.177622 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:29.179589 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:29.180265 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:29.180453 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:29.184395 (+ 3942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:29.184402 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:29.184408 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:29.184455 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:29.188257 (+ 3802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:29.189446 (+ 1189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:29.189454 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:29.189458 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:29.189666 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:29.190320 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:29.190325 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:29.190334 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:29.190659 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:29.190784 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:29.191859 (+ 1075us) server_negotiation.cc:299] Negotiation successful
0811 18:47:29.192066 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":266,"threads_started":1}
I20260811 18:47:29.193879 32737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:29.171602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:41145 (local address 127.25.25.2:51069)
0811 18:47:29.172485 (+ 883us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:29.172527 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:29.174298 (+ 1771us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:29.175078 (+ 780us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:29.175087 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:29.175643 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:29.176336 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:29.176362 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:29.177802 (+ 1440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:29.177806 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:29.179400 (+ 1594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:29.179420 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:29.180584 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:29.180591 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:29.180863 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:29.181597 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:29.181623 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:29.184012 (+ 2389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:29.188546 (+ 4534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:29.188557 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:29.188574 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:29.189240 (+ 666us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:29.189859 (+ 619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:29.189864 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:29.189867 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:29.190167 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:29.190828 (+ 661us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:29.190837 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:29.191378 (+ 541us) client_negotiation.cc:769] Sending connection context
0811 18:47:29.191731 (+ 353us) client_negotiation.cc:240] Negotiation successful
0811 18:47:29.192367 (+ 636us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":371,"threads_started":1}
I20260811 18:47:29.195588 32733 heartbeater.cc:347] Connected to a master server at 127.25.25.62:41145
I20260811 18:47:29.195937 32733 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:29.196791 32733 heartbeater.cc:511] Master 127.25.25.62:41145 requested a full tablet report, sending...
I20260811 18:47:29.198489 32124 ts_manager.cc:194] Registered new tserver with Master: 2bcddc227a6c4cc7b55393454b7e88eb (127.25.25.2:33915)
I20260811 18:47:29.199453 32124 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.2@KRBTEST.COM'} at 127.25.25.2:51069
WARNING: no policy specified for kudu/127.25.25.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
I20260811 18:47:29.235275 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:0
--local_ip_for_outbound_sockets=127.25.25.3
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:41145
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:41181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:29.590518 32740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:29.590827 32740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:29.590929 32740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:29.598490 32740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:29.598632 32740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:29.598749 32740 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:47:29.609416 32740 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:41181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:41145
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:29.610882 32740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:29.612471 32740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:29.628170 32749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:29.628219 32754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:29.628278 32757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:29.629001 32740 server_base.cc:1034] running on GCE node
I20260811 18:47:29.629801 32740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:29.630860 32740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:29.632140 32740 hybrid_clock.cc:648] HybridClock initialized: now 1786474049632049 us; error 55 us; skew 500 ppm
I20260811 18:47:29.632525 32740 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:29 dist-test-slave-lgr5 krb5kdc[32049](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474049, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:29.636130 32740 init.cc:377] Logged in from keytab as kudu/127.25.25.3@KRBTEST.COM (short username kudu)
I20260811 18:47:29.637877 32740 webserver.cc:460] Webserver started at http://127.25.25.3:40621/ using document root <none> and password file <none>
I20260811 18:47:29.638660 32740 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:29.638782 32740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:29.639106 32740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:29.642638 32740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-2/data/instance:
uuid: "326f55183dfd427f8d3505865a6bbf1b"
format_stamp: "Formatted at 2026-08-11 18:47:29 on dist-test-slave-lgr5"
server_key: "e2f4b2e4ea77df03ad47e547a3f0ef7c"
server_key_iv: "2fdb3ba63766d9408d38623b10f06462"
server_key_version: "encryptionkey@0"
I20260811 18:47:29.643644 32740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance:
uuid: "326f55183dfd427f8d3505865a6bbf1b"
format_stamp: "Formatted at 2026-08-11 18:47:29 on dist-test-slave-lgr5"
server_key: "e2f4b2e4ea77df03ad47e547a3f0ef7c"
server_key_iv: "2fdb3ba63766d9408d38623b10f06462"
server_key_version: "encryptionkey@0"
I20260811 18:47:29.649878 32740 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260811 18:47:29.651784 32449 heartbeater.cc:503] Master 127.25.25.62:41145 was elected leader, sending a full tablet report...
I20260811 18:47:29.654327 303 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:29.655926 32740 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 18:47:29.656127 32740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "326f55183dfd427f8d3505865a6bbf1b"
format_stamp: "Formatted at 2026-08-11 18:47:29 on dist-test-slave-lgr5"
server_key: "e2f4b2e4ea77df03ad47e547a3f0ef7c"
server_key_iv: "2fdb3ba63766d9408d38623b10f06462"
server_key_version: "encryptionkey@0"
I20260811 18:47:29.656383 32740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:29.686825 32740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:29.691715 32740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:29.692057 32740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:29.693502 32740 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:47:29.695469 32740 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:29.695547 32740 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:29.695662 32740 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:29.695727 32740 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:29.728848 32740 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:41337
I20260811 18:47:29.728929 507 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:41337 every 8 connection(s)
I20260811 18:47:29.730293 32740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:47:29.740556 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 32740
I20260811 18:47:29.740782 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance
I20260811 18:47:29.741223 25700 external_mini_cluster.cc:1428] Setting key c8de98cec05df529876dcf6d89dac556
Aug 11 18:47:29 dist-test-slave-lgr5 krb5kdc[32049](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474049, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:29.751617 515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:29.733095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:59363 (local address 127.25.25.62:41145)
0811 18:47:29.733604 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:29.733609 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:29.734670 (+ 1061us) server_negotiation.cc:407] Connection header received
0811 18:47:29.736689 (+ 2019us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:29.736694 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:29.736797 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:29.736896 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:29.738612 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:29.739432 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:29.741183 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:29.741624 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:29.741739 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:29.745515 (+ 3776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:29.745520 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:29.745523 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:29.745569 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:29.748356 (+ 2787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:29.749248 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:29.749252 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:29.749255 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:29.749409 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:29.749874 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:29.749881 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:29.749883 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:29.750201 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:29.750330 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:29.751117 (+ 787us) server_negotiation.cc:299] Negotiation successful
0811 18:47:29.751325 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":258,"threads_started":1}
I20260811 18:47:29.752607 516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:29.733732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:41145 (local address 127.25.25.3:59363)
0811 18:47:29.734468 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:29.734544 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:29.736378 (+ 1834us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:29.737172 (+ 794us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:29.737181 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:29.737780 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:29.738410 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:29.738430 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:29.739607 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:29.739612 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:29.741030 (+ 1418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:29.741045 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:29.741879 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:29.741887 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:29.742139 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:29.742820 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:29.742845 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:29.745264 (+ 2419us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:29.748549 (+ 3285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:29.748558 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:29.748577 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:29.749082 (+ 505us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:29.749504 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:29.749508 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:29.749512 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:29.749728 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:29.750328 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:29.750335 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:29.750707 (+ 372us) client_negotiation.cc:769] Sending connection context
0811 18:47:29.750956 (+ 249us) client_negotiation.cc:240] Negotiation successful
0811 18:47:29.751402 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":289,"threads_started":1}
I20260811 18:47:29.754177 510 heartbeater.cc:347] Connected to a master server at 127.25.25.62:41145
I20260811 18:47:29.754518 510 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:29.755342 510 heartbeater.cc:511] Master 127.25.25.62:41145 requested a full tablet report, sending...
I20260811 18:47:29.757031 32122 ts_manager.cc:194] Registered new tserver with Master: 326f55183dfd427f8d3505865a6bbf1b (127.25.25.3:41337)
I20260811 18:47:29.757920 32122 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.3@KRBTEST.COM'} at 127.25.25.3:59363
I20260811 18:47:29.770419 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 18:47:29 dist-test-slave-lgr5 krb5kdc[32049](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474049, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 18:47:29 dist-test-slave-lgr5 krb5kdc[32049](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474049, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.1@KRBTEST.COM
I20260811 18:47:29.830370 526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:29.812593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39948 (local address 127.25.25.1:38931)
0811 18:47:29.813342 (+ 749us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:29.813354 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:29.813389 (+ 35us) server_negotiation.cc:407] Connection header received
0811 18:47:29.813461 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:29.813468 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:29.813687 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:29.813888 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:29.815640 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:29.816915 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:29.818354 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:29.819053 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:29.819208 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:29.823787 (+ 4579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:29.823806 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:29.823824 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:29.823881 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:29.827042 (+ 3161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:29.827883 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:29.827892 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:29.827894 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:29.828057 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:29.828563 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:29.828569 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:29.828572 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:29.828971 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:29.829312 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:29.829670 (+ 358us) server_negotiation.cc:299] Negotiation successful
0811 18:47:29.829963 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":537,"thread_start_us":345,"threads_started":1}
Aug 11 18:47:29 dist-test-slave-lgr5 krb5kdc[32049](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474049, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:29.850222 515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:29.835443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55046 (local address 127.25.25.62:41145)
0811 18:47:29.835662 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:29.835668 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:29.835843 (+ 175us) server_negotiation.cc:407] Connection header received
0811 18:47:29.835992 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:29.835995 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:29.836063 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:29.836172 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:29.837468 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:29.838224 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:29.839530 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:29.839991 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:29.840126 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:29.844447 (+ 4321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:29.844454 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:29.844461 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:29.844507 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:29.847312 (+ 2805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:29.848211 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:29.848216 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:29.848219 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:29.848381 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:29.848846 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:29.848850 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:29.848852 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:29.849205 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:29.849405 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:29.849736 (+ 331us) server_negotiation.cc:299] Negotiation successful
0811 18:47:29.849934 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
W20260811 18:47:29.850860 32122 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55046
I20260811 18:47:29.851878 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 32228
I20260811 18:47:29.866927 526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:29.852962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39960 (local address 127.25.25.1:38931)
0811 18:47:29.853195 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:29.853202 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:29.853342 (+ 140us) server_negotiation.cc:407] Connection header received
0811 18:47:29.853540 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:29.853547 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:29.853664 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:29.853761 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:29.855299 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:29.856066 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:29.857449 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:29.857935 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:29.858078 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:29.860901 (+ 2823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:29.860908 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:29.860911 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:29.860957 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:29.863977 (+ 3020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:29.864891 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:29.864897 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:29.864901 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:29.865055 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:29.865468 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:29.865473 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:29.865475 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:29.865776 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:29.866038 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:29.866350 (+ 312us) server_negotiation.cc:299] Negotiation successful
0811 18:47:29.866600 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 18:47:29.867712 32442 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:29.954196 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 32228
I20260811 18:47:29.983057 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 32462
Aug 11 18:47:29 dist-test-slave-lgr5 krb5kdc[32049](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474049, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.2@KRBTEST.COM
I20260811 18:47:30.000893 536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:29.984144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38314 (local address 127.25.25.2:33915)
0811 18:47:29.984721 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:29.984729 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:29.984758 (+ 29us) server_negotiation.cc:407] Connection header received
0811 18:47:29.984831 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:29.984838 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:29.985057 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:29.985225 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:29.986529 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:29.987623 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:29.989075 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:29.989689 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:29.989818 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:29.994473 (+ 4655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:29.994494 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:29.994512 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:29.994559 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:29.997539 (+ 2980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:29.998388 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:29.998396 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:29.998399 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:29.998549 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:29.998979 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:29.998983 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:29.998986 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:29.999389 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:29.999736 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:30.000257 (+ 521us) server_negotiation.cc:299] Negotiation successful
0811 18:47:30.000588 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":290,"threads_started":1}
I20260811 18:47:30.002264 32723 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:30.087081 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 32462
I20260811 18:47:30.115000 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 32740
Aug 11 18:47:30 dist-test-slave-lgr5 krb5kdc[32049](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474049, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.3@KRBTEST.COM
I20260811 18:47:30.133492 539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:30.115995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39284 (local address 127.25.25.3:41337)
0811 18:47:30.116685 (+ 690us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:30.116695 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:30.116737 (+ 42us) server_negotiation.cc:407] Connection header received
0811 18:47:30.116813 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:30.116820 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:30.117051 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:30.117189 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:30.118602 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:30.119644 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:30.121270 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:30.121877 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:30.121995 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:30.126975 (+ 4980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:30.126994 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:30.127011 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:30.127063 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:30.130518 (+ 3455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:30.131357 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:30.131367 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:30.131369 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:30.131547 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:30.131935 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:30.131938 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:30.131940 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:30.132350 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:30.132639 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:30.132872 (+ 233us) server_negotiation.cc:299] Negotiation successful
0811 18:47:30.133096 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":325,"threads_started":1}
I20260811 18:47:30.134943 501 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:30.219939 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 32740
I20260811 18:47:30.247581 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 32070
I20260811 18:47:30.248900 32171 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:30.356621 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 32070
2026-08-11T18:47:30Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4369 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:47:30 dist-test-slave-lgr5 krb5kdc[547](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:47:30 dist-test-slave-lgr5 krb5kdc[547](info): set up 2 sockets
Aug 11 18:47:30 dist-test-slave-lgr5 krb5kdc[547](info): commencing operation
krb5kdc: starting...
W20260811 18:47:31.628429 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.216s user 0.004s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:47:31 dist-test-slave-lgr5 krb5kdc[547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474051, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:47:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:47:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:47:31.877935 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:46869
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:40079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:46869
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:32.231776 564 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:32.232194 564 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:32.232345 564 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:32.240378 564 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:47:32.240543 564 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:32.240628 564 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:32.240708 564 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:47:32.240780 564 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:47:32.251380 564 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:46869
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:46869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:32.252942 564 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:32.254406 564 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:32.266925 570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:32.266857 574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:32.266883 572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:32.267951 564 server_base.cc:1034] running on GCE node
I20260811 18:47:32.268872 564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:32.270430 564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:32.271658 564 hybrid_clock.cc:648] HybridClock initialized: now 1786474052271603 us; error 40 us; skew 500 ppm
I20260811 18:47:32.272101 564 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:32 dist-test-slave-lgr5 krb5kdc[547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474052, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:32.275761 564 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:47:32.277184 564 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:32.277299 564 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:32.277680 564 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:32.281172 564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "c5b5a7d5df6542c190aa9262df154fd5"
format_stamp: "Formatted at 2026-08-11 18:47:32 on dist-test-slave-lgr5"
server_key: "806ddb862dd97c3af8ecd3f53daec2d4"
server_key_iv: "43773f34cfdbec3c3ff8fd926fa6d7dc"
server_key_version: "encryptionkey@0"
I20260811 18:47:32.282225 564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "c5b5a7d5df6542c190aa9262df154fd5"
format_stamp: "Formatted at 2026-08-11 18:47:32 on dist-test-slave-lgr5"
server_key: "806ddb862dd97c3af8ecd3f53daec2d4"
server_key_iv: "43773f34cfdbec3c3ff8fd926fa6d7dc"
server_key_version: "encryptionkey@0"
I20260811 18:47:32.288614 564 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 18:47:32.292862 583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:32.294495 564 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:47:32.294704 564 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "c5b5a7d5df6542c190aa9262df154fd5"
format_stamp: "Formatted at 2026-08-11 18:47:32 on dist-test-slave-lgr5"
server_key: "806ddb862dd97c3af8ecd3f53daec2d4"
server_key_iv: "43773f34cfdbec3c3ff8fd926fa6d7dc"
server_key_version: "encryptionkey@0"
I20260811 18:47:32.294950 564 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:32.309366 564 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:32.313987 564 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:32.314287 564 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:32.333586 564 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:46869
I20260811 18:47:32.333621 665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:46869 every 8 connection(s)
I20260811 18:47:32.334563 564 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:47:32.338644 668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:32.343098 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 564
I20260811 18:47:32.343308 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:47:32.343957 25700 external_mini_cluster.cc:1428] Setting key aa47f1ac07f35610d2c6f9df1784e8fe
I20260811 18:47:32.350881 668 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5b5a7d5df6542c190aa9262df154fd5: Bootstrap starting.
I20260811 18:47:32.355065 668 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5b5a7d5df6542c190aa9262df154fd5: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:32.356513 668 log.cc:824] T 00000000000000000000000000000000 P c5b5a7d5df6542c190aa9262df154fd5: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:32.360455 668 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5b5a7d5df6542c190aa9262df154fd5: No bootstrap required, opened a new log
Aug 11 18:47:32 dist-test-slave-lgr5 krb5kdc[547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474051, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:32.370072 668 raft_consensus.cc:348] T 00000000000000000000000000000000 P c5b5a7d5df6542c190aa9262df154fd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5b5a7d5df6542c190aa9262df154fd5" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46869 } }
I20260811 18:47:32.370502 668 raft_consensus.cc:374] T 00000000000000000000000000000000 P c5b5a7d5df6542c190aa9262df154fd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:32.370609 668 raft_consensus.cc:729] T 00000000000000000000000000000000 P c5b5a7d5df6542c190aa9262df154fd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b5a7d5df6542c190aa9262df154fd5, State: Initialized, Role: FOLLOWER
I20260811 18:47:32.371089 672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:32.346051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56558 (local address 127.25.25.62:46869)
0811 18:47:32.346959 (+ 908us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:32.346973 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:32.347018 (+ 45us) server_negotiation.cc:407] Connection header received
0811 18:47:32.349107 (+ 2089us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:32.349134 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:32.349585 (+ 451us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:32.349947 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:32.351930 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:32.353531 (+ 1601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:32.355680 (+ 2149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:32.356519 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:32.356702 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:32.362140 (+ 5438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:32.362156 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:32.362183 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:32.362246 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:32.365911 (+ 3665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:32.367076 (+ 1165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:32.367088 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:32.367097 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:32.367346 (+ 249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:32.367844 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:32.367848 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:32.367850 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:32.368613 (+ 763us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:32.368871 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:32.369391 (+ 520us) server_negotiation.cc:299] Negotiation successful
0811 18:47:32.369829 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":666,"thread_start_us":396,"threads_started":1}
I20260811 18:47:32.371335 668 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5b5a7d5df6542c190aa9262df154fd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5b5a7d5df6542c190aa9262df154fd5" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46869 } }
I20260811 18:47:32.371599 668 raft_consensus.cc:388] T 00000000000000000000000000000000 P c5b5a7d5df6542c190aa9262df154fd5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:47:32.371747 668 raft_consensus.cc:482] T 00000000000000000000000000000000 P c5b5a7d5df6542c190aa9262df154fd5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:47:32.371943 668 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c5b5a7d5df6542c190aa9262df154fd5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:32.374445 668 raft_consensus.cc:504] T 00000000000000000000000000000000 P c5b5a7d5df6542c190aa9262df154fd5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5b5a7d5df6542c190aa9262df154fd5" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46869 } }
I20260811 18:47:32.374997 668 leader_election.cc:302] T 00000000000000000000000000000000 P c5b5a7d5df6542c190aa9262df154fd5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5b5a7d5df6542c190aa9262df154fd5; no voters:
I20260811 18:47:32.375663 668 leader_election.cc:288] T 00000000000000000000000000000000 P c5b5a7d5df6542c190aa9262df154fd5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:47:32.375850 674 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c5b5a7d5df6542c190aa9262df154fd5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:32.377040 674 raft_consensus.cc:686] T 00000000000000000000000000000000 P c5b5a7d5df6542c190aa9262df154fd5 [term 1 LEADER]: Becoming Leader. State: Replica: c5b5a7d5df6542c190aa9262df154fd5, State: Running, Role: LEADER
I20260811 18:47:32.377617 674 consensus_queue.cc:237] T 00000000000000000000000000000000 P c5b5a7d5df6542c190aa9262df154fd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5b5a7d5df6542c190aa9262df154fd5" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46869 } }
I20260811 18:47:32.378083 668 sys_catalog.cc:564] T 00000000000000000000000000000000 P c5b5a7d5df6542c190aa9262df154fd5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:47:32.380440 676 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5b5a7d5df6542c190aa9262df154fd5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5b5a7d5df6542c190aa9262df154fd5. Latest consensus state: current_term: 1 leader_uuid: "c5b5a7d5df6542c190aa9262df154fd5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5b5a7d5df6542c190aa9262df154fd5" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46869 } } }
I20260811 18:47:32.380462 675 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5b5a7d5df6542c190aa9262df154fd5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c5b5a7d5df6542c190aa9262df154fd5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5b5a7d5df6542c190aa9262df154fd5" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46869 } } }
I20260811 18:47:32.380939 675 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5b5a7d5df6542c190aa9262df154fd5 [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:32.380935 676 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5b5a7d5df6542c190aa9262df154fd5 [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:32.381906 681 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:47:32.387065 681 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:47:32.397269 681 catalog_manager.cc:1347] Generated new cluster ID: 952058a1d6bc4a17b555703673105ac7
I20260811 18:47:32.397439 681 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:47:32.413530 681 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:47:32.414935 681 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:47:32.424149 681 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c5b5a7d5df6542c190aa9262df154fd5: Generated new TSK 0
I20260811 18:47:32.425061 681 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.25.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
I20260811 18:47:32.486281 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:0
--local_ip_for_outbound_sockets=127.25.25.1
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:46869
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:40079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:32.848048 717 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:32.848460 717 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:32.848615 717 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:32.856215 717 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:32.856381 717 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:32.856554 717 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:47:32.867075 717 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:46869
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:32.868639 717 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:32.870087 717 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:32.884560 726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:32.884541 729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:32.884560 732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:32.885914 717 server_base.cc:1034] running on GCE node
I20260811 18:47:32.886628 717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:32.887753 717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:32.888978 717 hybrid_clock.cc:648] HybridClock initialized: now 1786474052888899 us; error 76 us; skew 500 ppm
I20260811 18:47:32.889338 717 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:32 dist-test-slave-lgr5 krb5kdc[547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474052, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:32.892880 717 init.cc:377] Logged in from keytab as kudu/127.25.25.1@KRBTEST.COM (short username kudu)
I20260811 18:47:32.894176 717 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:32.894279 717 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:32.894577 717 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:32.897862 717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-0/data/instance:
uuid: "74ab25ec201749f6bbda2b92ac9b8aff"
format_stamp: "Formatted at 2026-08-11 18:47:32 on dist-test-slave-lgr5"
server_key: "704c1ab70bafc265b391754e95c995a5"
server_key_iv: "229599d0e0c382cba6008b137066e413"
server_key_version: "encryptionkey@0"
I20260811 18:47:32.898759 717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance:
uuid: "74ab25ec201749f6bbda2b92ac9b8aff"
format_stamp: "Formatted at 2026-08-11 18:47:32 on dist-test-slave-lgr5"
server_key: "704c1ab70bafc265b391754e95c995a5"
server_key_iv: "229599d0e0c382cba6008b137066e413"
server_key_version: "encryptionkey@0"
I20260811 18:47:32.904570 717 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 18:47:32.908574 741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:32.910023 717 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 18:47:32.910208 717 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "74ab25ec201749f6bbda2b92ac9b8aff"
format_stamp: "Formatted at 2026-08-11 18:47:32 on dist-test-slave-lgr5"
server_key: "704c1ab70bafc265b391754e95c995a5"
server_key_iv: "229599d0e0c382cba6008b137066e413"
server_key_version: "encryptionkey@0"
I20260811 18:47:32.910437 717 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:32.939056 717 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:32.943675 717 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:32.943957 717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:32.945076 717 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:47:32.946615 717 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:32.946717 717 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:32.946835 717 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:32.946913 717 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:32.980206 717 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:36099
I20260811 18:47:32.980265 937 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:36099 every 8 connection(s)
I20260811 18:47:32.981138 717 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:47:32.990550 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 717
I20260811 18:47:32.990835 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance
I20260811 18:47:32.991736 25700 external_mini_cluster.cc:1428] Setting key 5a66309d2185e84f99bb5f64bfe3bf8f
Aug 11 18:47:32 dist-test-slave-lgr5 krb5kdc[547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474052, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:33.003966 941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:32.983766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:47819 (local address 127.25.25.62:46869)
0811 18:47:32.984277 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:32.984283 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:32.985361 (+ 1078us) server_negotiation.cc:407] Connection header received
0811 18:47:32.987331 (+ 1970us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:32.987337 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:32.987413 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:32.987534 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:32.989438 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:32.990173 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:32.992798 (+ 2625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:32.993308 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:32.993429 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:32.997204 (+ 3775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:32.997210 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:32.997213 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:32.997253 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:32.999908 (+ 2655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:33.000883 (+ 975us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:33.000889 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:33.000891 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:33.001055 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:33.001743 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:33.001748 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:33.001750 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:33.002194 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:33.002364 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:33.003279 (+ 915us) server_negotiation.cc:299] Negotiation successful
0811 18:47:33.003580 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":225,"threads_started":1}
I20260811 18:47:33.005111 943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:32.984377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:46869 (local address 127.25.25.1:47819)
0811 18:47:32.985170 (+ 793us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:32.985214 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:32.987020 (+ 1806us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:32.987825 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:32.987835 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:32.988574 (+ 739us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:32.989244 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:32.989265 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:32.990399 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:32.990406 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:32.992613 (+ 2207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:32.992631 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:32.993560 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:32.993569 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:32.993847 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:32.994599 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:32.994627 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:32.996927 (+ 2300us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:33.000147 (+ 3220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:33.000156 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:33.000174 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:33.000720 (+ 546us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:33.001188 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:33.001192 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:33.001194 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:33.001443 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:33.002361 (+ 918us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:33.002371 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:33.002812 (+ 441us) client_negotiation.cc:769] Sending connection context
0811 18:47:33.003104 (+ 292us) client_negotiation.cc:240] Negotiation successful
0811 18:47:33.003774 (+ 670us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":302,"threads_started":1}
I20260811 18:47:33.007081 939 heartbeater.cc:347] Connected to a master server at 127.25.25.62:46869
I20260811 18:47:33.007542 939 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:33.008471 939 heartbeater.cc:511] Master 127.25.25.62:46869 requested a full tablet report, sending...
I20260811 18:47:33.011312 615 ts_manager.cc:194] Registered new tserver with Master: 74ab25ec201749f6bbda2b92ac9b8aff (127.25.25.1:36099)
I20260811 18:47:33.013622 615 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.1@KRBTEST.COM'} at 127.25.25.1:47819
WARNING: no policy specified for kudu/127.25.25.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
I20260811 18:47:33.050096 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:0
--local_ip_for_outbound_sockets=127.25.25.2
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:46869
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:40079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:33.410921 947 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:33.411254 947 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:33.411399 947 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:33.419281 947 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:33.419461 947 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:33.419637 947 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:47:33.431048 947 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:46869
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:33.432626 947 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:33.434145 947 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:33.449442 962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:33.449468 955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:33.449607 954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:33.450706 947 server_base.cc:1034] running on GCE node
I20260811 18:47:33.451447 947 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:33.452713 947 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:33.454047 947 hybrid_clock.cc:648] HybridClock initialized: now 1786474053453969 us; error 55 us; skew 500 ppm
I20260811 18:47:33.454552 947 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:33 dist-test-slave-lgr5 krb5kdc[547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474053, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:33.458425 947 init.cc:377] Logged in from keytab as kudu/127.25.25.2@KRBTEST.COM (short username kudu)
I20260811 18:47:33.459856 947 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:33.459988 947 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:33.460393 947 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:33.463733 947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-1/data/instance:
uuid: "75a847aef0594f8589996c8c6bdba567"
format_stamp: "Formatted at 2026-08-11 18:47:33 on dist-test-slave-lgr5"
server_key: "7a30b47e8cf5acc7b73e6446557ce81a"
server_key_iv: "cfc0113eb6b6cab85beb6f148e3ef8f7"
server_key_version: "encryptionkey@0"
I20260811 18:47:33.464727 947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance:
uuid: "75a847aef0594f8589996c8c6bdba567"
format_stamp: "Formatted at 2026-08-11 18:47:33 on dist-test-slave-lgr5"
server_key: "7a30b47e8cf5acc7b73e6446557ce81a"
server_key_iv: "cfc0113eb6b6cab85beb6f148e3ef8f7"
server_key_version: "encryptionkey@0"
I20260811 18:47:33.471261 947 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.003s
I20260811 18:47:33.475904 972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:33.477897 947 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260811 18:47:33.478137 947 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "75a847aef0594f8589996c8c6bdba567"
format_stamp: "Formatted at 2026-08-11 18:47:33 on dist-test-slave-lgr5"
server_key: "7a30b47e8cf5acc7b73e6446557ce81a"
server_key_iv: "cfc0113eb6b6cab85beb6f148e3ef8f7"
server_key_version: "encryptionkey@0"
I20260811 18:47:33.478410 947 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:33.510695 947 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:33.515456 947 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:33.515755 947 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:33.516876 947 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:47:33.518378 947 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:33.518488 947 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:33.518605 947 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:33.518693 947 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:33.552166 947 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:38263
I20260811 18:47:33.552248 1195 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:38263 every 8 connection(s)
I20260811 18:47:33.553109 947 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:47:33.557502 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 947
I20260811 18:47:33.557744 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance
I20260811 18:47:33.558287 25700 external_mini_cluster.cc:1428] Setting key 501a9e54a6df86ed9d144e6c7f56c230
Aug 11 18:47:33 dist-test-slave-lgr5 krb5kdc[547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474053, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:33.582470 1202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:33.556280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:49733 (local address 127.25.25.62:46869)
0811 18:47:33.557486 (+ 1206us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:33.557493 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:33.558221 (+ 728us) server_negotiation.cc:407] Connection header received
0811 18:47:33.560549 (+ 2328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:33.560556 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:33.560658 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:33.560792 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:33.563288 (+ 2496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:33.564074 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:33.566641 (+ 2567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:33.567140 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:33.567274 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:33.573146 (+ 5872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:33.573153 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:33.573157 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:33.573202 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:33.576543 (+ 3341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:33.578575 (+ 2032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:33.578582 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:33.578584 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:33.578763 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:33.579941 (+ 1178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:33.579947 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:33.579949 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:33.580374 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:33.580648 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:33.581871 (+ 1223us) server_negotiation.cc:299] Negotiation successful
0811 18:47:33.582105 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":961,"thread_start_us":809,"threads_started":1}
I20260811 18:47:33.584303 1203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:33.557006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:46869 (local address 127.25.25.2:49733)
0811 18:47:33.558001 (+ 995us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:33.558069 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:33.560162 (+ 2093us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:33.561147 (+ 985us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:33.561161 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:33.562036 (+ 875us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:33.562991 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:33.563028 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:33.564298 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:33.564303 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:33.566344 (+ 2041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:33.566371 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:33.567457 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:33.567466 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:33.567872 (+ 406us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:33.568810 (+ 938us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:33.568843 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:33.572707 (+ 3864us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:33.576998 (+ 4291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:33.577021 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:33.577063 (+ 42us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:33.578299 (+ 1236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:33.579041 (+ 742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:33.579049 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:33.579054 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:33.579609 (+ 555us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:33.580607 (+ 998us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:33.580619 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:33.581226 (+ 607us) client_negotiation.cc:769] Sending connection context
0811 18:47:33.581651 (+ 425us) client_negotiation.cc:240] Negotiation successful
0811 18:47:33.582543 (+ 892us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":651,"thread_start_us":394,"threads_started":1}
I20260811 18:47:33.586279 1197 heartbeater.cc:347] Connected to a master server at 127.25.25.62:46869
I20260811 18:47:33.586681 1197 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:33.587446 1197 heartbeater.cc:511] Master 127.25.25.62:46869 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.25.25.3@KRBTEST.COM; defaulting to no policy
I20260811 18:47:33.589368 615 ts_manager.cc:194] Registered new tserver with Master: 75a847aef0594f8589996c8c6bdba567 (127.25.25.2:38263)
I20260811 18:47:33.590291 615 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.2@KRBTEST.COM'} at 127.25.25.2:49733
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
I20260811 18:47:33.621793 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:0
--local_ip_for_outbound_sockets=127.25.25.3
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:46869
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:40079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:33.974084 1211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:33.974588 1211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:33.974777 1211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:33.984123 1211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:33.984252 1211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:33.984421 1211 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:47:33.995144 1211 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:46869
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:33.996708 1211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:33.998172 1211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:34.012573 1223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:34.013717 1221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:34.012529 1219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:34.014760 1211 server_base.cc:1034] running on GCE node
I20260811 18:47:34.015517 1211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:34.016631 1211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:34.017516 939 heartbeater.cc:503] Master 127.25.25.62:46869 was elected leader, sending a full tablet report...
I20260811 18:47:34.017856 1211 hybrid_clock.cc:648] HybridClock initialized: now 1786474054017799 us; error 51 us; skew 500 ppm
I20260811 18:47:34.018266 1211 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:34 dist-test-slave-lgr5 krb5kdc[547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474054, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:34.021625 1211 init.cc:377] Logged in from keytab as kudu/127.25.25.3@KRBTEST.COM (short username kudu)
I20260811 18:47:34.022799 1211 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:34.022898 1211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:34.023200 1211 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:34.026392 1211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-2/data/instance:
uuid: "a362ae4bce20440aa6b6872cc728d0c3"
format_stamp: "Formatted at 2026-08-11 18:47:34 on dist-test-slave-lgr5"
server_key: "1a39c74828c3da8eee8096aff998a195"
server_key_iv: "46121fa546923fe8a4c5d88491099818"
server_key_version: "encryptionkey@0"
I20260811 18:47:34.027251 1211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance:
uuid: "a362ae4bce20440aa6b6872cc728d0c3"
format_stamp: "Formatted at 2026-08-11 18:47:34 on dist-test-slave-lgr5"
server_key: "1a39c74828c3da8eee8096aff998a195"
server_key_iv: "46121fa546923fe8a4c5d88491099818"
server_key_version: "encryptionkey@0"
I20260811 18:47:34.033051 1211 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260811 18:47:34.036841 1241 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:34.038503 1211 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:47:34.038686 1211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "a362ae4bce20440aa6b6872cc728d0c3"
format_stamp: "Formatted at 2026-08-11 18:47:34 on dist-test-slave-lgr5"
server_key: "1a39c74828c3da8eee8096aff998a195"
server_key_iv: "46121fa546923fe8a4c5d88491099818"
server_key_version: "encryptionkey@0"
I20260811 18:47:34.038903 1211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:34.073380 1211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:34.078207 1211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:34.078477 1211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:34.079563 1211 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:47:34.081198 1211 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:34.081295 1211 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:34.081380 1211 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:34.081446 1211 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:34.113332 1211 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:42239
I20260811 18:47:34.113385 1440 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:42239 every 8 connection(s)
I20260811 18:47:34.114203 1211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:47:34.117188 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 1211
I20260811 18:47:34.117398 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance
I20260811 18:47:34.117825 25700 external_mini_cluster.cc:1428] Setting key 3013ed6202e9f0a4c4aabc85d3b28bbf
Aug 11 18:47:34 dist-test-slave-lgr5 krb5kdc[547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474054, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:34.134698 1446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:34.116842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:45151 (local address 127.25.25.62:46869)
0811 18:47:34.117367 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:34.117374 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:34.118521 (+ 1147us) server_negotiation.cc:407] Connection header received
0811 18:47:34.120638 (+ 2117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:34.120644 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:34.120740 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:34.120832 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:34.122479 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.123240 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.124918 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.125351 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.125477 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:34.128994 (+ 3517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:34.129000 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:34.129003 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:34.129040 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:34.131463 (+ 2423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:34.132252 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:34.132257 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:34.132259 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:34.132383 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:34.132832 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:34.132836 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:34.132838 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:34.133125 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:34.133271 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:34.134045 (+ 774us) server_negotiation.cc:299] Negotiation successful
0811 18:47:34.134295 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":236,"threads_started":1}
I20260811 18:47:34.135800 1447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:34.117447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:46869 (local address 127.25.25.3:45151)
0811 18:47:34.118304 (+ 857us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:34.118358 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:34.120359 (+ 2001us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:34.121097 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:34.121105 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:34.121656 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:34.122269 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:34.122292 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.123400 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.123404 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:34.124766 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:34.124781 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.125590 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.125598 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:34.125820 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:34.126495 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:34.126519 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:34.128750 (+ 2231us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:34.131608 (+ 2858us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:34.131619 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:34.131636 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:34.132125 (+ 489us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:34.132508 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:34.132514 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:34.132518 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:34.132714 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:34.133259 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:34.133268 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:34.133635 (+ 367us) client_negotiation.cc:769] Sending connection context
0811 18:47:34.133918 (+ 283us) client_negotiation.cc:240] Negotiation successful
0811 18:47:34.134491 (+ 573us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":361,"threads_started":1}
I20260811 18:47:34.137476 1441 heartbeater.cc:347] Connected to a master server at 127.25.25.62:46869
I20260811 18:47:34.137817 1441 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:34.138545 1441 heartbeater.cc:511] Master 127.25.25.62:46869 requested a full tablet report, sending...
I20260811 18:47:34.140127 615 ts_manager.cc:194] Registered new tserver with Master: a362ae4bce20440aa6b6872cc728d0c3 (127.25.25.3:42239)
I20260811 18:47:34.141004 615 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.3@KRBTEST.COM'} at 127.25.25.3:45151
I20260811 18:47:34.145768 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:47:34.164671 1446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:34.150397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56564 (local address 127.25.25.62:46869)
0811 18:47:34.150604 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:34.150612 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:34.151104 (+ 492us) server_negotiation.cc:407] Connection header received
0811 18:47:34.151243 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:34.151248 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:34.151317 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:34.151398 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:34.152911 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.153633 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.154973 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.155397 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.155492 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:34.158080 (+ 2588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:34.158087 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:34.158090 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:34.158133 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:34.161097 (+ 2964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:34.162030 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:34.162036 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:34.162039 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:34.162217 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:34.162923 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:34.162929 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:34.162932 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:34.163332 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:34.163567 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:34.163980 (+ 413us) server_negotiation.cc:299] Negotiation successful
0811 18:47:34.164274 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 18:47:34.169471 615 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56564:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:47:34.176805 615 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:47:34.211401 1464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:34.191350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53450 (local address 127.25.25.3:42239)
0811 18:47:34.200977 (+ 9627us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:34.200987 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:34.202990 (+ 2003us) server_negotiation.cc:407] Connection header received
0811 18:47:34.203322 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:34.203331 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:34.203563 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:34.203725 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:34.204886 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.206816 (+ 1930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.208673 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.210152 (+ 1479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.210286 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:34.210525 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:34.210874 (+ 349us) server_negotiation.cc:299] Negotiation successful
0811 18:47:34.211061 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9410,"thread_start_us":9238,"threads_started":1}
I20260811 18:47:34.211490 1460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:34.190685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:42239 (local address 127.0.0.1:53450)
0811 18:47:34.202845 (+ 12160us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:34.202863 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:34.203110 (+ 247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:34.204100 (+ 990us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:34.204105 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:34.204129 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:34.204605 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:34.204619 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.206956 (+ 2337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.206962 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:34.208517 (+ 1555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:34.208533 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.210373 (+ 1840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.210379 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:34.210604 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:34.210652 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 18:47:34.210794 (+ 142us) client_negotiation.cc:240] Negotiation successful
0811 18:47:34.210993 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12034,"mutex_wait_us":4,"thread_start_us":10335,"threads_started":1}
I20260811 18:47:34.211529 1461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:34.190486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:38263 (local address 127.0.0.1:37470)
0811 18:47:34.201491 (+ 11005us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:34.201547 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:34.201785 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:34.203457 (+ 1672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:34.203465 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:34.203617 (+ 152us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:34.204114 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:34.204133 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.206198 (+ 2065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.206203 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:34.208739 (+ 2536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:34.208754 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.210698 (+ 1944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.210706 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:34.210889 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:34.210934 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 18:47:34.211004 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 18:47:34.211139 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10675,"thread_start_us":12009,"threads_started":1}
I20260811 18:47:34.212352 1463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:34.190759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37470 (local address 127.25.25.2:38263)
0811 18:47:34.202421 (+ 11662us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:34.202443 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:34.202478 (+ 35us) server_negotiation.cc:407] Connection header received
0811 18:47:34.202662 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:34.202677 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:34.203122 (+ 445us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:34.204281 (+ 1159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:34.204533 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.206059 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.208906 (+ 2847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.210237 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.210360 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:34.210548 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:34.211815 (+ 1267us) server_negotiation.cc:299] Negotiation successful
0811 18:47:34.212002 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11506,"thread_start_us":11367,"threads_started":1}
I20260811 18:47:34.214160 1466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:34.193329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:36099 (local address 127.0.0.1:60858)
0811 18:47:34.204975 (+ 11646us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:34.204993 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:34.205114 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:34.205986 (+ 872us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:34.205991 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:34.206015 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:34.206409 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:34.206423 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.208450 (+ 2027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.208455 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:34.210846 (+ 2391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:34.210860 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.213509 (+ 2649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.213514 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:34.213628 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:34.213652 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 18:47:34.213742 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 18:47:34.213864 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11519,"thread_start_us":11289,"threads_started":1}
I20260811 18:47:34.214847 1468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:34.193895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60858 (local address 127.25.25.1:36099)
0811 18:47:34.204422 (+ 10527us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:34.204432 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:34.205243 (+ 811us) server_negotiation.cc:407] Connection header received
0811 18:47:34.205348 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:34.205355 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:34.205603 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:34.205786 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:34.206611 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.208264 (+ 1653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.211032 (+ 2768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.213046 (+ 2014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.213173 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:34.213408 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:34.214458 (+ 1050us) server_negotiation.cc:299] Negotiation successful
0811 18:47:34.214620 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10320,"thread_start_us":10110,"threads_started":1}
I20260811 18:47:34.215873 1330 tablet_service.cc:1467] Processing CreateTablet for tablet a7743fd0b34e49e1a90950f668599734 (DEFAULT_TABLE table=test-table [id=d361c36b9c4241fab6a88a316775f7b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:34.216338 1072 tablet_service.cc:1467] Processing CreateTablet for tablet a7743fd0b34e49e1a90950f668599734 (DEFAULT_TABLE table=test-table [id=d361c36b9c4241fab6a88a316775f7b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:34.217491 1330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7743fd0b34e49e1a90950f668599734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:34.217700 1072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7743fd0b34e49e1a90950f668599734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:34.217896 825 tablet_service.cc:1467] Processing CreateTablet for tablet a7743fd0b34e49e1a90950f668599734 (DEFAULT_TABLE table=test-table [id=d361c36b9c4241fab6a88a316775f7b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:34.219017 825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7743fd0b34e49e1a90950f668599734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:34.232533 1469 tablet_bootstrap.cc:492] T a7743fd0b34e49e1a90950f668599734 P 74ab25ec201749f6bbda2b92ac9b8aff: Bootstrap starting.
I20260811 18:47:34.232534 1470 tablet_bootstrap.cc:492] T a7743fd0b34e49e1a90950f668599734 P 75a847aef0594f8589996c8c6bdba567: Bootstrap starting.
I20260811 18:47:34.234095 1475 tablet_bootstrap.cc:492] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3: Bootstrap starting.
I20260811 18:47:34.236398 1469 tablet_bootstrap.cc:654] T a7743fd0b34e49e1a90950f668599734 P 74ab25ec201749f6bbda2b92ac9b8aff: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:34.236410 1470 tablet_bootstrap.cc:654] T a7743fd0b34e49e1a90950f668599734 P 75a847aef0594f8589996c8c6bdba567: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:34.237054 1475 tablet_bootstrap.cc:654] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:34.237784 1470 log.cc:824] T a7743fd0b34e49e1a90950f668599734 P 75a847aef0594f8589996c8c6bdba567: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:34.237784 1469 log.cc:824] T a7743fd0b34e49e1a90950f668599734 P 74ab25ec201749f6bbda2b92ac9b8aff: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:34.238070 1475 log.cc:824] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:34.241730 1470 tablet_bootstrap.cc:492] T a7743fd0b34e49e1a90950f668599734 P 75a847aef0594f8589996c8c6bdba567: No bootstrap required, opened a new log
I20260811 18:47:34.241950 1469 tablet_bootstrap.cc:492] T a7743fd0b34e49e1a90950f668599734 P 74ab25ec201749f6bbda2b92ac9b8aff: No bootstrap required, opened a new log
I20260811 18:47:34.242063 1470 ts_tablet_manager.cc:1397] T a7743fd0b34e49e1a90950f668599734 P 75a847aef0594f8589996c8c6bdba567: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260811 18:47:34.242259 1469 ts_tablet_manager.cc:1397] T a7743fd0b34e49e1a90950f668599734 P 74ab25ec201749f6bbda2b92ac9b8aff: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.000s
I20260811 18:47:34.242520 1475 tablet_bootstrap.cc:492] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3: No bootstrap required, opened a new log
I20260811 18:47:34.242822 1475 ts_tablet_manager.cc:1397] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260811 18:47:34.253594 1469 raft_consensus.cc:348] T a7743fd0b34e49e1a90950f668599734 P 74ab25ec201749f6bbda2b92ac9b8aff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a847aef0594f8589996c8c6bdba567" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 38263 } } peers { permanent_uuid: "a362ae4bce20440aa6b6872cc728d0c3" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 42239 } } peers { permanent_uuid: "74ab25ec201749f6bbda2b92ac9b8aff" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 36099 } }
I20260811 18:47:34.253808 1470 raft_consensus.cc:348] T a7743fd0b34e49e1a90950f668599734 P 75a847aef0594f8589996c8c6bdba567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a847aef0594f8589996c8c6bdba567" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 38263 } } peers { permanent_uuid: "a362ae4bce20440aa6b6872cc728d0c3" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 42239 } } peers { permanent_uuid: "74ab25ec201749f6bbda2b92ac9b8aff" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 36099 } }
I20260811 18:47:34.254196 1469 raft_consensus.cc:374] T a7743fd0b34e49e1a90950f668599734 P 74ab25ec201749f6bbda2b92ac9b8aff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:34.254266 1470 raft_consensus.cc:374] T a7743fd0b34e49e1a90950f668599734 P 75a847aef0594f8589996c8c6bdba567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:34.254302 1469 raft_consensus.cc:729] T a7743fd0b34e49e1a90950f668599734 P 74ab25ec201749f6bbda2b92ac9b8aff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ab25ec201749f6bbda2b92ac9b8aff, State: Initialized, Role: FOLLOWER
I20260811 18:47:34.254355 1470 raft_consensus.cc:729] T a7743fd0b34e49e1a90950f668599734 P 75a847aef0594f8589996c8c6bdba567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75a847aef0594f8589996c8c6bdba567, State: Initialized, Role: FOLLOWER
I20260811 18:47:34.255100 1470 consensus_queue.cc:260] T a7743fd0b34e49e1a90950f668599734 P 75a847aef0594f8589996c8c6bdba567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a847aef0594f8589996c8c6bdba567" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 38263 } } peers { permanent_uuid: "a362ae4bce20440aa6b6872cc728d0c3" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 42239 } } peers { permanent_uuid: "74ab25ec201749f6bbda2b92ac9b8aff" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 36099 } }
I20260811 18:47:34.255198 1469 consensus_queue.cc:260] T a7743fd0b34e49e1a90950f668599734 P 74ab25ec201749f6bbda2b92ac9b8aff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a847aef0594f8589996c8c6bdba567" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 38263 } } peers { permanent_uuid: "a362ae4bce20440aa6b6872cc728d0c3" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 42239 } } peers { permanent_uuid: "74ab25ec201749f6bbda2b92ac9b8aff" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 36099 } }
I20260811 18:47:34.255931 1475 raft_consensus.cc:348] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a847aef0594f8589996c8c6bdba567" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 38263 } } peers { permanent_uuid: "a362ae4bce20440aa6b6872cc728d0c3" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 42239 } } peers { permanent_uuid: "74ab25ec201749f6bbda2b92ac9b8aff" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 36099 } }
I20260811 18:47:34.256522 1475 raft_consensus.cc:374] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:34.256623 1475 raft_consensus.cc:729] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a362ae4bce20440aa6b6872cc728d0c3, State: Initialized, Role: FOLLOWER
I20260811 18:47:34.257556 1475 consensus_queue.cc:260] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a847aef0594f8589996c8c6bdba567" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 38263 } } peers { permanent_uuid: "a362ae4bce20440aa6b6872cc728d0c3" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 42239 } } peers { permanent_uuid: "74ab25ec201749f6bbda2b92ac9b8aff" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 36099 } }
I20260811 18:47:34.260752 1469 ts_tablet_manager.cc:1428] T a7743fd0b34e49e1a90950f668599734 P 74ab25ec201749f6bbda2b92ac9b8aff: Time spent starting tablet: real 0.018s user 0.014s sys 0.005s
I20260811 18:47:34.270306 1197 heartbeater.cc:503] Master 127.25.25.62:46869 was elected leader, sending a full tablet report...
I20260811 18:47:34.270792 1441 heartbeater.cc:503] Master 127.25.25.62:46869 was elected leader, sending a full tablet report...
I20260811 18:47:34.271108 1470 ts_tablet_manager.cc:1428] T a7743fd0b34e49e1a90950f668599734 P 75a847aef0594f8589996c8c6bdba567: Time spent starting tablet: real 0.029s user 0.012s sys 0.016s
I20260811 18:47:34.271625 1475 ts_tablet_manager.cc:1428] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3: Time spent starting tablet: real 0.029s user 0.019s sys 0.005s
W20260811 18:47:34.305205 1201 tablet.cc:2369] T a7743fd0b34e49e1a90950f668599734 P 75a847aef0594f8589996c8c6bdba567: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:47:34.341578 1499 raft_consensus.cc:482] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:47:34.341903 1499 raft_consensus.cc:504] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a847aef0594f8589996c8c6bdba567" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 38263 } } peers { permanent_uuid: "a362ae4bce20440aa6b6872cc728d0c3" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 42239 } } peers { permanent_uuid: "74ab25ec201749f6bbda2b92ac9b8aff" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 36099 } }
I20260811 18:47:34.343773 1499 leader_election.cc:288] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75a847aef0594f8589996c8c6bdba567 (127.25.25.2:38263), 74ab25ec201749f6bbda2b92ac9b8aff (127.25.25.1:36099)
I20260811 18:47:34.350708 1447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:34.344256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:38263 (local address 127.25.25.3:53691)
0811 18:47:34.344463 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:34.344483 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:34.344618 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:34.345495 (+ 877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:34.345501 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:34.345532 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:34.345726 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:34.345738 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.346986 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.346990 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:34.348727 (+ 1737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:34.348744 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.350065 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.350069 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:34.350207 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:34.350234 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 18:47:34.350309 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 18:47:34.350409 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 18:47:34.350817 1463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:34.344912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:53691 (local address 127.25.25.2:38263)
0811 18:47:34.345137 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:34.345144 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:34.345166 (+ 22us) server_negotiation.cc:407] Connection header received
0811 18:47:34.345251 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:34.345257 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:34.345339 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:34.345442 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:34.345866 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.346841 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.348917 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.349895 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.350062 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:34.350182 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:34.350360 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 18:47:34.350509 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 18:47:34.352011 1468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:34.344364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:55553 (local address 127.25.25.1:36099)
0811 18:47:34.344568 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:34.344574 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:34.345547 (+ 973us) server_negotiation.cc:407] Connection header received
0811 18:47:34.345834 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:34.345841 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:34.345922 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:34.346021 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:34.346583 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.347726 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.349819 (+ 2093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.351108 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.351258 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:34.351377 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:34.351721 (+ 344us) server_negotiation.cc:299] Negotiation successful
0811 18:47:34.351827 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 18:47:34.352294 1500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:34.344279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:36099 (local address 127.25.25.3:55553)
0811 18:47:34.345429 (+ 1150us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:34.345453 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:34.345645 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:34.346050 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:34.346055 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:34.346082 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:34.346402 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:34.346414 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.347902 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.347908 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:34.349610 (+ 1702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:34.349624 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.351365 (+ 1741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.351373 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:34.351539 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:34.351578 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 18:47:34.351693 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 18:47:34.351838 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1024,"mutex_wait_us":429,"thread_start_us":414,"threads_started":1}
I20260811 18:47:34.352177 1111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7743fd0b34e49e1a90950f668599734" candidate_uuid: "a362ae4bce20440aa6b6872cc728d0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a847aef0594f8589996c8c6bdba567" is_pre_election: true
I20260811 18:47:34.352905 1111 raft_consensus.cc:2454] T a7743fd0b34e49e1a90950f668599734 P 75a847aef0594f8589996c8c6bdba567 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a362ae4bce20440aa6b6872cc728d0c3 in term 0.
I20260811 18:47:34.353366 858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7743fd0b34e49e1a90950f668599734" candidate_uuid: "a362ae4bce20440aa6b6872cc728d0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ab25ec201749f6bbda2b92ac9b8aff" is_pre_election: true
I20260811 18:47:34.353721 1249 leader_election.cc:302] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75a847aef0594f8589996c8c6bdba567, a362ae4bce20440aa6b6872cc728d0c3; no voters:
I20260811 18:47:34.353884 858 raft_consensus.cc:2454] T a7743fd0b34e49e1a90950f668599734 P 74ab25ec201749f6bbda2b92ac9b8aff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a362ae4bce20440aa6b6872cc728d0c3 in term 0.
I20260811 18:47:34.354143 1499 raft_consensus.cc:2781] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:47:34.354296 1499 raft_consensus.cc:482] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:47:34.354439 1499 raft_consensus.cc:3037] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:34.356900 1499 raft_consensus.cc:504] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a847aef0594f8589996c8c6bdba567" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 38263 } } peers { permanent_uuid: "a362ae4bce20440aa6b6872cc728d0c3" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 42239 } } peers { permanent_uuid: "74ab25ec201749f6bbda2b92ac9b8aff" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 36099 } }
I20260811 18:47:34.357605 1499 leader_election.cc:288] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3 [CANDIDATE]: Term 1 election: Requested vote from peers 75a847aef0594f8589996c8c6bdba567 (127.25.25.2:38263), 74ab25ec201749f6bbda2b92ac9b8aff (127.25.25.1:36099)
I20260811 18:47:34.358084 1111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7743fd0b34e49e1a90950f668599734" candidate_uuid: "a362ae4bce20440aa6b6872cc728d0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a847aef0594f8589996c8c6bdba567"
I20260811 18:47:34.358182 858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7743fd0b34e49e1a90950f668599734" candidate_uuid: "a362ae4bce20440aa6b6872cc728d0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ab25ec201749f6bbda2b92ac9b8aff"
I20260811 18:47:34.358347 1111 raft_consensus.cc:3037] T a7743fd0b34e49e1a90950f668599734 P 75a847aef0594f8589996c8c6bdba567 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:34.358485 858 raft_consensus.cc:3037] T a7743fd0b34e49e1a90950f668599734 P 74ab25ec201749f6bbda2b92ac9b8aff [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:34.361989 858 raft_consensus.cc:2454] T a7743fd0b34e49e1a90950f668599734 P 74ab25ec201749f6bbda2b92ac9b8aff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a362ae4bce20440aa6b6872cc728d0c3 in term 1.
I20260811 18:47:34.361989 1111 raft_consensus.cc:2454] T a7743fd0b34e49e1a90950f668599734 P 75a847aef0594f8589996c8c6bdba567 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a362ae4bce20440aa6b6872cc728d0c3 in term 1.
I20260811 18:47:34.362676 1243 leader_election.cc:302] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ab25ec201749f6bbda2b92ac9b8aff, a362ae4bce20440aa6b6872cc728d0c3; no voters:
I20260811 18:47:34.363108 1499 raft_consensus.cc:2781] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:34.363626 1499 raft_consensus.cc:686] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3 [term 1 LEADER]: Becoming Leader. State: Replica: a362ae4bce20440aa6b6872cc728d0c3, State: Running, Role: LEADER
I20260811 18:47:34.364379 1499 consensus_queue.cc:237] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a847aef0594f8589996c8c6bdba567" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 38263 } } peers { permanent_uuid: "a362ae4bce20440aa6b6872cc728d0c3" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 42239 } } peers { permanent_uuid: "74ab25ec201749f6bbda2b92ac9b8aff" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 36099 } }
W20260811 18:47:34.365741 1443 tablet.cc:2369] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:47:34.369684 615 catalog_manager.cc:5495] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to a362ae4bce20440aa6b6872cc728d0c3 (127.25.25.3). New cstate: current_term: 1 leader_uuid: "a362ae4bce20440aa6b6872cc728d0c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a847aef0594f8589996c8c6bdba567" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 38263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a362ae4bce20440aa6b6872cc728d0c3" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ab25ec201749f6bbda2b92ac9b8aff" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 36099 } health_report { overall_health: UNKNOWN } } }
I20260811 18:47:34.417001 1464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:34.411346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53454 (local address 127.25.25.3:42239)
0811 18:47:34.411528 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:34.411533 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:34.411551 (+ 18us) server_negotiation.cc:407] Connection header received
0811 18:47:34.411650 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:34.411654 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:34.411736 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:34.411872 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:47:34.412293 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.413084 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.414617 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.415058 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.415193 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:34.415758 (+ 565us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:47:34.416434 (+ 676us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:47:34.416562 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:34.416698 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 18:47:34.416781 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 18:47:34.426028 858 raft_consensus.cc:1261] T a7743fd0b34e49e1a90950f668599734 P 74ab25ec201749f6bbda2b92ac9b8aff [term 1 FOLLOWER]: Refusing update from remote peer a362ae4bce20440aa6b6872cc728d0c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:47:34.426028 1111 raft_consensus.cc:1261] T a7743fd0b34e49e1a90950f668599734 P 75a847aef0594f8589996c8c6bdba567 [term 1 FOLLOWER]: Refusing update from remote peer a362ae4bce20440aa6b6872cc728d0c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:47:34.427085 1501 consensus_queue.cc:1035] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75a847aef0594f8589996c8c6bdba567" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 38263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:47:34.427451 1499 consensus_queue.cc:1035] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ab25ec201749f6bbda2b92ac9b8aff" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 36099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:47:34.439924 1512 mvcc.cc:205] Tried to move back new op lower bound from 7317397726918078464 to 7317397726681489408. Current Snapshot: MvccSnapshot[applied={T|T < 7317397726918078464}]
I20260811 18:47:34.455883 613 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56564:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:47:34.456241 613 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56564:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:47:34.460275 613 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c5b5a7d5df6542c190aa9262df154fd5: Sending DeleteTablet for 3 replicas of tablet a7743fd0b34e49e1a90950f668599734
I20260811 18:47:34.461706 1072 tablet_service.cc:1514] Processing DeleteTablet for tablet a7743fd0b34e49e1a90950f668599734 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:34 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:37470
I20260811 18:47:34.461717 1330 tablet_service.cc:1514] Processing DeleteTablet for tablet a7743fd0b34e49e1a90950f668599734 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:34 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:53450
I20260811 18:47:34.461790 825 tablet_service.cc:1514] Processing DeleteTablet for tablet a7743fd0b34e49e1a90950f668599734 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:34 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:60858
I20260811 18:47:34.465098 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 717
I20260811 18:47:34.479601 1524 tablet_replica.cc:330] T a7743fd0b34e49e1a90950f668599734 P 75a847aef0594f8589996c8c6bdba567: stopping tablet replica
I20260811 18:47:34.480227 1524 raft_consensus.cc:2229] T a7743fd0b34e49e1a90950f668599734 P 75a847aef0594f8589996c8c6bdba567 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:47:34.480911 1524 raft_consensus.cc:2258] T a7743fd0b34e49e1a90950f668599734 P 75a847aef0594f8589996c8c6bdba567 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:34.483577 1526 tablet_replica.cc:330] T a7743fd0b34e49e1a90950f668599734 P 74ab25ec201749f6bbda2b92ac9b8aff: stopping tablet replica
I20260811 18:47:34.485399 1526 raft_consensus.cc:2229] T a7743fd0b34e49e1a90950f668599734 P 74ab25ec201749f6bbda2b92ac9b8aff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:47:34.485718 1524 ts_tablet_manager.cc:1905] T a7743fd0b34e49e1a90950f668599734 P 75a847aef0594f8589996c8c6bdba567: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:34.488560 1526 raft_consensus.cc:2258] T a7743fd0b34e49e1a90950f668599734 P 74ab25ec201749f6bbda2b92ac9b8aff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:34.492303 1525 tablet_replica.cc:330] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3: stopping tablet replica
I20260811 18:47:34.492882 1525 raft_consensus.cc:2229] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:47:34.493606 1524 ts_tablet_manager.cc:1918] T a7743fd0b34e49e1a90950f668599734 P 75a847aef0594f8589996c8c6bdba567: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:47:34.493630 1525 raft_consensus.cc:2258] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:34.493803 1524 log.cc:1196] T a7743fd0b34e49e1a90950f668599734 P 75a847aef0594f8589996c8c6bdba567: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-1/wal/wals/a7743fd0b34e49e1a90950f668599734
I20260811 18:47:34.494244 1526 ts_tablet_manager.cc:1905] T a7743fd0b34e49e1a90950f668599734 P 74ab25ec201749f6bbda2b92ac9b8aff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:34.494407 1524 ts_tablet_manager.cc:1939] T a7743fd0b34e49e1a90950f668599734 P 75a847aef0594f8589996c8c6bdba567: Deleting consensus metadata
I20260811 18:47:34.495935 1525 ts_tablet_manager.cc:1905] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:34.496555 588 catalog_manager.cc:4841] TS 75a847aef0594f8589996c8c6bdba567 (127.25.25.2:38263): tablet a7743fd0b34e49e1a90950f668599734 (table test-table [id=d361c36b9c4241fab6a88a316775f7b9]) successfully deleted
Aug 11 18:47:34 dist-test-slave-lgr5 krb5kdc[547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474051, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.1@KRBTEST.COM
I20260811 18:47:34.503832 1526 ts_tablet_manager.cc:1918] T a7743fd0b34e49e1a90950f668599734 P 74ab25ec201749f6bbda2b92ac9b8aff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:47:34.504143 1526 log.cc:1196] T a7743fd0b34e49e1a90950f668599734 P 74ab25ec201749f6bbda2b92ac9b8aff: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-0/wal/wals/a7743fd0b34e49e1a90950f668599734
I20260811 18:47:34.504189 1525 ts_tablet_manager.cc:1918] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:47:34.504390 1525 log.cc:1196] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474012733352-25700-0/minicluster-data/ts-2/wal/wals/a7743fd0b34e49e1a90950f668599734
I20260811 18:47:34.504911 1526 ts_tablet_manager.cc:1939] T a7743fd0b34e49e1a90950f668599734 P 74ab25ec201749f6bbda2b92ac9b8aff: Deleting consensus metadata
I20260811 18:47:34.504992 1525 ts_tablet_manager.cc:1939] T a7743fd0b34e49e1a90950f668599734 P a362ae4bce20440aa6b6872cc728d0c3: Deleting consensus metadata
I20260811 18:47:34.507133 586 catalog_manager.cc:4841] TS a362ae4bce20440aa6b6872cc728d0c3 (127.25.25.3:42239): tablet a7743fd0b34e49e1a90950f668599734 (table test-table [id=d361c36b9c4241fab6a88a316775f7b9]) successfully deleted
I20260811 18:47:34.507282 585 catalog_manager.cc:4841] TS 74ab25ec201749f6bbda2b92ac9b8aff (127.25.25.1:36099): tablet a7743fd0b34e49e1a90950f668599734 (table test-table [id=d361c36b9c4241fab6a88a316775f7b9]) successfully deleted
I20260811 18:47:34.510638 1468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:34.467450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60860 (local address 127.25.25.1:36099)
0811 18:47:34.467670 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:34.467677 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:34.484286 (+ 16609us) server_negotiation.cc:407] Connection header received
0811 18:47:34.485759 (+ 1473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:34.485766 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:34.485907 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:34.486006 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:34.489124 (+ 3118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.490374 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.496580 (+ 6206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.497210 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.497368 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:34.503209 (+ 5841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:34.503228 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:34.503250 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:34.503310 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:34.507436 (+ 4126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:34.508244 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:34.508253 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:34.508256 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:34.508406 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:34.508818 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:34.508823 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:34.508825 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:34.509202 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:34.509540 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:34.509859 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 18:47:34.510094 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 18:47:34.511442 932 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:34.620428 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 717
I20260811 18:47:34.651926 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 947
Aug 11 18:47:34 dist-test-slave-lgr5 krb5kdc[547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474051, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.2@KRBTEST.COM
I20260811 18:47:34.670732 1463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:34.652878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37482 (local address 127.25.25.2:38263)
0811 18:47:34.653050 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:34.653055 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:34.653075 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:47:34.653320 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:34.653325 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:34.653426 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:34.653530 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:34.655362 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.656286 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.658236 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.658681 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.658800 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:34.664367 (+ 5567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:34.664388 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:34.664406 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:34.664462 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:34.667504 (+ 3042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:34.668541 (+ 1037us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:34.668550 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:34.668553 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:34.668740 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:34.669137 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:34.669140 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:34.669142 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:34.669605 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:34.669844 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:34.670217 (+ 373us) server_negotiation.cc:299] Negotiation successful
0811 18:47:34.670424 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 18:47:34.671504 1190 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:34.765092 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 947
I20260811 18:47:34.813634 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 1211
Aug 11 18:47:34 dist-test-slave-lgr5 krb5kdc[547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474051, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.3@KRBTEST.COM
I20260811 18:47:34.833027 1464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:34.814602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53468 (local address 127.25.25.3:42239)
0811 18:47:34.814828 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:34.814833 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:34.814858 (+ 25us) server_negotiation.cc:407] Connection header received
0811 18:47:34.815106 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:34.815110 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:34.815188 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:34.815290 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:34.817308 (+ 2018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.818246 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.820414 (+ 2168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:34.820973 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:34.821144 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:34.826137 (+ 4993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:34.826154 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:34.826172 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:34.826231 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:34.829680 (+ 3449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:34.830689 (+ 1009us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:34.830697 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:34.830700 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:34.830884 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:34.831304 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:34.831307 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:34.831310 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:34.831708 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:34.831943 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:34.832531 (+ 588us) server_negotiation.cc:299] Negotiation successful
0811 18:47:34.832728 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 18:47:34.833755 1429 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:34.963286 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 1211
I20260811 18:47:34.989341 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 564
I20260811 18:47:34.990545 660 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:35.103495 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 564
2026-08-11T18:47:35Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4742 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T18:47:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:47:35Z Disabled control of system clock
I20260811 18:47:35.189366 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:35335
--webserver_interface=127.25.25.62
--webserver_port=0
--builtin_ntp_servers=127.25.25.20:38651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:35335
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 18:47:35.545369 1539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:35.545701 1539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:35.545789 1539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:35.553278 1539 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:47:35.553406 1539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:35.553450 1539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:35.553508 1539 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:47:35.553553 1539 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:47:35.563146 1539 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:38651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:35335
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:35335
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:35.564548 1539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:35.566489 1539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:35.579403 1551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:35.579353 1549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:35.579979 1548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:35.580736 1539 server_base.cc:1034] running on GCE node
I20260811 18:47:35.581637 1539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:35.583185 1539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:35.584412 1539 hybrid_clock.cc:648] HybridClock initialized: now 1786474055584351 us; error 39 us; skew 500 ppm
I20260811 18:47:35.584779 1539 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:47:35.587211 1539 webserver.cc:460] Webserver started at http://127.25.25.62:35809/ using document root <none> and password file <none>
I20260811 18:47:35.587986 1539 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:35.588107 1539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:35.588444 1539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:35.591707 1539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "f530d58bd554498cab4f02cc6d47ac23"
format_stamp: "Formatted at 2026-08-11 18:47:35 on dist-test-slave-lgr5"
server_key: "ef251167850a2964c7dc332a36a257b0"
server_key_iv: "81806c25a60d8cfb2c14c500c26a7efc"
server_key_version: "encryptionkey@0"
I20260811 18:47:35.592677 1539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "f530d58bd554498cab4f02cc6d47ac23"
format_stamp: "Formatted at 2026-08-11 18:47:35 on dist-test-slave-lgr5"
server_key: "ef251167850a2964c7dc332a36a257b0"
server_key_iv: "81806c25a60d8cfb2c14c500c26a7efc"
server_key_version: "encryptionkey@0"
I20260811 18:47:35.598625 1539 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 18:47:35.602977 1568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:35.604707 1539 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 18:47:35.604928 1539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "f530d58bd554498cab4f02cc6d47ac23"
format_stamp: "Formatted at 2026-08-11 18:47:35 on dist-test-slave-lgr5"
server_key: "ef251167850a2964c7dc332a36a257b0"
server_key_iv: "81806c25a60d8cfb2c14c500c26a7efc"
server_key_version: "encryptionkey@0"
I20260811 18:47:35.605172 1539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:35.611397 1539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:35.612345 1539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:35.612687 1539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:35.630779 1539 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:35335
I20260811 18:47:35.630795 1669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:35335 every 8 connection(s)
I20260811 18:47:35.632560 1539 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:47:35.635135 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 1539
I20260811 18:47:35.635377 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:47:35.636344 25700 external_mini_cluster.cc:1428] Setting key c50f3b4daf20034eedf619001c887d9a
I20260811 18:47:35.638202 1671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:35.646283 1679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:35.638951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41306 (local address 127.25.25.62:35335)
0811 18:47:35.640183 (+ 1232us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:35.640196 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:35.640258 (+ 62us) server_negotiation.cc:407] Connection header received
0811 18:47:35.642001 (+ 1743us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:35.642035 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:35.642568 (+ 533us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:35.642981 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:35.644252 (+ 1271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:35.644261 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:35.644342 (+ 81us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:47:35.644364 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:35.644467 (+ 103us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:47:35.644490 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:35.644699 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:35.644838 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 18:47:35.645157 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":699,"thread_start_us":468,"threads_started":1}
I20260811 18:47:35.652436 1671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f530d58bd554498cab4f02cc6d47ac23: Bootstrap starting.
I20260811 18:47:35.656040 1671 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f530d58bd554498cab4f02cc6d47ac23: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:35.657225 1671 log.cc:824] T 00000000000000000000000000000000 P f530d58bd554498cab4f02cc6d47ac23: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:35.660495 1671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f530d58bd554498cab4f02cc6d47ac23: No bootstrap required, opened a new log
I20260811 18:47:35.668358 1671 raft_consensus.cc:348] T 00000000000000000000000000000000 P f530d58bd554498cab4f02cc6d47ac23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f530d58bd554498cab4f02cc6d47ac23" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 35335 } }
I20260811 18:47:35.668807 1671 raft_consensus.cc:374] T 00000000000000000000000000000000 P f530d58bd554498cab4f02cc6d47ac23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:35.668892 1671 raft_consensus.cc:729] T 00000000000000000000000000000000 P f530d58bd554498cab4f02cc6d47ac23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f530d58bd554498cab4f02cc6d47ac23, State: Initialized, Role: FOLLOWER
I20260811 18:47:35.669487 1671 consensus_queue.cc:260] T 00000000000000000000000000000000 P f530d58bd554498cab4f02cc6d47ac23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f530d58bd554498cab4f02cc6d47ac23" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 35335 } }
I20260811 18:47:35.669720 1671 raft_consensus.cc:388] T 00000000000000000000000000000000 P f530d58bd554498cab4f02cc6d47ac23 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:47:35.669819 1671 raft_consensus.cc:482] T 00000000000000000000000000000000 P f530d58bd554498cab4f02cc6d47ac23 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:47:35.669965 1671 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f530d58bd554498cab4f02cc6d47ac23 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:35.672331 1671 raft_consensus.cc:504] T 00000000000000000000000000000000 P f530d58bd554498cab4f02cc6d47ac23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f530d58bd554498cab4f02cc6d47ac23" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 35335 } }
I20260811 18:47:35.673048 1671 leader_election.cc:302] T 00000000000000000000000000000000 P f530d58bd554498cab4f02cc6d47ac23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f530d58bd554498cab4f02cc6d47ac23; no voters:
I20260811 18:47:35.673705 1671 leader_election.cc:288] T 00000000000000000000000000000000 P f530d58bd554498cab4f02cc6d47ac23 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:47:35.673859 1682 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f530d58bd554498cab4f02cc6d47ac23 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:35.674930 1682 raft_consensus.cc:686] T 00000000000000000000000000000000 P f530d58bd554498cab4f02cc6d47ac23 [term 1 LEADER]: Becoming Leader. State: Replica: f530d58bd554498cab4f02cc6d47ac23, State: Running, Role: LEADER
I20260811 18:47:35.675643 1682 consensus_queue.cc:237] T 00000000000000000000000000000000 P f530d58bd554498cab4f02cc6d47ac23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f530d58bd554498cab4f02cc6d47ac23" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 35335 } }
I20260811 18:47:35.677065 1671 sys_catalog.cc:564] T 00000000000000000000000000000000 P f530d58bd554498cab4f02cc6d47ac23 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:47:35.681366 1686 sys_catalog.cc:455] T 00000000000000000000000000000000 P f530d58bd554498cab4f02cc6d47ac23 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f530d58bd554498cab4f02cc6d47ac23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f530d58bd554498cab4f02cc6d47ac23" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 35335 } } }
I20260811 18:47:35.681425 1684 sys_catalog.cc:455] T 00000000000000000000000000000000 P f530d58bd554498cab4f02cc6d47ac23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f530d58bd554498cab4f02cc6d47ac23. Latest consensus state: current_term: 1 leader_uuid: "f530d58bd554498cab4f02cc6d47ac23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f530d58bd554498cab4f02cc6d47ac23" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 35335 } } }
I20260811 18:47:35.681890 1686 sys_catalog.cc:458] T 00000000000000000000000000000000 P f530d58bd554498cab4f02cc6d47ac23 [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:35.681896 1684 sys_catalog.cc:458] T 00000000000000000000000000000000 P f530d58bd554498cab4f02cc6d47ac23 [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:35.683738 1691 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:47:35.689039 1691 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:47:35.699087 1691 catalog_manager.cc:1347] Generated new cluster ID: 77504f4ed2854bba9374f29529022f38
I20260811 18:47:35.699231 1691 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:47:35.723174 1691 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:47:35.723666 1691 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:47:35.731650 1691 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f530d58bd554498cab4f02cc6d47ac23: Generated new TSK 0
I20260811 18:47:35.732632 1691 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:47:35.737967 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:0
--local_ip_for_outbound_sockets=127.25.25.1
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:35335
--builtin_ntp_servers=127.25.25.20:38651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 18:47:36.119433 1719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:36.119771 1719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:36.119921 1719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:36.127664 1719 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:36.127787 1719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:36.127939 1719 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:47:36.137815 1719 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:38651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:35335
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:36.139492 1719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:36.141654 1719 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:36.156560 1731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:36.156466 1729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:36.156497 1734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:36.162184 1719 server_base.cc:1034] running on GCE node
I20260811 18:47:36.163021 1719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:36.164252 1719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:36.165508 1719 hybrid_clock.cc:648] HybridClock initialized: now 1786474056165440 us; error 73 us; skew 500 ppm
I20260811 18:47:36.165891 1719 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:47:36.168804 1719 webserver.cc:460] Webserver started at http://127.25.25.1:33901/ using document root <none> and password file <none>
I20260811 18:47:36.169631 1719 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:36.169759 1719 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:36.170128 1719 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:36.173492 1719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-0/data/instance:
uuid: "879daa9b8b1b4c858b2238c78eac603e"
format_stamp: "Formatted at 2026-08-11 18:47:36 on dist-test-slave-lgr5"
server_key: "05b1981754e1522534fcb8e55ce0623a"
server_key_iv: "673a94e3852cddc4fb32b248e97a7d9f"
server_key_version: "encryptionkey@0"
I20260811 18:47:36.174454 1719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance:
uuid: "879daa9b8b1b4c858b2238c78eac603e"
format_stamp: "Formatted at 2026-08-11 18:47:36 on dist-test-slave-lgr5"
server_key: "05b1981754e1522534fcb8e55ce0623a"
server_key_iv: "673a94e3852cddc4fb32b248e97a7d9f"
server_key_version: "encryptionkey@0"
I20260811 18:47:36.180827 1719 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260811 18:47:36.185009 1751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:36.186527 1719 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260811 18:47:36.186717 1719 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "879daa9b8b1b4c858b2238c78eac603e"
format_stamp: "Formatted at 2026-08-11 18:47:36 on dist-test-slave-lgr5"
server_key: "05b1981754e1522534fcb8e55ce0623a"
server_key_iv: "673a94e3852cddc4fb32b248e97a7d9f"
server_key_version: "encryptionkey@0"
I20260811 18:47:36.186950 1719 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:36.193275 1719 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:36.194144 1719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:36.194406 1719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:36.195408 1719 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:47:36.196921 1719 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:36.197024 1719 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:36.197134 1719 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:36.197209 1719 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:36.230029 1719 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:37729
I20260811 18:47:36.230086 1973 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:37729 every 8 connection(s)
I20260811 18:47:36.231528 1719 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:47:36.239754 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 1719
I20260811 18:47:36.239951 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance
I20260811 18:47:36.240399 1981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:36.234314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:60343 (local address 127.25.25.62:35335)
0811 18:47:36.234766 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:36.234771 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:36.236130 (+ 1359us) server_negotiation.cc:407] Connection header received
0811 18:47:36.237943 (+ 1813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:36.237949 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:36.238020 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:36.238122 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:36.239562 (+ 1440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:36.239567 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:36.239570 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:47:36.239589 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:36.239636 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:47:36.239649 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:36.239768 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:36.239956 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 18:47:36.240030 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":225,"threads_started":1}
I20260811 18:47:36.240725 25700 external_mini_cluster.cc:1428] Setting key 2f9bb23d7ecb780f1ed692cf76ca4810
I20260811 18:47:36.241475 1984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:36.234964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:35335 (local address 127.25.25.1:60343)
0811 18:47:36.235933 (+ 969us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:36.235973 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:36.237642 (+ 1669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:36.238401 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:36.238411 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:36.238517 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:36.239211 (+ 694us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:47:36.239213 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:36.239254 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:47:36.239348 (+ 94us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:36.239744 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:36.239756 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:36.239764 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 18:47:36.240044 (+ 280us) client_negotiation.cc:240] Negotiation successful
0811 18:47:36.240362 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":263,"threads_started":1}
I20260811 18:47:36.243084 1975 heartbeater.cc:347] Connected to a master server at 127.25.25.62:35335
I20260811 18:47:36.243394 1975 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:36.243592 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:0
--local_ip_for_outbound_sockets=127.25.25.2
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:35335
--builtin_ntp_servers=127.25.25.20:38651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 18:47:36.244099 1975 heartbeater.cc:511] Master 127.25.25.62:35335 requested a full tablet report, sending...
I20260811 18:47:36.246276 1599 ts_manager.cc:194] Registered new tserver with Master: 879daa9b8b1b4c858b2238c78eac603e (127.25.25.1:37729)
W20260811 18:47:36.603432 1986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:36.603758 1986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:36.603853 1986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:36.611529 1986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:36.611660 1986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:36.611776 1986 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:47:36.621640 1986 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:38651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:35335
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:36.623010 1986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:36.624961 1986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:36.641695 1991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:36.641578 1998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:36.642134 1994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:36.642490 1986 server_base.cc:1034] running on GCE node
I20260811 18:47:36.643205 1986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:36.644248 1986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:36.645496 1986 hybrid_clock.cc:648] HybridClock initialized: now 1786474056645417 us; error 67 us; skew 500 ppm
I20260811 18:47:36.645845 1986 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:47:36.648415 1986 webserver.cc:460] Webserver started at http://127.25.25.2:33815/ using document root <none> and password file <none>
I20260811 18:47:36.649170 1986 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:36.649279 1986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:36.649617 1986 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:36.652678 1986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-1/data/instance:
uuid: "1e20b0908926475896bf58a903e188be"
format_stamp: "Formatted at 2026-08-11 18:47:36 on dist-test-slave-lgr5"
server_key: "fb2f3cbeb4ee4da2da64e669da3aa246"
server_key_iv: "8153dd9115057ccfb1651c4c0637b9b1"
server_key_version: "encryptionkey@0"
I20260811 18:47:36.653498 1986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance:
uuid: "1e20b0908926475896bf58a903e188be"
format_stamp: "Formatted at 2026-08-11 18:47:36 on dist-test-slave-lgr5"
server_key: "fb2f3cbeb4ee4da2da64e669da3aa246"
server_key_iv: "8153dd9115057ccfb1651c4c0637b9b1"
server_key_version: "encryptionkey@0"
I20260811 18:47:36.659086 1986 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 18:47:36.663518 2010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:36.665524 1986 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 18:47:36.665745 1986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "1e20b0908926475896bf58a903e188be"
format_stamp: "Formatted at 2026-08-11 18:47:36 on dist-test-slave-lgr5"
server_key: "fb2f3cbeb4ee4da2da64e669da3aa246"
server_key_iv: "8153dd9115057ccfb1651c4c0637b9b1"
server_key_version: "encryptionkey@0"
I20260811 18:47:36.666006 1986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:36.672593 1986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:36.673552 1986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:36.673836 1986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:36.674855 1986 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:47:36.676578 1986 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:36.676690 1986 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:36.676801 1986 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:36.676870 1986 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:36.712405 1986 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:44853
I20260811 18:47:36.712464 2219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:44853 every 8 connection(s)
I20260811 18:47:36.713923 1986 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:47:36.719934 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 1986
I20260811 18:47:36.720135 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance
I20260811 18:47:36.720569 25700 external_mini_cluster.cc:1428] Setting key d10516949ec46788f04ecc43f010886c
I20260811 18:47:36.723732 1981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:36.716884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:57775 (local address 127.25.25.62:35335)
0811 18:47:36.717111 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:36.717117 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:36.719049 (+ 1932us) server_negotiation.cc:407] Connection header received
0811 18:47:36.721335 (+ 2286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:36.721342 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:36.721407 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:36.721501 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:36.723011 (+ 1510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:36.723018 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:36.723022 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:47:36.723046 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:36.723091 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:47:36.723108 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:36.723253 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:36.723373 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 18:47:36.723444 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260811 18:47:36.723937 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:0
--local_ip_for_outbound_sockets=127.25.25.3
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:35335
--builtin_ntp_servers=127.25.25.20:38651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 18:47:36.724872 2224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:36.717508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:35335 (local address 127.25.25.2:57775)
0811 18:47:36.718829 (+ 1321us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:36.718887 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:36.720998 (+ 2111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:36.721796 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:36.721807 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:36.721920 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:36.722658 (+ 738us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:47:36.722661 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:36.722708 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:47:36.722818 (+ 110us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:36.723201 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:36.723208 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:36.723214 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 18:47:36.723489 (+ 275us) client_negotiation.cc:240] Negotiation successful
0811 18:47:36.723735 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":343,"threads_started":1}
I20260811 18:47:36.729638 2220 heartbeater.cc:347] Connected to a master server at 127.25.25.62:35335
I20260811 18:47:36.730023 2220 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:36.730733 2220 heartbeater.cc:511] Master 127.25.25.62:35335 requested a full tablet report, sending...
I20260811 18:47:36.732511 1599 ts_manager.cc:194] Registered new tserver with Master: 1e20b0908926475896bf58a903e188be (127.25.25.2:44853)
W20260811 18:47:37.075337 2228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:37.075675 2228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:37.075768 2228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:37.083616 2228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:37.083760 2228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:37.083881 2228 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:47:37.094174 2228 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:38651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:35335
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:37.095675 2228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:37.097927 2228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:37.113425 2235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:37.113401 2236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:37.113358 2243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:37.113811 2228 server_base.cc:1034] running on GCE node
I20260811 18:47:37.114707 2228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:37.115849 2228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:37.117071 2228 hybrid_clock.cc:648] HybridClock initialized: now 1786474057116996 us; error 62 us; skew 500 ppm
I20260811 18:47:37.117463 2228 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:47:37.120308 2228 webserver.cc:460] Webserver started at http://127.25.25.3:32833/ using document root <none> and password file <none>
I20260811 18:47:37.121124 2228 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:37.121236 2228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:37.121603 2228 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:37.125001 2228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-2/data/instance:
uuid: "30e52769566a46359ccabf998ae51550"
format_stamp: "Formatted at 2026-08-11 18:47:37 on dist-test-slave-lgr5"
server_key: "e228ab5af941a2b5d3a95b5fae0554a7"
server_key_iv: "61926bff9365adee24ff31417c99f861"
server_key_version: "encryptionkey@0"
I20260811 18:47:37.125972 2228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance:
uuid: "30e52769566a46359ccabf998ae51550"
format_stamp: "Formatted at 2026-08-11 18:47:37 on dist-test-slave-lgr5"
server_key: "e228ab5af941a2b5d3a95b5fae0554a7"
server_key_iv: "61926bff9365adee24ff31417c99f861"
server_key_version: "encryptionkey@0"
I20260811 18:47:37.132259 2228 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260811 18:47:37.136422 2251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:37.138013 2228 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:47:37.138211 2228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "30e52769566a46359ccabf998ae51550"
format_stamp: "Formatted at 2026-08-11 18:47:37 on dist-test-slave-lgr5"
server_key: "e228ab5af941a2b5d3a95b5fae0554a7"
server_key_iv: "61926bff9365adee24ff31417c99f861"
server_key_version: "encryptionkey@0"
I20260811 18:47:37.138484 2228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:37.145088 2228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:37.146056 2228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:37.146344 2228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:37.147419 2228 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:47:37.149139 2228 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:37.149243 2228 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:37.149364 2228 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:37.149437 2228 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:37.183656 2228 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:33127
I20260811 18:47:37.183729 2481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:33127 every 8 connection(s)
I20260811 18:47:37.185292 2228 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:47:37.189781 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 2228
I20260811 18:47:37.190011 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance
I20260811 18:47:37.190613 25700 external_mini_cluster.cc:1428] Setting key c8028170d36b889ff9837175842f7e8d
I20260811 18:47:37.195468 1981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:37.188297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:49391 (local address 127.25.25.62:35335)
0811 18:47:37.188518 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:37.188522 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:37.190756 (+ 2234us) server_negotiation.cc:407] Connection header received
0811 18:47:37.193121 (+ 2365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:37.193127 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:37.193202 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:37.193294 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:37.194706 (+ 1412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:37.194713 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:37.194716 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:47:37.194733 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:37.194768 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:47:37.194780 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:37.194894 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:37.195098 (+ 204us) server_negotiation.cc:299] Negotiation successful
0811 18:47:37.195186 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260811 18:47:37.196633 2489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:37.188901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:35335 (local address 127.25.25.3:49391)
0811 18:47:37.190504 (+ 1603us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:37.190554 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:37.192818 (+ 2264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:37.193589 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:37.193599 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:37.193713 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:37.194370 (+ 657us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:47:37.194373 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:37.194415 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:47:37.194515 (+ 100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:37.194872 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:37.194883 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:37.194892 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 18:47:37.195195 (+ 303us) client_negotiation.cc:240] Negotiation successful
0811 18:47:37.195521 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":863,"thread_start_us":474,"threads_started":1}
I20260811 18:47:37.198194 2484 heartbeater.cc:347] Connected to a master server at 127.25.25.62:35335
I20260811 18:47:37.198559 2484 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:37.199254 2484 heartbeater.cc:511] Master 127.25.25.62:35335 requested a full tablet report, sending...
I20260811 18:47:37.200970 1599 ts_manager.cc:194] Registered new tserver with Master: 30e52769566a46359ccabf998ae51550 (127.25.25.3:33127)
I20260811 18:47:37.206970 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:47:37.214546 1981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:37.211938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41316 (local address 127.25.25.62:35335)
0811 18:47:37.212155 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:37.212161 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:37.212783 (+ 622us) server_negotiation.cc:407] Connection header received
0811 18:47:37.212929 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:37.212934 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:37.212996 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:37.213094 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:37.214056 (+ 962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:37.214060 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:37.214063 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:47:37.214078 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:37.214106 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:47:37.214118 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:37.214221 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:37.214255 (+ 34us) server_negotiation.cc:299] Negotiation successful
0811 18:47:37.214308 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 18:47:37.219866 1599 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41316:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:47:37.227123 1599 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:47:37.249500 1975 heartbeater.cc:503] Master 127.25.25.62:35335 was elected leader, sending a full tablet report...
I20260811 18:47:37.262082 2513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:37.242506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33872 (local address 127.25.25.3:33127)
0811 18:47:37.258761 (+ 16255us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:37.258770 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:37.258805 (+ 35us) server_negotiation.cc:407] Connection header received
0811 18:47:37.258882 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:37.258889 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:37.259087 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:37.259979 (+ 892us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:37.261140 (+ 1161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:37.261149 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:37.261164 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:47:37.261181 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:37.261242 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:47:37.261265 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:37.261451 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:37.261603 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 18:47:37.261697 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16068,"thread_start_us":15874,"threads_started":1}
I20260811 18:47:37.262193 2506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:37.242142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:33127 (local address 127.0.0.1:33872)
0811 18:47:37.257035 (+ 14893us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:37.257058 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:37.257202 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:37.259324 (+ 2122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:37.259332 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:37.259445 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:37.260373 (+ 928us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:47:37.260377 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:37.260413 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:47:37.260513 (+ 100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:37.261389 (+ 876us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:37.261405 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:37.261415 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 18:47:37.261613 (+ 198us) client_negotiation.cc:240] Negotiation successful
0811 18:47:37.261711 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14734,"thread_start_us":15561,"threads_started":1}
I20260811 18:47:37.262924 2511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:37.243484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:44853 (local address 127.0.0.1:35570)
0811 18:47:37.257996 (+ 14512us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:37.258017 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:37.258143 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:37.259858 (+ 1715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:37.259863 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:37.260646 (+ 783us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:37.261375 (+ 729us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:47:37.261378 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:37.261396 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:47:37.261442 (+ 46us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:37.261889 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:37.261894 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:37.261899 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:47:37.262082 (+ 183us) client_negotiation.cc:240] Negotiation successful
0811 18:47:37.262143 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14370,"thread_start_us":12490,"threads_started":1}
I20260811 18:47:37.262972 2518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:37.244114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35570 (local address 127.25.25.2:44853)
0811 18:47:37.252737 (+ 8623us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:37.252749 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:37.258149 (+ 5400us) server_negotiation.cc:407] Connection header received
0811 18:47:37.258258 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:37.258267 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:37.258579 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:37.258759 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:37.261631 (+ 2872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:37.261640 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:37.261653 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:47:37.261674 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:37.261742 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:47:37.261766 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:37.261916 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:37.262061 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 18:47:37.262177 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8379,"thread_start_us":7949,"threads_started":1}
I20260811 18:47:37.263836 2512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:37.242310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50072 (local address 127.25.25.1:37729)
0811 18:47:37.259141 (+ 16831us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:37.259150 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:37.259180 (+ 30us) server_negotiation.cc:407] Connection header received
0811 18:47:37.259264 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:37.259272 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:37.259475 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:37.259642 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:37.262784 (+ 3142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:37.262793 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:37.262808 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:47:37.262832 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:37.262898 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:47:37.262922 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:37.263111 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:37.263343 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 18:47:37.263456 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16625,"thread_start_us":18716,"threads_started":1}
I20260811 18:47:37.266544 2088 tablet_service.cc:1467] Processing CreateTablet for tablet 1d046f60a3cd456e871286077d497e16 (DEFAULT_TABLE table=test-table [id=7b714a2fff15490f85ccb31da9f4d75b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:37.266455 2341 tablet_service.cc:1467] Processing CreateTablet for tablet 1d046f60a3cd456e871286077d497e16 (DEFAULT_TABLE table=test-table [id=7b714a2fff15490f85ccb31da9f4d75b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:37.267359 2515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:37.242080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:37729 (local address 127.0.0.1:50072)
0811 18:47:37.256537 (+ 14457us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:37.256601 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:37.256790 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:37.260821 (+ 4031us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:37.260824 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:37.260843 (+ 19us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:37.262503 (+ 1660us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:47:37.262506 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:37.262523 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:47:37.262574 (+ 51us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:37.263167 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:37.263172 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:37.263177 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:47:37.263322 (+ 145us) client_negotiation.cc:240] Negotiation successful
0811 18:47:37.263376 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14142,"thread_start_us":15197,"threads_started":1}
I20260811 18:47:37.267994 2088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d046f60a3cd456e871286077d497e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:37.268005 2341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d046f60a3cd456e871286077d497e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:37.272107 1842 tablet_service.cc:1467] Processing CreateTablet for tablet 1d046f60a3cd456e871286077d497e16 (DEFAULT_TABLE table=test-table [id=7b714a2fff15490f85ccb31da9f4d75b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:37.274178 1842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d046f60a3cd456e871286077d497e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:37.280864 2519 tablet_bootstrap.cc:492] T 1d046f60a3cd456e871286077d497e16 P 30e52769566a46359ccabf998ae51550: Bootstrap starting.
I20260811 18:47:37.283571 2521 tablet_bootstrap.cc:492] T 1d046f60a3cd456e871286077d497e16 P 1e20b0908926475896bf58a903e188be: Bootstrap starting.
I20260811 18:47:37.285840 2519 tablet_bootstrap.cc:654] T 1d046f60a3cd456e871286077d497e16 P 30e52769566a46359ccabf998ae51550: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:37.287382 2519 log.cc:824] T 1d046f60a3cd456e871286077d497e16 P 30e52769566a46359ccabf998ae51550: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:37.288499 2521 tablet_bootstrap.cc:654] T 1d046f60a3cd456e871286077d497e16 P 1e20b0908926475896bf58a903e188be: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:37.290050 2521 log.cc:824] T 1d046f60a3cd456e871286077d497e16 P 1e20b0908926475896bf58a903e188be: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:37.290970 2524 tablet_bootstrap.cc:492] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e: Bootstrap starting.
I20260811 18:47:37.292487 2519 tablet_bootstrap.cc:492] T 1d046f60a3cd456e871286077d497e16 P 30e52769566a46359ccabf998ae51550: No bootstrap required, opened a new log
I20260811 18:47:37.292950 2519 ts_tablet_manager.cc:1397] T 1d046f60a3cd456e871286077d497e16 P 30e52769566a46359ccabf998ae51550: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.007s
I20260811 18:47:37.294528 2521 tablet_bootstrap.cc:492] T 1d046f60a3cd456e871286077d497e16 P 1e20b0908926475896bf58a903e188be: No bootstrap required, opened a new log
I20260811 18:47:37.294847 2521 ts_tablet_manager.cc:1397] T 1d046f60a3cd456e871286077d497e16 P 1e20b0908926475896bf58a903e188be: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.007s
I20260811 18:47:37.296375 2524 tablet_bootstrap.cc:654] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:37.297844 2524 log.cc:824] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:37.301168 2519 raft_consensus.cc:348] T 1d046f60a3cd456e871286077d497e16 P 30e52769566a46359ccabf998ae51550 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879daa9b8b1b4c858b2238c78eac603e" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 37729 } } peers { permanent_uuid: "30e52769566a46359ccabf998ae51550" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 33127 } } peers { permanent_uuid: "1e20b0908926475896bf58a903e188be" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44853 } }
I20260811 18:47:37.301687 2519 raft_consensus.cc:374] T 1d046f60a3cd456e871286077d497e16 P 30e52769566a46359ccabf998ae51550 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:37.301736 2524 tablet_bootstrap.cc:492] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e: No bootstrap required, opened a new log
I20260811 18:47:37.301793 2519 raft_consensus.cc:729] T 1d046f60a3cd456e871286077d497e16 P 30e52769566a46359ccabf998ae51550 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30e52769566a46359ccabf998ae51550, State: Initialized, Role: FOLLOWER
I20260811 18:47:37.302043 2524 ts_tablet_manager.cc:1397] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260811 18:47:37.302623 2519 consensus_queue.cc:260] T 1d046f60a3cd456e871286077d497e16 P 30e52769566a46359ccabf998ae51550 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879daa9b8b1b4c858b2238c78eac603e" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 37729 } } peers { permanent_uuid: "30e52769566a46359ccabf998ae51550" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 33127 } } peers { permanent_uuid: "1e20b0908926475896bf58a903e188be" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44853 } }
I20260811 18:47:37.303857 2484 heartbeater.cc:503] Master 127.25.25.62:35335 was elected leader, sending a full tablet report...
I20260811 18:47:37.304504 2519 ts_tablet_manager.cc:1428] T 1d046f60a3cd456e871286077d497e16 P 30e52769566a46359ccabf998ae51550: Time spent starting tablet: real 0.011s user 0.006s sys 0.006s
I20260811 18:47:37.305190 2521 raft_consensus.cc:348] T 1d046f60a3cd456e871286077d497e16 P 1e20b0908926475896bf58a903e188be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879daa9b8b1b4c858b2238c78eac603e" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 37729 } } peers { permanent_uuid: "30e52769566a46359ccabf998ae51550" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 33127 } } peers { permanent_uuid: "1e20b0908926475896bf58a903e188be" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44853 } }
I20260811 18:47:37.305634 2521 raft_consensus.cc:374] T 1d046f60a3cd456e871286077d497e16 P 1e20b0908926475896bf58a903e188be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:37.305733 2521 raft_consensus.cc:729] T 1d046f60a3cd456e871286077d497e16 P 1e20b0908926475896bf58a903e188be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e20b0908926475896bf58a903e188be, State: Initialized, Role: FOLLOWER
I20260811 18:47:37.306355 2521 consensus_queue.cc:260] T 1d046f60a3cd456e871286077d497e16 P 1e20b0908926475896bf58a903e188be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879daa9b8b1b4c858b2238c78eac603e" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 37729 } } peers { permanent_uuid: "30e52769566a46359ccabf998ae51550" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 33127 } } peers { permanent_uuid: "1e20b0908926475896bf58a903e188be" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44853 } }
I20260811 18:47:37.307464 2220 heartbeater.cc:503] Master 127.25.25.62:35335 was elected leader, sending a full tablet report...
I20260811 18:47:37.308238 2521 ts_tablet_manager.cc:1428] T 1d046f60a3cd456e871286077d497e16 P 1e20b0908926475896bf58a903e188be: Time spent starting tablet: real 0.013s user 0.016s sys 0.000s
I20260811 18:47:37.313668 2524 raft_consensus.cc:348] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879daa9b8b1b4c858b2238c78eac603e" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 37729 } } peers { permanent_uuid: "30e52769566a46359ccabf998ae51550" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 33127 } } peers { permanent_uuid: "1e20b0908926475896bf58a903e188be" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44853 } }
I20260811 18:47:37.314105 2524 raft_consensus.cc:374] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:37.314219 2524 raft_consensus.cc:729] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879daa9b8b1b4c858b2238c78eac603e, State: Initialized, Role: FOLLOWER
I20260811 18:47:37.314850 2524 consensus_queue.cc:260] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879daa9b8b1b4c858b2238c78eac603e" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 37729 } } peers { permanent_uuid: "30e52769566a46359ccabf998ae51550" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 33127 } } peers { permanent_uuid: "1e20b0908926475896bf58a903e188be" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44853 } }
I20260811 18:47:37.316625 2524 ts_tablet_manager.cc:1428] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e: Time spent starting tablet: real 0.014s user 0.014s sys 0.001s
I20260811 18:47:37.388371 2529 raft_consensus.cc:482] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:47:37.388763 2529 raft_consensus.cc:504] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879daa9b8b1b4c858b2238c78eac603e" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 37729 } } peers { permanent_uuid: "30e52769566a46359ccabf998ae51550" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 33127 } } peers { permanent_uuid: "1e20b0908926475896bf58a903e188be" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44853 } }
I20260811 18:47:37.390748 2529 leader_election.cc:288] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30e52769566a46359ccabf998ae51550 (127.25.25.3:33127), 1e20b0908926475896bf58a903e188be (127.25.25.2:44853)
I20260811 18:47:37.394459 2513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:37.391323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:48569 (local address 127.25.25.3:33127)
0811 18:47:37.391612 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:37.391620 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:37.392169 (+ 549us) server_negotiation.cc:407] Connection header received
0811 18:47:37.392393 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:37.392399 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:37.392471 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:37.392574 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:37.393771 (+ 1197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:37.393777 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:37.393781 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:47:37.393806 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:37.393872 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:47:37.393888 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:37.394022 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:37.394116 (+ 94us) server_negotiation.cc:299] Negotiation successful
0811 18:47:37.394186 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260811 18:47:37.394510 2518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:37.391381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:37377 (local address 127.25.25.2:44853)
0811 18:47:37.391593 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:37.391601 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:37.392251 (+ 650us) server_negotiation.cc:407] Connection header received
0811 18:47:37.392429 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:37.392433 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:37.392491 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:37.392559 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:37.393807 (+ 1248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:37.393812 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:37.393817 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:47:37.393838 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:37.393876 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:47:37.393891 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:37.394016 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:37.394116 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 18:47:37.394186 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 18:47:37.394770 2530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:37.391122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:44853 (local address 127.25.25.1:37377)
0811 18:47:37.392140 (+ 1018us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:37.392157 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:37.392258 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:37.392789 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:37.392795 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:37.392821 (+ 26us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:37.393580 (+ 759us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:47:37.393583 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:37.393596 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:47:37.393629 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:37.393999 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:37.394004 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:37.394009 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:47:37.394154 (+ 145us) client_negotiation.cc:240] Negotiation successful
0811 18:47:37.394220 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":882,"thread_start_us":507,"threads_started":1}
I20260811 18:47:37.395061 2531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:37.391082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:33127 (local address 127.25.25.1:48569)
0811 18:47:37.391977 (+ 895us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:37.391999 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:37.392216 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:37.392641 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:37.392646 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:37.392673 (+ 27us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:37.393482 (+ 809us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:47:37.393486 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:37.393506 (+ 20us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:47:37.393569 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:37.393999 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:37.394004 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:37.394009 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:47:37.394193 (+ 184us) client_negotiation.cc:240] Negotiation successful
0811 18:47:37.394231 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":706,"thread_start_us":695,"threads_started":1}
I20260811 18:47:37.396003 2122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d046f60a3cd456e871286077d497e16" candidate_uuid: "879daa9b8b1b4c858b2238c78eac603e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e20b0908926475896bf58a903e188be" is_pre_election: true
I20260811 18:47:37.396003 2375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d046f60a3cd456e871286077d497e16" candidate_uuid: "879daa9b8b1b4c858b2238c78eac603e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30e52769566a46359ccabf998ae51550" is_pre_election: true
I20260811 18:47:37.396661 2375 raft_consensus.cc:2454] T 1d046f60a3cd456e871286077d497e16 P 30e52769566a46359ccabf998ae51550 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879daa9b8b1b4c858b2238c78eac603e in term 0.
I20260811 18:47:37.396661 2122 raft_consensus.cc:2454] T 1d046f60a3cd456e871286077d497e16 P 1e20b0908926475896bf58a903e188be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879daa9b8b1b4c858b2238c78eac603e in term 0.
I20260811 18:47:37.397372 1754 leader_election.cc:302] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30e52769566a46359ccabf998ae51550, 879daa9b8b1b4c858b2238c78eac603e; no voters:
I20260811 18:47:37.397753 2529 raft_consensus.cc:2781] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:47:37.397899 2529 raft_consensus.cc:482] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:47:37.398003 2529 raft_consensus.cc:3037] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:37.400369 2529 raft_consensus.cc:504] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879daa9b8b1b4c858b2238c78eac603e" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 37729 } } peers { permanent_uuid: "30e52769566a46359ccabf998ae51550" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 33127 } } peers { permanent_uuid: "1e20b0908926475896bf58a903e188be" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44853 } }
I20260811 18:47:37.401023 2529 leader_election.cc:288] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e [CANDIDATE]: Term 1 election: Requested vote from peers 30e52769566a46359ccabf998ae51550 (127.25.25.3:33127), 1e20b0908926475896bf58a903e188be (127.25.25.2:44853)
I20260811 18:47:37.401685 2122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d046f60a3cd456e871286077d497e16" candidate_uuid: "879daa9b8b1b4c858b2238c78eac603e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e20b0908926475896bf58a903e188be"
I20260811 18:47:37.401686 2375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d046f60a3cd456e871286077d497e16" candidate_uuid: "879daa9b8b1b4c858b2238c78eac603e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30e52769566a46359ccabf998ae51550"
I20260811 18:47:37.401932 2122 raft_consensus.cc:3037] T 1d046f60a3cd456e871286077d497e16 P 1e20b0908926475896bf58a903e188be [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:37.401957 2375 raft_consensus.cc:3037] T 1d046f60a3cd456e871286077d497e16 P 30e52769566a46359ccabf998ae51550 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:37.405441 2122 raft_consensus.cc:2454] T 1d046f60a3cd456e871286077d497e16 P 1e20b0908926475896bf58a903e188be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879daa9b8b1b4c858b2238c78eac603e in term 1.
I20260811 18:47:37.405434 2375 raft_consensus.cc:2454] T 1d046f60a3cd456e871286077d497e16 P 30e52769566a46359ccabf998ae51550 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879daa9b8b1b4c858b2238c78eac603e in term 1.
I20260811 18:47:37.406140 1755 leader_election.cc:302] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1e20b0908926475896bf58a903e188be, 30e52769566a46359ccabf998ae51550, 879daa9b8b1b4c858b2238c78eac603e; no voters:
I20260811 18:47:37.406620 2529 raft_consensus.cc:2781] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:37.407158 2529 raft_consensus.cc:686] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e [term 1 LEADER]: Becoming Leader. State: Replica: 879daa9b8b1b4c858b2238c78eac603e, State: Running, Role: LEADER
I20260811 18:47:37.407780 2529 consensus_queue.cc:237] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879daa9b8b1b4c858b2238c78eac603e" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 37729 } } peers { permanent_uuid: "30e52769566a46359ccabf998ae51550" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 33127 } } peers { permanent_uuid: "1e20b0908926475896bf58a903e188be" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44853 } }
I20260811 18:47:37.413496 1599 catalog_manager.cc:5495] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e reported cstate change: term changed from 0 to 1, leader changed from <none> to 879daa9b8b1b4c858b2238c78eac603e (127.25.25.1). New cstate: current_term: 1 leader_uuid: "879daa9b8b1b4c858b2238c78eac603e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "879daa9b8b1b4c858b2238c78eac603e" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 37729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30e52769566a46359ccabf998ae51550" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e20b0908926475896bf58a903e188be" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44853 } health_report { overall_health: UNKNOWN } } }
W20260811 18:47:37.437055 2488 tablet.cc:2369] T 1d046f60a3cd456e871286077d497e16 P 30e52769566a46359ccabf998ae51550: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:47:37.464979 2512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:37.462996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50082 (local address 127.25.25.1:37729)
0811 18:47:37.463191 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:37.463196 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:37.463213 (+ 17us) server_negotiation.cc:407] Connection header received
0811 18:47:37.463310 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:37.463313 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:37.463394 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:37.463523 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:37.464383 (+ 860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:37.464387 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:37.464390 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:47:37.464406 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:37.464470 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:47:37.464483 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:37.464588 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:37.464660 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 18:47:37.464711 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
W20260811 18:47:37.466207 2222 tablet.cc:2369] T 1d046f60a3cd456e871286077d497e16 P 1e20b0908926475896bf58a903e188be: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:47:37.474330 2375 raft_consensus.cc:1261] T 1d046f60a3cd456e871286077d497e16 P 30e52769566a46359ccabf998ae51550 [term 1 FOLLOWER]: Refusing update from remote peer 879daa9b8b1b4c858b2238c78eac603e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:47:37.474321 2122 raft_consensus.cc:1261] T 1d046f60a3cd456e871286077d497e16 P 1e20b0908926475896bf58a903e188be [term 1 FOLLOWER]: Refusing update from remote peer 879daa9b8b1b4c858b2238c78eac603e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:47:37.475577 2535 consensus_queue.cc:1035] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e [LEADER]: Connected to new peer: Peer: permanent_uuid: "30e52769566a46359ccabf998ae51550" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:47:37.475996 2529 consensus_queue.cc:1035] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e20b0908926475896bf58a903e188be" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 18:47:37.484015 1979 tablet.cc:2369] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:47:37.488682 2542 mvcc.cc:205] Tried to move back new op lower bound from 7317397739403472896 to 7317397739147485184. Current Snapshot: MvccSnapshot[applied={T|T < 7317397739403472896}]
I20260811 18:47:37.490043 2547 mvcc.cc:205] Tried to move back new op lower bound from 7317397739403472896 to 7317397739147485184. Current Snapshot: MvccSnapshot[applied={T|T < 7317397739403472896}]
I20260811 18:47:37.505717 1600 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:47:37.506048 1600 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:47:37.510607 1600 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f530d58bd554498cab4f02cc6d47ac23: Sending DeleteTablet for 3 replicas of tablet 1d046f60a3cd456e871286077d497e16
I20260811 18:47:37.511929 1842 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d046f60a3cd456e871286077d497e16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:37 UTC) from {username='slave'} at 127.0.0.1:50072
I20260811 18:47:37.511946 2088 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d046f60a3cd456e871286077d497e16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:37 UTC) from {username='slave'} at 127.0.0.1:35570
I20260811 18:47:37.512812 2341 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d046f60a3cd456e871286077d497e16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:37 UTC) from {username='slave'} at 127.0.0.1:33872
I20260811 18:47:37.513226 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 1719
I20260811 18:47:37.513845 2567 tablet_replica.cc:330] T 1d046f60a3cd456e871286077d497e16 P 30e52769566a46359ccabf998ae51550: stopping tablet replica
I20260811 18:47:37.514465 2567 raft_consensus.cc:2229] T 1d046f60a3cd456e871286077d497e16 P 30e52769566a46359ccabf998ae51550 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:47:37.515236 2567 raft_consensus.cc:2258] T 1d046f60a3cd456e871286077d497e16 P 30e52769566a46359ccabf998ae51550 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:37.518167 2567 ts_tablet_manager.cc:1905] T 1d046f60a3cd456e871286077d497e16 P 30e52769566a46359ccabf998ae51550: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:37.525956 2512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:37.514523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50088 (local address 127.25.25.1:37729)
0811 18:47:37.514727 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:37.514734 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:37.521576 (+ 6842us) server_negotiation.cc:407] Connection header received
0811 18:47:37.522693 (+ 1117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:37.522699 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:37.522776 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:37.522870 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:37.524776 (+ 1906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:37.524783 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:37.524788 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:47:37.524816 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:37.524863 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:47:37.524881 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:37.525016 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:37.525531 (+ 515us) server_negotiation.cc:299] Negotiation successful
0811 18:47:37.525620 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 18:47:37.527040 2567 ts_tablet_manager.cc:1918] T 1d046f60a3cd456e871286077d497e16 P 30e52769566a46359ccabf998ae51550: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:47:37.527254 1967 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:37.527407 2567 log.cc:1196] T 1d046f60a3cd456e871286077d497e16 P 30e52769566a46359ccabf998ae51550: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-2/wal/wals/1d046f60a3cd456e871286077d497e16
I20260811 18:47:37.528195 2567 ts_tablet_manager.cc:1939] T 1d046f60a3cd456e871286077d497e16 P 30e52769566a46359ccabf998ae51550: Deleting consensus metadata
I20260811 18:47:37.530638 1575 catalog_manager.cc:4841] TS 30e52769566a46359ccabf998ae51550 (127.25.25.3:33127): tablet 1d046f60a3cd456e871286077d497e16 (table test-table [id=7b714a2fff15490f85ccb31da9f4d75b]) successfully deleted
I20260811 18:47:37.533417 2566 tablet_replica.cc:330] T 1d046f60a3cd456e871286077d497e16 P 1e20b0908926475896bf58a903e188be: stopping tablet replica
I20260811 18:47:37.534017 2566 raft_consensus.cc:2229] T 1d046f60a3cd456e871286077d497e16 P 1e20b0908926475896bf58a903e188be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:47:37.534657 2566 raft_consensus.cc:2258] T 1d046f60a3cd456e871286077d497e16 P 1e20b0908926475896bf58a903e188be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:37.537322 2566 ts_tablet_manager.cc:1905] T 1d046f60a3cd456e871286077d497e16 P 1e20b0908926475896bf58a903e188be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:37.543159 2566 ts_tablet_manager.cc:1918] T 1d046f60a3cd456e871286077d497e16 P 1e20b0908926475896bf58a903e188be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:47:37.543339 2566 log.cc:1196] T 1d046f60a3cd456e871286077d497e16 P 1e20b0908926475896bf58a903e188be: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474012733352-25700-0/minicluster-data/ts-1/wal/wals/1d046f60a3cd456e871286077d497e16
I20260811 18:47:37.543820 2566 ts_tablet_manager.cc:1939] T 1d046f60a3cd456e871286077d497e16 P 1e20b0908926475896bf58a903e188be: Deleting consensus metadata
I20260811 18:47:37.545612 1577 catalog_manager.cc:4841] TS 1e20b0908926475896bf58a903e188be (127.25.25.2:44853): tablet 1d046f60a3cd456e871286077d497e16 (table test-table [id=7b714a2fff15490f85ccb31da9f4d75b]) successfully deleted
I20260811 18:47:37.629997 2565 tablet_replica.cc:330] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e: stopping tablet replica
I20260811 18:47:37.630659 2565 raft_consensus.cc:2229] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:47:37.631523 2565 raft_consensus.cc:2258] T 1d046f60a3cd456e871286077d497e16 P 879daa9b8b1b4c858b2238c78eac603e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:37.632740 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 1719
W20260811 18:47:37.658157 1571 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.25.1:37729 (error 108)
I20260811 18:47:37.658916 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 1986
I20260811 18:47:37.660146 2515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:37.659588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:37729 (local address 127.0.0.1:50102)
0811 18:47:37.659864 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:37.659983 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:37729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158}
W20260811 18:47:37.660434 1571 catalog_manager.cc:4584] TS 879daa9b8b1b4c858b2238c78eac603e (127.25.25.1:37729): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1d046f60a3cd456e871286077d497e16: Network error: Client connection negotiation failed: client connection to 127.25.25.1:37729: connect: Connection refused (error 111)
I20260811 18:47:37.661885 2518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:37.659663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35574 (local address 127.25.25.2:44853)
0811 18:47:37.659880 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:37.659886 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:37.659906 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:47:37.660024 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:37.660029 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:37.660156 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:37.660259 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:37.661277 (+ 1018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:37.661282 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:37.661285 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:47:37.661304 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:37.661341 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:47:37.661354 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:37.661464 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:37.661585 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 18:47:37.661643 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 18:47:37.662597 2210 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:37.715041 2515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:37.714479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:37729 (local address 127.0.0.1:50108)
0811 18:47:37.714690 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:37.714793 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:37729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260811 18:47:37.716353 2515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:37.715902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:37729 (local address 127.0.0.1:50118)
0811 18:47:37.716127 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:37.716215 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:37729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 18:47:37.758626 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 1986
I20260811 18:47:37.777007 2515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:37.776506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:37729 (local address 127.0.0.1:50124)
0811 18:47:37.776735 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:37.776837 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:37729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260811 18:47:37.778218 2515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:37.777797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:37729 (local address 127.0.0.1:50130)
0811 18:47:37.777973 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:37.778079 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:37729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 18:47:37.782717 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 2228
I20260811 18:47:37.785748 2513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:37.783674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33884 (local address 127.25.25.3:33127)
0811 18:47:37.783851 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:37.783856 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:37.783881 (+ 25us) server_negotiation.cc:407] Connection header received
0811 18:47:37.783947 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:37.783952 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:37.784050 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:37.784179 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:37.785120 (+ 941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:37.785125 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:37.785128 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:47:37.785145 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:37.785181 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:47:37.785193 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:37.785308 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:37.785350 (+ 42us) server_negotiation.cc:299] Negotiation successful
0811 18:47:37.785399 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 18:47:37.786412 2470 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:37.859117 2515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:37.858572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:37729 (local address 127.0.0.1:50140)
0811 18:47:37.858827 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:37.858938 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:37729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260811 18:47:37.860318 2515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:37.859822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:37729 (local address 127.0.0.1:50144)
0811 18:47:37.860048 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:37.860175 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:37729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260811 18:47:37.875396 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 2228
I20260811 18:47:37.903942 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 1539
I20260811 18:47:37.905225 1659 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:38.025233 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 1539
2026-08-11T18:47:38Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2923 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 18:47:38.079772 25700 mini_oidc.cc:152] Starting JWKS server
I20260811 18:47:38.084450 25700 webserver.cc:460] Webserver started at https://127.0.0.1:36955/ using document root <none> and password file <none>
I20260811 18:47:38.084827 25700 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 18:47:38.085531 25700 webserver.cc:460] Webserver started at http://127.0.0.1:42555/ using document root <none> and password file <none>
2026-08-11T18:47:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:47:38Z Disabled control of system clock
I20260811 18:47:38.122617 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:35135
--webserver_interface=127.25.25.62
--webserver_port=0
--builtin_ntp_servers=127.25.25.20:37321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:35135
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36955/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474012733352-25700-0/testchainca.cert with env {}
W20260811 18:47:38.482008 2594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:38.482367 2594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:38.482504 2594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:38.490113 2594 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:47:38.490257 2594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:38.490321 2594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:38.490413 2594 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:47:38.490483 2594 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 18:47:38.490576 2594 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 18:47:38.490631 2594 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36955/jwks.json
I20260811 18:47:38.501130 2594 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:37321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:35135
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:35135
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36955/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474012733352-25700-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:38.502573 2594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:38.504058 2594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:38.516467 2599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:38.516390 2607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:38.516412 2602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:38.517251 2594 server_base.cc:1034] running on GCE node
I20260811 18:47:38.518169 2594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:38.519860 2594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:38.521149 2594 hybrid_clock.cc:648] HybridClock initialized: now 1786474058521075 us; error 62 us; skew 500 ppm
I20260811 18:47:38.521605 2594 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:47:38.530637 2594 webserver.cc:460] Webserver started at http://127.25.25.62:36577/ using document root <none> and password file <none>
I20260811 18:47:38.531540 2594 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:38.531680 2594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:38.532029 2594 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:38.535450 2594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "e53f0984817c4e66986ddd22601d5aed"
format_stamp: "Formatted at 2026-08-11 18:47:38 on dist-test-slave-lgr5"
server_key: "0c66a5863ea8aa2a97f5d59d51ae2198"
server_key_iv: "9e6133efffe34283e0060d1e47a43512"
server_key_version: "encryptionkey@0"
I20260811 18:47:38.536473 2594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "e53f0984817c4e66986ddd22601d5aed"
format_stamp: "Formatted at 2026-08-11 18:47:38 on dist-test-slave-lgr5"
server_key: "0c66a5863ea8aa2a97f5d59d51ae2198"
server_key_iv: "9e6133efffe34283e0060d1e47a43512"
server_key_version: "encryptionkey@0"
I20260811 18:47:38.542452 2594 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 18:47:38.547158 2618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:38.548887 2594 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260811 18:47:38.549101 2594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "e53f0984817c4e66986ddd22601d5aed"
format_stamp: "Formatted at 2026-08-11 18:47:38 on dist-test-slave-lgr5"
server_key: "0c66a5863ea8aa2a97f5d59d51ae2198"
server_key_iv: "9e6133efffe34283e0060d1e47a43512"
server_key_version: "encryptionkey@0"
I20260811 18:47:38.549355 2594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:38.563195 2594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:38.564235 2594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:38.564575 2594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:38.583316 2594 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:35135
I20260811 18:47:38.583338 2723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:35135 every 8 connection(s)
I20260811 18:47:38.584882 2594 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:47:38.587920 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 2594
I20260811 18:47:38.588191 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:47:38.589040 25700 external_mini_cluster.cc:1428] Setting key 264c8fac14828000bddfffb77b840bb2
I20260811 18:47:38.590021 2727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:38.605597 2727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e53f0984817c4e66986ddd22601d5aed: Bootstrap starting.
I20260811 18:47:38.605672 2732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:38.591276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39514 (local address 127.25.25.62:35135)
0811 18:47:38.592473 (+ 1197us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:38.592486 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:38.592534 (+ 48us) server_negotiation.cc:407] Connection header received
0811 18:47:38.595091 (+ 2557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:38.595122 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:38.595748 (+ 626us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:38.596211 (+ 463us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:38.597117 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:38.598559 (+ 1442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:38.600628 (+ 2069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:38.601349 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:38.601537 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:38.602969 (+ 1432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:38.602978 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:38.603000 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:47:38.603652 (+ 652us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:38.603744 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:47:38.603772 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:38.603863 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:38.604201 (+ 338us) server_negotiation.cc:299] Negotiation successful
0811 18:47:38.604609 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":656,"thread_start_us":412,"threads_started":1}
I20260811 18:47:38.609470 2727 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e53f0984817c4e66986ddd22601d5aed: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:38.609825 25700 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:47:38.610659 2727 log.cc:824] T 00000000000000000000000000000000 P e53f0984817c4e66986ddd22601d5aed: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:38.613972 2727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e53f0984817c4e66986ddd22601d5aed: No bootstrap required, opened a new log
I20260811 18:47:38.621775 2727 raft_consensus.cc:348] T 00000000000000000000000000000000 P e53f0984817c4e66986ddd22601d5aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e53f0984817c4e66986ddd22601d5aed" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 35135 } }
I20260811 18:47:38.622207 2727 raft_consensus.cc:374] T 00000000000000000000000000000000 P e53f0984817c4e66986ddd22601d5aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:38.622309 2727 raft_consensus.cc:729] T 00000000000000000000000000000000 P e53f0984817c4e66986ddd22601d5aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e53f0984817c4e66986ddd22601d5aed, State: Initialized, Role: FOLLOWER
I20260811 18:47:38.623025 2727 consensus_queue.cc:260] T 00000000000000000000000000000000 P e53f0984817c4e66986ddd22601d5aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e53f0984817c4e66986ddd22601d5aed" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 35135 } }
I20260811 18:47:38.623347 2727 raft_consensus.cc:388] T 00000000000000000000000000000000 P e53f0984817c4e66986ddd22601d5aed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:47:38.623494 2727 raft_consensus.cc:482] T 00000000000000000000000000000000 P e53f0984817c4e66986ddd22601d5aed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:47:38.623656 2727 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e53f0984817c4e66986ddd22601d5aed [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:38.626523 2727 raft_consensus.cc:504] T 00000000000000000000000000000000 P e53f0984817c4e66986ddd22601d5aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e53f0984817c4e66986ddd22601d5aed" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 35135 } }
I20260811 18:47:38.627066 2727 leader_election.cc:302] T 00000000000000000000000000000000 P e53f0984817c4e66986ddd22601d5aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e53f0984817c4e66986ddd22601d5aed; no voters:
I20260811 18:47:38.627700 2727 leader_election.cc:288] T 00000000000000000000000000000000 P e53f0984817c4e66986ddd22601d5aed [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:47:38.627895 2735 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e53f0984817c4e66986ddd22601d5aed [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:38.629333 2735 raft_consensus.cc:686] T 00000000000000000000000000000000 P e53f0984817c4e66986ddd22601d5aed [term 1 LEADER]: Becoming Leader. State: Replica: e53f0984817c4e66986ddd22601d5aed, State: Running, Role: LEADER
I20260811 18:47:38.630137 2727 sys_catalog.cc:564] T 00000000000000000000000000000000 P e53f0984817c4e66986ddd22601d5aed [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:47:38.630003 2735 consensus_queue.cc:237] T 00000000000000000000000000000000 P e53f0984817c4e66986ddd22601d5aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e53f0984817c4e66986ddd22601d5aed" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 35135 } }
I20260811 18:47:38.633277 2737 sys_catalog.cc:455] T 00000000000000000000000000000000 P e53f0984817c4e66986ddd22601d5aed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e53f0984817c4e66986ddd22601d5aed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e53f0984817c4e66986ddd22601d5aed" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 35135 } } }
I20260811 18:47:38.633842 2737 sys_catalog.cc:458] T 00000000000000000000000000000000 P e53f0984817c4e66986ddd22601d5aed [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:38.634126 2740 sys_catalog.cc:455] T 00000000000000000000000000000000 P e53f0984817c4e66986ddd22601d5aed [sys.catalog]: SysCatalogTable state changed. Reason: New leader e53f0984817c4e66986ddd22601d5aed. Latest consensus state: current_term: 1 leader_uuid: "e53f0984817c4e66986ddd22601d5aed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e53f0984817c4e66986ddd22601d5aed" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 35135 } } }
I20260811 18:47:38.634459 2740 sys_catalog.cc:458] T 00000000000000000000000000000000 P e53f0984817c4e66986ddd22601d5aed [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:38.636020 2753 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:47:38.642699 2753 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:47:38.653759 2753 catalog_manager.cc:1347] Generated new cluster ID: 8951b87daac5459bba9194b7c3122a68
I20260811 18:47:38.653898 2753 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:47:38.669929 2753 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:47:38.672043 2753 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:47:38.684480 2753 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e53f0984817c4e66986ddd22601d5aed: Generated new TSK 0
I20260811 18:47:38.685562 2753 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 18:47:38.729748 2782 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 18:47:38.730095 2782 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 18:47:38.731150 2732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:38.705863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39516 (local address 127.25.25.62:35135)
0811 18:47:38.706091 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:38.706097 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:38.706577 (+ 480us) server_negotiation.cc:407] Connection header received
0811 18:47:38.707090 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:38.707094 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:38.707180 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:38.707351 (+ 171us) server_negotiation.cc:226] Negotiated authn=JWT
0811 18:47:38.708069 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:38.708950 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:38.711216 (+ 2266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:38.711752 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:38.711876 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:38.712789 (+ 913us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 18:47:38.730526 (+ 17737us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36955/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 18:47:38.730868 (+ 342us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39516: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36955/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":89}
W20260811 18:47:38.731285 2732 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39516: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36955/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 18:47:38.733639 2779 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:47:38.705607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:35135 (local address 127.0.0.1:39516)
0811 18:47:38.706422 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:38.706446 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:38.706686 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:38.707410 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:38.707416 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:38.707431 (+ 15us) client_negotiation.cc:189] Negotiated authn=JWT
0811 18:47:38.707857 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:38.707871 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:38.709114 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:38.709121 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:38.710986 (+ 1865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:38.711009 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:38.711955 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:38.711962 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:38.712235 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:38.712351 (+ 116us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 18:47:38.730883 (+ 18532us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36955/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 18:47:38.731355 (+ 472us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.25.25.62:35135: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36955/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":402,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.25.25.62:35135: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36955/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 18:47:38.736021 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 2594
I20260811 18:47:38.737401 2717 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:38.836220 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 2594
2026-08-11T18:47:38Z chronyd exiting
I20260811 18:47:38.899094 25700 test_util.cc:175] -----------------------------------------------
I20260811 18:47:38.899256 25700 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474012733352-25700-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (824 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 18:47:38.903245 25700 mini_oidc.cc:152] Starting JWKS server
I20260811 18:47:38.905256 25700 webserver.cc:460] Webserver started at https://127.0.0.1:46539/ using document root <none> and password file <none>
I20260811 18:47:38.905498 25700 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 18:47:38.906225 25700 webserver.cc:460] Webserver started at http://127.0.0.1:32781/ using document root <none> and password file <none>
2026-08-11T18:47:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:47:38Z Disabled control of system clock
I20260811 18:47:38.942348 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:42325
--webserver_interface=127.25.25.62
--webserver_port=0
--builtin_ntp_servers=127.25.25.20:34477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:42325
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46539/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474012733352-25700-0/testchainca.cert with env {}
W20260811 18:47:39.289042 2796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:39.289377 2796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:39.289500 2796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:39.297072 2796 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:47:39.297187 2796 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:39.297230 2796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:39.297310 2796 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:47:39.297365 2796 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 18:47:39.297456 2796 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 18:47:39.297513 2796 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46539/jwks.json
I20260811 18:47:39.307807 2796 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:34477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:42325
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:42325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46539/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474012733352-25700-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:39.309336 2796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:39.310732 2796 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:39.322995 2803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:39.323020 2804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:39.323057 2808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:39.324139 2796 server_base.cc:1034] running on GCE node
I20260811 18:47:39.325069 2796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:39.326656 2796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:39.327922 2796 hybrid_clock.cc:648] HybridClock initialized: now 1786474059327850 us; error 52 us; skew 500 ppm
I20260811 18:47:39.328449 2796 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:47:39.331382 2796 webserver.cc:460] Webserver started at http://127.25.25.62:39953/ using document root <none> and password file <none>
I20260811 18:47:39.332264 2796 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:39.332412 2796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:39.332818 2796 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:39.336431 2796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "47517f1b218842058376e60851bd0283"
format_stamp: "Formatted at 2026-08-11 18:47:39 on dist-test-slave-lgr5"
server_key: "95ba83090f66a922b587de4150e2da0b"
server_key_iv: "7e19a87bd2125cc586a46d74b4d7203f"
server_key_version: "encryptionkey@0"
I20260811 18:47:39.337471 2796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "47517f1b218842058376e60851bd0283"
format_stamp: "Formatted at 2026-08-11 18:47:39 on dist-test-slave-lgr5"
server_key: "95ba83090f66a922b587de4150e2da0b"
server_key_iv: "7e19a87bd2125cc586a46d74b4d7203f"
server_key_version: "encryptionkey@0"
I20260811 18:47:39.343545 2796 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 18:47:39.347618 2819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:39.349242 2796 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:47:39.349458 2796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "47517f1b218842058376e60851bd0283"
format_stamp: "Formatted at 2026-08-11 18:47:39 on dist-test-slave-lgr5"
server_key: "95ba83090f66a922b587de4150e2da0b"
server_key_iv: "7e19a87bd2125cc586a46d74b4d7203f"
server_key_version: "encryptionkey@0"
I20260811 18:47:39.349713 2796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:39.370810 2796 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:39.371801 2796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:39.372160 2796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:39.390618 2796 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:42325
I20260811 18:47:39.390641 2913 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:42325 every 8 connection(s)
I20260811 18:47:39.392127 2796 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:47:39.396328 2915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:39.397599 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 2796
I20260811 18:47:39.397795 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:47:39.398660 25700 external_mini_cluster.cc:1428] Setting key bf90a923254c83089fadf46b7ac8f021
I20260811 18:47:39.410414 2915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47517f1b218842058376e60851bd0283: Bootstrap starting.
I20260811 18:47:39.412720 2923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:39.400825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53486 (local address 127.25.25.62:42325)
0811 18:47:39.402043 (+ 1218us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:39.402055 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:39.402100 (+ 45us) server_negotiation.cc:407] Connection header received
0811 18:47:39.403697 (+ 1597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:39.403723 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:39.404292 (+ 569us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:39.404690 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:39.405267 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:39.406631 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:39.408015 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:39.408778 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:39.408967 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:39.410227 (+ 1260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:39.410235 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:39.410251 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:47:39.410861 (+ 610us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:39.410955 (+ 94us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:47:39.410978 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:39.411081 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:39.411316 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 18:47:39.411652 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":764,"thread_start_us":429,"threads_started":1}
I20260811 18:47:39.413863 2915 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 47517f1b218842058376e60851bd0283: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:39.415001 2915 log.cc:824] T 00000000000000000000000000000000 P 47517f1b218842058376e60851bd0283: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:39.416886 25700 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:47:39.418347 2915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47517f1b218842058376e60851bd0283: No bootstrap required, opened a new log
I20260811 18:47:39.426157 2915 raft_consensus.cc:348] T 00000000000000000000000000000000 P 47517f1b218842058376e60851bd0283 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47517f1b218842058376e60851bd0283" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42325 } }
I20260811 18:47:39.426594 2915 raft_consensus.cc:374] T 00000000000000000000000000000000 P 47517f1b218842058376e60851bd0283 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:39.426712 2915 raft_consensus.cc:729] T 00000000000000000000000000000000 P 47517f1b218842058376e60851bd0283 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47517f1b218842058376e60851bd0283, State: Initialized, Role: FOLLOWER
I20260811 18:47:39.427340 2915 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47517f1b218842058376e60851bd0283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47517f1b218842058376e60851bd0283" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42325 } }
I20260811 18:47:39.427568 2915 raft_consensus.cc:388] T 00000000000000000000000000000000 P 47517f1b218842058376e60851bd0283 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:47:39.427701 2915 raft_consensus.cc:482] T 00000000000000000000000000000000 P 47517f1b218842058376e60851bd0283 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:47:39.427855 2915 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 47517f1b218842058376e60851bd0283 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:39.430210 2915 raft_consensus.cc:504] T 00000000000000000000000000000000 P 47517f1b218842058376e60851bd0283 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47517f1b218842058376e60851bd0283" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42325 } }
I20260811 18:47:39.430790 2915 leader_election.cc:302] T 00000000000000000000000000000000 P 47517f1b218842058376e60851bd0283 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47517f1b218842058376e60851bd0283; no voters:
I20260811 18:47:39.431453 2915 leader_election.cc:288] T 00000000000000000000000000000000 P 47517f1b218842058376e60851bd0283 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:47:39.431605 2931 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 47517f1b218842058376e60851bd0283 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:39.432427 2931 raft_consensus.cc:686] T 00000000000000000000000000000000 P 47517f1b218842058376e60851bd0283 [term 1 LEADER]: Becoming Leader. State: Replica: 47517f1b218842058376e60851bd0283, State: Running, Role: LEADER
I20260811 18:47:39.432991 2931 consensus_queue.cc:237] T 00000000000000000000000000000000 P 47517f1b218842058376e60851bd0283 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47517f1b218842058376e60851bd0283" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42325 } }
I20260811 18:47:39.433691 2915 sys_catalog.cc:564] T 00000000000000000000000000000000 P 47517f1b218842058376e60851bd0283 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:47:39.436026 2934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47517f1b218842058376e60851bd0283 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47517f1b218842058376e60851bd0283. Latest consensus state: current_term: 1 leader_uuid: "47517f1b218842058376e60851bd0283" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47517f1b218842058376e60851bd0283" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42325 } } }
I20260811 18:47:39.436038 2932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47517f1b218842058376e60851bd0283 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "47517f1b218842058376e60851bd0283" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47517f1b218842058376e60851bd0283" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42325 } } }
I20260811 18:47:39.436512 2932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47517f1b218842058376e60851bd0283 [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:39.437093 2934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47517f1b218842058376e60851bd0283 [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:39.437865 2940 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:47:39.443490 2940 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:47:39.454303 2940 catalog_manager.cc:1347] Generated new cluster ID: e4314996ca664801ad311396c8343ee4
I20260811 18:47:39.454473 2940 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:47:39.473320 2940 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:47:39.474774 2940 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:47:39.485340 2940 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 47517f1b218842058376e60851bd0283: Generated new TSK 0
I20260811 18:47:39.486601 2940 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 18:47:39.531724 2971 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 18:47:39.531845 2971 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 18:47:39.533324 2923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:39.512368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53488 (local address 127.25.25.62:42325)
0811 18:47:39.512587 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:39.512595 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:39.512951 (+ 356us) server_negotiation.cc:407] Connection header received
0811 18:47:39.513181 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:39.513187 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:39.513291 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:39.513518 (+ 227us) server_negotiation.cc:226] Negotiated authn=JWT
0811 18:47:39.513979 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:39.515147 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:39.516807 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:39.517557 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:39.517685 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:39.518264 (+ 579us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 18:47:39.532557 (+ 14293us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46539/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 18:47:39.532994 (+ 437us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53488: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46539/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":87}
W20260811 18:47:39.533470 2923 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53488: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46539/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260811 18:47:39.533586 2969 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:47:39.512173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42325 (local address 127.0.0.1:53488)
0811 18:47:39.512836 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:39.512855 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:39.512996 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:39.513527 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:39.513531 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:39.513541 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0811 18:47:39.513804 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:39.513813 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:39.515341 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:39.515345 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:39.516605 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:39.516625 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:39.517770 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:39.517776 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:39.517927 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:39.517967 (+ 40us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 18:47:39.532860 (+ 14893us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46539/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 18:47:39.533139 (+ 279us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.25.25.62:42325: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46539/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":355,"threads_started":1}
I20260811 18:47:39.535319 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 2796
I20260811 18:47:39.536592 2903 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:39.635581 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 2796
2026-08-11T18:47:39Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (800 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 18:47:39.703536 25700 mini_oidc.cc:152] Starting JWKS server
I20260811 18:47:39.705554 25700 webserver.cc:460] Webserver started at https://127.0.0.1:44183/ using document root <none> and password file <none>
I20260811 18:47:39.705804 25700 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 18:47:39.706508 25700 webserver.cc:460] Webserver started at http://127.0.0.1:43031/ using document root <none> and password file <none>
2026-08-11T18:47:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:47:39Z Disabled control of system clock
I20260811 18:47:39.744809 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:46429
--webserver_interface=127.25.25.62
--webserver_port=0
--builtin_ntp_servers=127.25.25.20:42655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:46429
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44183/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 18:47:40.101179 2981 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:40.101538 2981 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:40.101676 2981 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:40.109441 2981 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:47:40.109586 2981 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:40.109658 2981 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:40.109738 2981 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:47:40.109807 2981 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 18:47:40.109890 2981 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 18:47:40.109943 2981 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44183/jwks.json
I20260811 18:47:40.119659 2981 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:42655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:46429
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:46429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44183/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:40.121148 2981 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:40.123248 2981 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:40.135908 2993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:40.135950 2990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:40.136206 2989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:40.137907 2981 server_base.cc:1034] running on GCE node
I20260811 18:47:40.138962 2981 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:40.140640 2981 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:40.141882 2981 hybrid_clock.cc:648] HybridClock initialized: now 1786474060141829 us; error 42 us; skew 500 ppm
I20260811 18:47:40.142278 2981 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:47:40.144848 2981 webserver.cc:460] Webserver started at http://127.25.25.62:34835/ using document root <none> and password file <none>
I20260811 18:47:40.145628 2981 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:40.145742 2981 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:40.146081 2981 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:40.149379 2981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "1179606e95fc44f7a894c177cca97f8d"
format_stamp: "Formatted at 2026-08-11 18:47:40 on dist-test-slave-lgr5"
server_key: "40910d6a13ef7a6c5c5d1b676a17de8d"
server_key_iv: "23977c914e9fb0a6b6dff7f10a06da08"
server_key_version: "encryptionkey@0"
I20260811 18:47:40.150250 2981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "1179606e95fc44f7a894c177cca97f8d"
format_stamp: "Formatted at 2026-08-11 18:47:40 on dist-test-slave-lgr5"
server_key: "40910d6a13ef7a6c5c5d1b676a17de8d"
server_key_iv: "23977c914e9fb0a6b6dff7f10a06da08"
server_key_version: "encryptionkey@0"
I20260811 18:47:40.156051 2981 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 18:47:40.160182 3002 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:40.161813 2981 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260811 18:47:40.162009 2981 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "1179606e95fc44f7a894c177cca97f8d"
format_stamp: "Formatted at 2026-08-11 18:47:40 on dist-test-slave-lgr5"
server_key: "40910d6a13ef7a6c5c5d1b676a17de8d"
server_key_iv: "23977c914e9fb0a6b6dff7f10a06da08"
server_key_version: "encryptionkey@0"
I20260811 18:47:40.162241 2981 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:40.175498 2981 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:40.176554 2981 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:40.176882 2981 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:40.195461 2981 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:46429
I20260811 18:47:40.195478 3109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:46429 every 8 connection(s)
I20260811 18:47:40.196996 2981 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:47:40.200717 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 2981
I20260811 18:47:40.200930 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:47:40.201264 3114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:40.201596 25700 external_mini_cluster.cc:1428] Setting key 6abb274039c550467677314d403df4a7
I20260811 18:47:40.215080 3114 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1179606e95fc44f7a894c177cca97f8d: Bootstrap starting.
I20260811 18:47:40.215993 3123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:40.203568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46786 (local address 127.25.25.62:46429)
0811 18:47:40.204798 (+ 1230us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:40.204811 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:40.204859 (+ 48us) server_negotiation.cc:407] Connection header received
0811 18:47:40.206535 (+ 1676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:40.206563 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:40.207112 (+ 549us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:40.207606 (+ 494us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:40.208305 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:40.209702 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:40.211110 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:40.211851 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:40.212071 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:40.213444 (+ 1373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:40.213453 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:40.213471 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:47:40.214050 (+ 579us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:40.214139 (+ 89us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:47:40.214164 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:40.214271 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:40.214539 (+ 268us) server_negotiation.cc:299] Negotiation successful
0811 18:47:40.214888 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":656,"thread_start_us":426,"threads_started":1}
I20260811 18:47:40.218479 3114 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1179606e95fc44f7a894c177cca97f8d: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:40.219630 3114 log.cc:824] T 00000000000000000000000000000000 P 1179606e95fc44f7a894c177cca97f8d: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:40.220034 25700 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:47:40.222944 3114 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1179606e95fc44f7a894c177cca97f8d: No bootstrap required, opened a new log
I20260811 18:47:40.231431 3114 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1179606e95fc44f7a894c177cca97f8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1179606e95fc44f7a894c177cca97f8d" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46429 } }
I20260811 18:47:40.231921 3114 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1179606e95fc44f7a894c177cca97f8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:40.232025 3114 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1179606e95fc44f7a894c177cca97f8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1179606e95fc44f7a894c177cca97f8d, State: Initialized, Role: FOLLOWER
I20260811 18:47:40.232676 3114 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1179606e95fc44f7a894c177cca97f8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1179606e95fc44f7a894c177cca97f8d" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46429 } }
I20260811 18:47:40.232975 3114 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1179606e95fc44f7a894c177cca97f8d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:47:40.233135 3114 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1179606e95fc44f7a894c177cca97f8d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:47:40.233332 3114 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1179606e95fc44f7a894c177cca97f8d [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:40.235728 3114 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1179606e95fc44f7a894c177cca97f8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1179606e95fc44f7a894c177cca97f8d" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46429 } }
I20260811 18:47:40.236336 3114 leader_election.cc:302] T 00000000000000000000000000000000 P 1179606e95fc44f7a894c177cca97f8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1179606e95fc44f7a894c177cca97f8d; no voters:
I20260811 18:47:40.236959 3114 leader_election.cc:288] T 00000000000000000000000000000000 P 1179606e95fc44f7a894c177cca97f8d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:47:40.237103 3127 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1179606e95fc44f7a894c177cca97f8d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:40.237895 3127 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1179606e95fc44f7a894c177cca97f8d [term 1 LEADER]: Becoming Leader. State: Replica: 1179606e95fc44f7a894c177cca97f8d, State: Running, Role: LEADER
I20260811 18:47:40.238431 3127 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1179606e95fc44f7a894c177cca97f8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1179606e95fc44f7a894c177cca97f8d" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46429 } }
I20260811 18:47:40.239112 3114 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1179606e95fc44f7a894c177cca97f8d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:47:40.241413 3131 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1179606e95fc44f7a894c177cca97f8d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1179606e95fc44f7a894c177cca97f8d. Latest consensus state: current_term: 1 leader_uuid: "1179606e95fc44f7a894c177cca97f8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1179606e95fc44f7a894c177cca97f8d" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46429 } } }
I20260811 18:47:40.241393 3130 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1179606e95fc44f7a894c177cca97f8d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1179606e95fc44f7a894c177cca97f8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1179606e95fc44f7a894c177cca97f8d" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46429 } } }
I20260811 18:47:40.241906 3130 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1179606e95fc44f7a894c177cca97f8d [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:40.241891 3131 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1179606e95fc44f7a894c177cca97f8d [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:40.243017 3138 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:47:40.249557 3138 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:47:40.260748 3138 catalog_manager.cc:1347] Generated new cluster ID: 0920efa57aac438290c48784d391ad17
I20260811 18:47:40.260905 3138 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:47:40.281563 3138 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:47:40.283804 3138 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:47:40.303678 3138 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1179606e95fc44f7a894c177cca97f8d: Generated new TSK 0
I20260811 18:47:40.304956 3138 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:47:40.330677 3123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:40.320539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46802 (local address 127.25.25.62:46429)
0811 18:47:40.320763 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:40.320770 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:40.321220 (+ 450us) server_negotiation.cc:407] Connection header received
0811 18:47:40.321461 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:40.321468 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:40.321576 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:40.321777 (+ 201us) server_negotiation.cc:226] Negotiated authn=JWT
0811 18:47:40.322326 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:40.323522 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:40.325282 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:40.326089 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:40.326276 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:40.326984 (+ 708us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 18:47:40.329606 (+ 2622us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44183/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 18:47:40.330337 (+ 731us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46802: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44183/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":69}
W20260811 18:47:40.330818 3123 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46802: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44183/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 18:47:40.332351 3172 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:47:40.320365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:46429 (local address 127.0.0.1:46802)
0811 18:47:40.321107 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:40.321125 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:40.321264 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:40.321775 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:40.321779 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:40.321790 (+ 11us) client_negotiation.cc:189] Negotiated authn=JWT
0811 18:47:40.322136 (+ 346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:40.322152 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:40.323767 (+ 1615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:40.323772 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:40.325059 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:40.325080 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:40.326416 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:40.326422 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:40.326587 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:40.326633 (+ 46us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 18:47:40.329910 (+ 3277us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44183/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 18:47:40.331803 (+ 1893us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.25.25.62:46429: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44183/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":601,"mutex_wait_us":1505,"thread_start_us":427,"threads_started":1}
I20260811 18:47:40.334009 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 2981
I20260811 18:47:40.335422 3094 generic_service.cc:196] Checking for leaks (request via RPC)
E20260811 18:47:40.344609 3173 webserver.cc:533] Webserver: sslize failed:
E20260811 18:47:40.344749 3173 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 18:47:40.433499 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 2981
2026-08-11T18:47:40Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (793 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T18:47:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:47:40Z Disabled control of system clock
I20260811 18:47:40.533324 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:40087
--webserver_interface=127.25.25.62
--webserver_port=0
--builtin_ntp_servers=127.25.25.20:43041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:40087
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474012733352-25700-0/testchainca.cert with env {}
W20260811 18:47:40.891049 3179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:40.891430 3179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:40.891564 3179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:40.899233 3179 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:47:40.899390 3179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:40.899461 3179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:40.899544 3179 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:47:40.899603 3179 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 18:47:40.899690 3179 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 18:47:40.899742 3179 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 18:47:40.910655 3179 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:43041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:40087
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:40087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474012733352-25700-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:40.912218 3179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:40.913714 3179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:40.926923 3191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:40.926944 3188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:40.926875 3195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:40.927688 3179 server_base.cc:1034] running on GCE node
I20260811 18:47:40.928649 3179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:40.930246 3179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:40.931468 3179 hybrid_clock.cc:648] HybridClock initialized: now 1786474060931423 us; error 44 us; skew 500 ppm
I20260811 18:47:40.931842 3179 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:47:40.934376 3179 webserver.cc:460] Webserver started at http://127.25.25.62:35909/ using document root <none> and password file <none>
I20260811 18:47:40.935187 3179 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:40.935316 3179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:40.935650 3179 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:40.938859 3179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "8a7b4356cb2147bb9144da6cac8bca3e"
format_stamp: "Formatted at 2026-08-11 18:47:40 on dist-test-slave-lgr5"
server_key: "705030a1d032d7c3600b7daec8ed2ddb"
server_key_iv: "2829d3c619c5df0e1d054c0f6e52b224"
server_key_version: "encryptionkey@0"
I20260811 18:47:40.939733 3179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "8a7b4356cb2147bb9144da6cac8bca3e"
format_stamp: "Formatted at 2026-08-11 18:47:40 on dist-test-slave-lgr5"
server_key: "705030a1d032d7c3600b7daec8ed2ddb"
server_key_iv: "2829d3c619c5df0e1d054c0f6e52b224"
server_key_version: "encryptionkey@0"
I20260811 18:47:40.945572 3179 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 18:47:40.949754 3203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:40.951251 3179 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260811 18:47:40.951463 3179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "8a7b4356cb2147bb9144da6cac8bca3e"
format_stamp: "Formatted at 2026-08-11 18:47:40 on dist-test-slave-lgr5"
server_key: "705030a1d032d7c3600b7daec8ed2ddb"
server_key_iv: "2829d3c619c5df0e1d054c0f6e52b224"
server_key_version: "encryptionkey@0"
I20260811 18:47:40.951707 3179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:40.980203 3179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:40.981153 3179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:40.981467 3179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:40.999930 3179 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:40087
I20260811 18:47:40.999962 3317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:40087 every 8 connection(s)
I20260811 18:47:41.001503 3179 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:47:41.006014 3318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:41.009642 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 3179
I20260811 18:47:41.009872 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:47:41.010756 25700 external_mini_cluster.cc:1428] Setting key 5a7a1a8bfa18fde94a215784e2c707f1
I20260811 18:47:41.020156 3318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a7b4356cb2147bb9144da6cac8bca3e: Bootstrap starting.
I20260811 18:47:41.023622 3318 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a7b4356cb2147bb9144da6cac8bca3e: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:41.025008 3318 log.cc:824] T 00000000000000000000000000000000 P 8a7b4356cb2147bb9144da6cac8bca3e: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:41.026109 3322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:41.013222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41702 (local address 127.25.25.62:40087)
0811 18:47:41.014310 (+ 1088us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:41.014326 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:41.014376 (+ 50us) server_negotiation.cc:407] Connection header received
0811 18:47:41.016233 (+ 1857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:41.016264 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:41.016858 (+ 594us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:41.017335 (+ 477us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:41.018059 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:41.019483 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:41.020975 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:41.021706 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:41.021899 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:41.023088 (+ 1189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:41.023096 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:41.023113 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:47:41.023765 (+ 652us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:41.023887 (+ 122us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:47:41.023911 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:41.024032 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:41.024333 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 18:47:41.024705 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":615,"thread_start_us":347,"threads_started":1}
I20260811 18:47:41.028574 3318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a7b4356cb2147bb9144da6cac8bca3e: No bootstrap required, opened a new log
I20260811 18:47:41.030282 25700 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:47:41.036713 3318 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a7b4356cb2147bb9144da6cac8bca3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a7b4356cb2147bb9144da6cac8bca3e" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40087 } }
I20260811 18:47:41.037158 3318 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a7b4356cb2147bb9144da6cac8bca3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:41.037269 3318 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a7b4356cb2147bb9144da6cac8bca3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a7b4356cb2147bb9144da6cac8bca3e, State: Initialized, Role: FOLLOWER
I20260811 18:47:41.037889 3318 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a7b4356cb2147bb9144da6cac8bca3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a7b4356cb2147bb9144da6cac8bca3e" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40087 } }
I20260811 18:47:41.038128 3318 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a7b4356cb2147bb9144da6cac8bca3e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:47:41.038305 3318 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a7b4356cb2147bb9144da6cac8bca3e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:47:41.038499 3318 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a7b4356cb2147bb9144da6cac8bca3e [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:41.041088 3318 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a7b4356cb2147bb9144da6cac8bca3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a7b4356cb2147bb9144da6cac8bca3e" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40087 } }
I20260811 18:47:41.041651 3318 leader_election.cc:302] T 00000000000000000000000000000000 P 8a7b4356cb2147bb9144da6cac8bca3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a7b4356cb2147bb9144da6cac8bca3e; no voters:
I20260811 18:47:41.042272 3318 leader_election.cc:288] T 00000000000000000000000000000000 P 8a7b4356cb2147bb9144da6cac8bca3e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:47:41.042462 3324 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a7b4356cb2147bb9144da6cac8bca3e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:41.043151 3324 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a7b4356cb2147bb9144da6cac8bca3e [term 1 LEADER]: Becoming Leader. State: Replica: 8a7b4356cb2147bb9144da6cac8bca3e, State: Running, Role: LEADER
I20260811 18:47:41.043741 3324 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a7b4356cb2147bb9144da6cac8bca3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a7b4356cb2147bb9144da6cac8bca3e" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40087 } }
I20260811 18:47:41.044488 3318 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a7b4356cb2147bb9144da6cac8bca3e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:47:41.046751 3330 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a7b4356cb2147bb9144da6cac8bca3e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a7b4356cb2147bb9144da6cac8bca3e. Latest consensus state: current_term: 1 leader_uuid: "8a7b4356cb2147bb9144da6cac8bca3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a7b4356cb2147bb9144da6cac8bca3e" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40087 } } }
I20260811 18:47:41.047259 3330 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a7b4356cb2147bb9144da6cac8bca3e [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:41.046993 3325 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a7b4356cb2147bb9144da6cac8bca3e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a7b4356cb2147bb9144da6cac8bca3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a7b4356cb2147bb9144da6cac8bca3e" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40087 } } }
I20260811 18:47:41.047379 3325 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a7b4356cb2147bb9144da6cac8bca3e [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:41.048856 3342 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:47:41.055004 3342 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:47:41.065430 3342 catalog_manager.cc:1347] Generated new cluster ID: 8bb83eacae0e4c24983f55d2c1e70e3a
I20260811 18:47:41.065572 3342 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:47:41.111370 3342 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:47:41.113437 3342 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:47:41.126935 3342 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8a7b4356cb2147bb9144da6cac8bca3e: Generated new TSK 0
I20260811 18:47:41.128129 3342 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:47:41.205313 3322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:41.155114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41714 (local address 127.25.25.62:40087)
0811 18:47:41.155342 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:41.155355 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:41.155817 (+ 462us) server_negotiation.cc:407] Connection header received
0811 18:47:41.156138 (+ 321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:41.156145 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:41.156271 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:41.156467 (+ 196us) server_negotiation.cc:226] Negotiated authn=JWT
0811 18:47:41.156954 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:41.158105 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:41.159593 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:41.160333 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:41.160484 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:41.161025 (+ 541us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 18:47:41.204460 (+ 43435us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 18:47:41.204938 (+ 478us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:41714: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":69}
W20260811 18:47:41.205386 3368 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:47:41.154889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40087 (local address 127.0.0.1:41714)
0811 18:47:41.155706 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:41.155724 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:41.155867 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:41.156503 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:41.156507 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:41.156519 (+ 12us) client_negotiation.cc:189] Negotiated authn=JWT
0811 18:47:41.156799 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:41.156810 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:41.158283 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:41.158287 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:41.159434 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:41.159448 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:41.160531 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:41.160536 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:41.160680 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:41.160720 (+ 40us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 18:47:41.204807 (+ 44087us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 18:47:41.205072 (+ 265us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.25.25.62:40087: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":673,"thread_start_us":445,"threads_started":1}
W20260811 18:47:41.205480 3322 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:41714: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
I20260811 18:47:41.206772 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 3179
I20260811 18:47:41.208032 3308 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:41.312427 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 3179
2026-08-11T18:47:41Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (857 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (441 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (442 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:47:42 dist-test-slave-lgr5 krb5kdc[3396](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:47:42 dist-test-slave-lgr5 krb5kdc[3396](info): set up 2 sockets
Aug 11 18:47:42 dist-test-slave-lgr5 krb5kdc[3396](info): commencing operation
krb5kdc: starting...
W20260811 18:47:43.469811 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.229s user 0.000s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:47:43 dist-test-slave-lgr5 krb5kdc[3396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474063, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:47:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:47:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:47:43.731361 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:37427
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:44301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:37427
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:44.083513 3429 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:44.083832 3429 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:44.083957 3429 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:44.091521 3429 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:47:44.091656 3429 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:44.091707 3429 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:44.091786 3429 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:47:44.091845 3429 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:47:44.102325 3429 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:44301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:37427
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:37427
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:44.103787 3429 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:44.105216 3429 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:44.117342 3437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:44.117408 3435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:44.117384 3440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:44.118314 3429 server_base.cc:1034] running on GCE node
I20260811 18:47:44.119208 3429 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:44.120854 3429 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:44.122099 3429 hybrid_clock.cc:648] HybridClock initialized: now 1786474064122039 us; error 44 us; skew 500 ppm
I20260811 18:47:44.122488 3429 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:44 dist-test-slave-lgr5 krb5kdc[3396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474064, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:44.130273 3429 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:47:44.132014 3429 webserver.cc:460] Webserver started at http://127.25.25.62:42687/ using document root <none> and password file <none>
I20260811 18:47:44.132784 3429 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:44.132895 3429 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:44.133193 3429 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:44.136621 3429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "2838953e893e477c83a1dd91d1d880b3"
format_stamp: "Formatted at 2026-08-11 18:47:44 on dist-test-slave-lgr5"
server_key: "87d6012eb456b0f46fc7f8034ebb9043"
server_key_iv: "4e06ba5d786e10ed546d4acf5b82ed86"
server_key_version: "encryptionkey@0"
I20260811 18:47:44.137540 3429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "2838953e893e477c83a1dd91d1d880b3"
format_stamp: "Formatted at 2026-08-11 18:47:44 on dist-test-slave-lgr5"
server_key: "87d6012eb456b0f46fc7f8034ebb9043"
server_key_iv: "4e06ba5d786e10ed546d4acf5b82ed86"
server_key_version: "encryptionkey@0"
I20260811 18:47:44.143432 3429 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 18:47:44.147372 3453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:44.148850 3429 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:47:44.149031 3429 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "2838953e893e477c83a1dd91d1d880b3"
format_stamp: "Formatted at 2026-08-11 18:47:44 on dist-test-slave-lgr5"
server_key: "87d6012eb456b0f46fc7f8034ebb9043"
server_key_iv: "4e06ba5d786e10ed546d4acf5b82ed86"
server_key_version: "encryptionkey@0"
I20260811 18:47:44.149225 3429 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:44.170548 3429 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:44.175408 3429 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:44.175673 3429 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:44.194375 3429 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:37427
I20260811 18:47:44.194454 3549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:37427 every 8 connection(s)
I20260811 18:47:44.195838 3429 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:47:44.198585 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 3429
I20260811 18:47:44.198829 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:47:44.199744 25700 external_mini_cluster.cc:1428] Setting key adfc2b049e7c9ade45edd2296491ba69
I20260811 18:47:44.200695 3550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 18:47:44 dist-test-slave-lgr5 krb5kdc[3396](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474063, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:44.216785 3550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2838953e893e477c83a1dd91d1d880b3: Bootstrap starting.
I20260811 18:47:44.220600 3550 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2838953e893e477c83a1dd91d1d880b3: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:44.221808 3550 log.cc:824] T 00000000000000000000000000000000 P 2838953e893e477c83a1dd91d1d880b3: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:44.225142 3554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:44.202200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42240 (local address 127.25.25.62:37427)
0811 18:47:44.203041 (+ 841us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:44.203054 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:44.203097 (+ 43us) server_negotiation.cc:407] Connection header received
0811 18:47:44.204759 (+ 1662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:44.204784 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:44.205251 (+ 467us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:44.205617 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:44.207509 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:44.209062 (+ 1553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:44.210962 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:44.211876 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:44.212052 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:44.217104 (+ 5052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:44.217115 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:44.217133 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:44.217178 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:44.220427 (+ 3249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:44.221288 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:44.221296 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:44.221304 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:44.221521 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:44.221992 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:44.221996 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:44.221998 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:44.222625 (+ 627us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:44.222963 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:44.223492 (+ 529us) server_negotiation.cc:299] Negotiation successful
0811 18:47:44.223976 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":617,"thread_start_us":383,"threads_started":1}
I20260811 18:47:44.225194 3550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2838953e893e477c83a1dd91d1d880b3: No bootstrap required, opened a new log
I20260811 18:47:44.233353 3550 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2838953e893e477c83a1dd91d1d880b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2838953e893e477c83a1dd91d1d880b3" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 37427 } }
I20260811 18:47:44.233829 3550 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2838953e893e477c83a1dd91d1d880b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:44.233950 3550 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2838953e893e477c83a1dd91d1d880b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2838953e893e477c83a1dd91d1d880b3, State: Initialized, Role: FOLLOWER
I20260811 18:47:44.234587 3550 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2838953e893e477c83a1dd91d1d880b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2838953e893e477c83a1dd91d1d880b3" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 37427 } }
I20260811 18:47:44.234871 3550 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2838953e893e477c83a1dd91d1d880b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:47:44.235049 3550 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2838953e893e477c83a1dd91d1d880b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:47:44.235242 3550 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2838953e893e477c83a1dd91d1d880b3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:44.237552 3550 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2838953e893e477c83a1dd91d1d880b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2838953e893e477c83a1dd91d1d880b3" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 37427 } }
I20260811 18:47:44.238140 3550 leader_election.cc:302] T 00000000000000000000000000000000 P 2838953e893e477c83a1dd91d1d880b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2838953e893e477c83a1dd91d1d880b3; no voters:
I20260811 18:47:44.238765 3550 leader_election.cc:288] T 00000000000000000000000000000000 P 2838953e893e477c83a1dd91d1d880b3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:47:44.238925 3565 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2838953e893e477c83a1dd91d1d880b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:44.239599 3565 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2838953e893e477c83a1dd91d1d880b3 [term 1 LEADER]: Becoming Leader. State: Replica: 2838953e893e477c83a1dd91d1d880b3, State: Running, Role: LEADER
I20260811 18:47:44.240356 3565 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2838953e893e477c83a1dd91d1d880b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2838953e893e477c83a1dd91d1d880b3" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 37427 } }
I20260811 18:47:44.241222 3550 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2838953e893e477c83a1dd91d1d880b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:47:44.243328 3568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2838953e893e477c83a1dd91d1d880b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2838953e893e477c83a1dd91d1d880b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2838953e893e477c83a1dd91d1d880b3" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 37427 } } }
I20260811 18:47:44.243673 3568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2838953e893e477c83a1dd91d1d880b3 [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:44.243850 3566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2838953e893e477c83a1dd91d1d880b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2838953e893e477c83a1dd91d1d880b3. Latest consensus state: current_term: 1 leader_uuid: "2838953e893e477c83a1dd91d1d880b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2838953e893e477c83a1dd91d1d880b3" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 37427 } } }
I20260811 18:47:44.244199 3566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2838953e893e477c83a1dd91d1d880b3 [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:44.245968 3573 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:47:44.251049 3573 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:47:44.260964 3573 catalog_manager.cc:1347] Generated new cluster ID: df917a54c656429f8482cb6ba4a5c741
I20260811 18:47:44.261106 3573 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:47:44.275662 3573 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:47:44.277148 3573 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:47:44.288213 3573 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2838953e893e477c83a1dd91d1d880b3: Generated new TSK 0
I20260811 18:47:44.289130 3573 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.25.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
I20260811 18:47:44.363606 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:0
--local_ip_for_outbound_sockets=127.25.25.1
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:37427
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:44301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:44.732153 3597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:44.732513 3597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:44.732658 3597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:44.740360 3597 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:44.740525 3597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:44.740679 3597 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:47:44.752596 3597 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:44301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:37427
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:44.754096 3597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:44.755613 3597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:44.769415 3606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:44.769564 3604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:44.769474 3613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:44.770215 3597 server_base.cc:1034] running on GCE node
I20260811 18:47:44.770941 3597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:44.772152 3597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:44.773460 3597 hybrid_clock.cc:648] HybridClock initialized: now 1786474064773371 us; error 67 us; skew 500 ppm
I20260811 18:47:44.773880 3597 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:44 dist-test-slave-lgr5 krb5kdc[3396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474064, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:44.777514 3597 init.cc:377] Logged in from keytab as kudu/127.25.25.1@KRBTEST.COM (short username kudu)
I20260811 18:47:44.779389 3597 webserver.cc:460] Webserver started at http://127.25.25.1:39155/ using document root <none> and password file <none>
I20260811 18:47:44.780218 3597 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:44.780345 3597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:44.780660 3597 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:44.783905 3597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-0/data/instance:
uuid: "6cc0b364965b4b758ce321bca89dc722"
format_stamp: "Formatted at 2026-08-11 18:47:44 on dist-test-slave-lgr5"
server_key: "2d5c7f22f9c2b29011f7aaec1644dac6"
server_key_iv: "2cd0d26d6f4e28fd0f992ae799b63505"
server_key_version: "encryptionkey@0"
I20260811 18:47:44.784853 3597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance:
uuid: "6cc0b364965b4b758ce321bca89dc722"
format_stamp: "Formatted at 2026-08-11 18:47:44 on dist-test-slave-lgr5"
server_key: "2d5c7f22f9c2b29011f7aaec1644dac6"
server_key_iv: "2cd0d26d6f4e28fd0f992ae799b63505"
server_key_version: "encryptionkey@0"
I20260811 18:47:44.790925 3597 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s
I20260811 18:47:44.794803 3633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:44.796387 3597 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 18:47:44.796584 3597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "6cc0b364965b4b758ce321bca89dc722"
format_stamp: "Formatted at 2026-08-11 18:47:44 on dist-test-slave-lgr5"
server_key: "2d5c7f22f9c2b29011f7aaec1644dac6"
server_key_iv: "2cd0d26d6f4e28fd0f992ae799b63505"
server_key_version: "encryptionkey@0"
I20260811 18:47:44.796783 3597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:44.811944 3597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:44.817636 3597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:44.817968 3597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:44.819139 3597 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:47:44.820823 3597 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:44.820919 3597 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:44.821045 3597 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:44.821101 3597 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:44.855444 3597 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:38527
I20260811 18:47:44.855509 3853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:38527 every 8 connection(s)
I20260811 18:47:44.856868 3597 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:47:44.866187 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 3597
I20260811 18:47:44.866374 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance
I20260811 18:47:44.867033 25700 external_mini_cluster.cc:1428] Setting key 07765508d3e898ba3bdd80c63c6ef0ec
Aug 11 18:47:44 dist-test-slave-lgr5 krb5kdc[3396](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474064, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:44.879190 3864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:44.859518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:60799 (local address 127.25.25.62:37427)
0811 18:47:44.859997 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:44.860001 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:44.860980 (+ 979us) server_negotiation.cc:407] Connection header received
0811 18:47:44.862942 (+ 1962us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:44.862948 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:44.863052 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:44.863155 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:44.864989 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:44.865752 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:44.867728 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:44.868310 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:44.868420 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:44.872582 (+ 4162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:44.872589 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:44.872594 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:44.872640 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:44.875625 (+ 2985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:44.876555 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:44.876561 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:44.876565 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:44.876722 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:44.877155 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:44.877160 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:44.877162 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:44.877508 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:44.877655 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:44.878563 (+ 908us) server_negotiation.cc:299] Negotiation successful
0811 18:47:44.878838 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":241,"threads_started":1}
I20260811 18:47:44.880610 3865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:44.859985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:37427 (local address 127.25.25.1:60799)
0811 18:47:44.860795 (+ 810us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:44.860849 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:44.862601 (+ 1752us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:44.863438 (+ 837us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:44.863448 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:44.864051 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:44.864773 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:44.864795 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:44.865987 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:44.865992 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:44.867540 (+ 1548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:44.867558 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:44.868603 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:44.868611 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:44.868938 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:44.869778 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:44.869803 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:44.872277 (+ 2474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:44.875806 (+ 3529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:44.875816 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:44.875833 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:44.876400 (+ 567us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:44.876817 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:44.876820 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:44.876822 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:44.877044 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:44.877681 (+ 637us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:44.877689 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:44.878115 (+ 426us) client_negotiation.cc:769] Sending connection context
0811 18:47:44.878407 (+ 292us) client_negotiation.cc:240] Negotiation successful
0811 18:47:44.878961 (+ 554us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":319,"threads_started":1}
I20260811 18:47:44.882360 3855 heartbeater.cc:347] Connected to a master server at 127.25.25.62:37427
I20260811 18:47:44.882691 3855 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:44.883478 3855 heartbeater.cc:511] Master 127.25.25.62:37427 requested a full tablet report, sending...
I20260811 18:47:44.885830 3477 ts_manager.cc:194] Registered new tserver with Master: 6cc0b364965b4b758ce321bca89dc722 (127.25.25.1:38527)
I20260811 18:47:44.887378 3477 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.1@KRBTEST.COM'} at 127.25.25.1:60799
WARNING: no policy specified for kudu/127.25.25.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
I20260811 18:47:44.925527 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:0
--local_ip_for_outbound_sockets=127.25.25.2
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:37427
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:44301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:45.285040 3870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:45.285403 3870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:45.285539 3870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:45.294152 3870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:45.294329 3870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:45.294497 3870 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:47:45.305264 3870 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:44301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:37427
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:45.306711 3870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:45.308175 3870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:45.321605 3878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:45.321537 3887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:45.321573 3882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:45.322376 3870 server_base.cc:1034] running on GCE node
I20260811 18:47:45.323000 3870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:45.323974 3870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:45.325178 3870 hybrid_clock.cc:648] HybridClock initialized: now 1786474065325121 us; error 44 us; skew 500 ppm
I20260811 18:47:45.325526 3870 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:45 dist-test-slave-lgr5 krb5kdc[3396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474065, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:45.328846 3870 init.cc:377] Logged in from keytab as kudu/127.25.25.2@KRBTEST.COM (short username kudu)
I20260811 18:47:45.330380 3870 webserver.cc:460] Webserver started at http://127.25.25.2:46419/ using document root <none> and password file <none>
I20260811 18:47:45.331102 3870 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:45.331220 3870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:45.331537 3870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:45.334826 3870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-1/data/instance:
uuid: "55e7d0e282b14adcb7a38628d4fca3b3"
format_stamp: "Formatted at 2026-08-11 18:47:45 on dist-test-slave-lgr5"
server_key: "328f342f7327f651346cbdb6530cfe22"
server_key_iv: "4de44649fde9c53e836b8e82fbd6411a"
server_key_version: "encryptionkey@0"
I20260811 18:47:45.335743 3870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance:
uuid: "55e7d0e282b14adcb7a38628d4fca3b3"
format_stamp: "Formatted at 2026-08-11 18:47:45 on dist-test-slave-lgr5"
server_key: "328f342f7327f651346cbdb6530cfe22"
server_key_iv: "4de44649fde9c53e836b8e82fbd6411a"
server_key_version: "encryptionkey@0"
I20260811 18:47:45.341802 3870 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260811 18:47:45.345762 3900 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:45.347352 3870 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 18:47:45.347538 3870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "55e7d0e282b14adcb7a38628d4fca3b3"
format_stamp: "Formatted at 2026-08-11 18:47:45 on dist-test-slave-lgr5"
server_key: "328f342f7327f651346cbdb6530cfe22"
server_key_iv: "4de44649fde9c53e836b8e82fbd6411a"
server_key_version: "encryptionkey@0"
I20260811 18:47:45.347777 3870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:45.367787 3870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:45.372210 3870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:45.372491 3870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:45.373530 3870 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:47:45.375128 3870 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:45.375208 3870 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:45.375315 3870 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:45.375360 3870 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:45.408883 3870 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:45693
I20260811 18:47:45.408923 4112 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:45693 every 8 connection(s)
I20260811 18:47:45.410234 3870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:47:45.412671 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 3870
I20260811 18:47:45.412868 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance
I20260811 18:47:45.413491 25700 external_mini_cluster.cc:1428] Setting key 18a51e05590ddc7b1e46979c7926d408
Aug 11 18:47:45 dist-test-slave-lgr5 krb5kdc[3396](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474065, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:45.435127 4116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:45.412915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:53415 (local address 127.25.25.62:37427)
0811 18:47:45.413468 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:45.413475 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:45.414637 (+ 1162us) server_negotiation.cc:407] Connection header received
0811 18:47:45.417209 (+ 2572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:45.417215 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:45.417301 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:45.417404 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:45.419724 (+ 2320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:45.420729 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:45.423111 (+ 2382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:45.423668 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:45.423780 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:45.428213 (+ 4433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:45.428219 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:45.428223 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:45.428266 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:45.431515 (+ 3249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:45.432563 (+ 1048us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:45.432568 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:45.432571 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:45.432758 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:45.433277 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:45.433281 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:45.433283 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:45.433576 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:45.433688 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:45.434634 (+ 946us) server_negotiation.cc:299] Negotiation successful
0811 18:47:45.434823 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":268,"threads_started":1}
I20260811 18:47:45.436789 4117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:45.413580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:37427 (local address 127.25.25.2:53415)
0811 18:47:45.414452 (+ 872us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:45.414506 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:45.416840 (+ 2334us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:45.417741 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:45.417755 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:45.418600 (+ 845us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:45.419515 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:45.419546 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:45.420916 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:45.420921 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:45.422928 (+ 2007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:45.422948 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:45.423937 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:45.423944 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:45.424304 (+ 360us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:45.425144 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:45.425182 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:45.427858 (+ 2676us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:45.431714 (+ 3856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:45.431726 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:45.431747 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:45.432431 (+ 684us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:45.432878 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:45.432883 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:45.432886 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:45.433160 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:45.433702 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:45.433711 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:45.434225 (+ 514us) client_negotiation.cc:769] Sending connection context
0811 18:47:45.434571 (+ 346us) client_negotiation.cc:240] Negotiation successful
0811 18:47:45.435147 (+ 576us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":358,"threads_started":1}
I20260811 18:47:45.438367 4113 heartbeater.cc:347] Connected to a master server at 127.25.25.62:37427
I20260811 18:47:45.438720 4113 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:45.439695 4113 heartbeater.cc:511] Master 127.25.25.62:37427 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.25.25.3@KRBTEST.COM; defaulting to no policy
I20260811 18:47:45.441711 3477 ts_manager.cc:194] Registered new tserver with Master: 55e7d0e282b14adcb7a38628d4fca3b3 (127.25.25.2:45693)
I20260811 18:47:45.442749 3477 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.2@KRBTEST.COM'} at 127.25.25.2:53415
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
I20260811 18:47:45.477190 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:0
--local_ip_for_outbound_sockets=127.25.25.3
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:37427
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:44301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:45.834403 4121 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:45.834723 4121 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:45.834824 4121 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:45.842697 4121 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:45.842826 4121 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:45.842955 4121 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:47:45.854143 4121 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:44301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:37427
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:45.855744 4121 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:45.857321 4121 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:45.871800 4128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:45.872053 4127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:45.871855 4130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:45.873165 4121 server_base.cc:1034] running on GCE node
I20260811 18:47:45.873886 4121 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:45.874929 4121 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:45.876202 4121 hybrid_clock.cc:648] HybridClock initialized: now 1786474065876143 us; error 40 us; skew 500 ppm
I20260811 18:47:45.876562 4121 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:45 dist-test-slave-lgr5 krb5kdc[3396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474065, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:45.879792 4121 init.cc:377] Logged in from keytab as kudu/127.25.25.3@KRBTEST.COM (short username kudu)
I20260811 18:47:45.881346 4121 webserver.cc:460] Webserver started at http://127.25.25.3:41309/ using document root <none> and password file <none>
I20260811 18:47:45.882114 4121 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:45.882252 4121 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:45.882570 4121 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:45.886144 4121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-2/data/instance:
uuid: "166ddbeb3ee04f569a44be752b22c3cc"
format_stamp: "Formatted at 2026-08-11 18:47:45 on dist-test-slave-lgr5"
server_key: "052a510c48e10643ce040a0bfdeeb343"
server_key_iv: "9823fd18954180f7d59063d4492099e9"
server_key_version: "encryptionkey@0"
I20260811 18:47:45.887382 4121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance:
uuid: "166ddbeb3ee04f569a44be752b22c3cc"
format_stamp: "Formatted at 2026-08-11 18:47:45 on dist-test-slave-lgr5"
server_key: "052a510c48e10643ce040a0bfdeeb343"
server_key_iv: "9823fd18954180f7d59063d4492099e9"
server_key_version: "encryptionkey@0"
I20260811 18:47:45.890942 3855 heartbeater.cc:503] Master 127.25.25.62:37427 was elected leader, sending a full tablet report...
I20260811 18:47:45.894439 4121 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.009s sys 0.000s
I20260811 18:47:45.899185 4139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:45.901051 4121 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 18:47:45.901281 4121 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "166ddbeb3ee04f569a44be752b22c3cc"
format_stamp: "Formatted at 2026-08-11 18:47:45 on dist-test-slave-lgr5"
server_key: "052a510c48e10643ce040a0bfdeeb343"
server_key_iv: "9823fd18954180f7d59063d4492099e9"
server_key_version: "encryptionkey@0"
I20260811 18:47:45.901549 4121 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:45.931173 4121 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:45.936312 4121 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:45.936623 4121 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:45.937722 4121 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:47:45.939246 4121 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:45.939345 4121 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:45.939457 4121 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:45.939505 4121 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:45.975234 4121 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:46305
I20260811 18:47:45.975270 4340 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:46305 every 8 connection(s)
I20260811 18:47:45.977049 4121 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:47:45.984582 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 4121
I20260811 18:47:45.984745 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance
I20260811 18:47:45.985189 25700 external_mini_cluster.cc:1428] Setting key 2f007b2662cb2c69e42e2021d7c49969
Aug 11 18:47:45 dist-test-slave-lgr5 krb5kdc[3396](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474065, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:47:45.999135 4345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:45.980578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:54109 (local address 127.25.25.62:37427)
0811 18:47:45.981030 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:45.981035 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:45.982122 (+ 1087us) server_negotiation.cc:407] Connection header received
0811 18:47:45.984182 (+ 2060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:45.984188 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:45.984297 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:45.984400 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:45.986345 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:45.987353 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:45.989162 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:45.989558 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:45.989671 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:45.993190 (+ 3519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:45.993195 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:45.993199 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:45.993239 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:45.995830 (+ 2591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:45.996656 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:45.996662 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:45.996664 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:45.996792 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:45.997233 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:45.997237 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:45.997239 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:45.997526 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:45.997678 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:45.998462 (+ 784us) server_negotiation.cc:299] Negotiation successful
0811 18:47:45.998720 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":226,"threads_started":1}
I20260811 18:47:46.000301 4346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:45.981063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:37427 (local address 127.25.25.3:54109)
0811 18:47:45.981935 (+ 872us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:45.981987 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:45.983810 (+ 1823us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:45.984719 (+ 909us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:45.984733 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:45.985376 (+ 643us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:45.986152 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:45.986176 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:45.987532 (+ 1356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:45.987536 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:45.989012 (+ 1476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:45.989031 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:45.989792 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:45.989800 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:45.990026 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:45.990664 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:45.990688 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:45.992976 (+ 2288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:45.995976 (+ 3000us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:45.995987 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:45.996007 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:45.996537 (+ 530us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:45.996901 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:45.996906 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:45.996910 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:45.997114 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:45.997662 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:45.997671 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:45.998058 (+ 387us) client_negotiation.cc:769] Sending connection context
0811 18:47:45.998323 (+ 265us) client_negotiation.cc:240] Negotiation successful
0811 18:47:45.998916 (+ 593us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":623,"thread_start_us":403,"threads_started":1}
I20260811 18:47:46.001830 4341 heartbeater.cc:347] Connected to a master server at 127.25.25.62:37427
I20260811 18:47:46.002151 4341 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:46.002928 4341 heartbeater.cc:511] Master 127.25.25.62:37427 requested a full tablet report, sending...
I20260811 18:47:46.004644 3477 ts_manager.cc:194] Registered new tserver with Master: 166ddbeb3ee04f569a44be752b22c3cc (127.25.25.3:46305)
I20260811 18:47:46.005525 3477 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.3@KRBTEST.COM'} at 127.25.25.3:54109
I20260811 18:47:46.014042 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/test-admin.keytab.
Aug 11 18:47:46 dist-test-slave-lgr5 krb5kdc[3396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474066, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:46.045701 25700 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 18:47:46.051505 4358 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:47:46.048639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36934 (local address 127.25.25.1:38527)
0811 18:47:46.049361 (+ 722us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:46.049372 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:46.049422 (+ 50us) server_negotiation.cc:407] Connection header received
0811 18:47:46.049503 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:46.049510 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:46.049718 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:46.049878 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:46.051007 (+ 1129us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36934: BlockingRecv error: recv got EOF from 127.0.0.1:36934 (error 108)
Metrics: {"server-negotiator.queue_time_us":501,"thread_start_us":327,"threads_started":1}
W20260811 18:47:46.051555 25700 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/krb5cc' of type FILE
Aug 11 18:47:46 dist-test-slave-lgr5 krb5kdc[3396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474066, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:46.053647 25700 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 18:47:46 dist-test-slave-lgr5 krb5kdc[3396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474066, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:46.055123 25700 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 18:47:46 dist-test-slave-lgr5 krb5kdc[3396](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474066, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.1@KRBTEST.COM
I20260811 18:47:46.071866 4358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:46.057115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36942 (local address 127.25.25.1:38527)
0811 18:47:46.057325 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:46.057330 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:46.057473 (+ 143us) server_negotiation.cc:407] Connection header received
0811 18:47:46.057625 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:46.057629 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:46.057694 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:46.057777 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:46.059025 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:46.060160 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:46.061528 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:46.062227 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:46.062359 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:46.066197 (+ 3838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:46.066213 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:46.066229 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:46.066280 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:46.069243 (+ 2963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:46.070001 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:46.070009 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:46.070011 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:46.070149 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:46.070453 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:46.070456 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:46.070458 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:46.070853 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:46.071080 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:46.071347 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 18:47:46.071602 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260811 18:47:46.078025 4358 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:47:46.076162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36956 (local address 127.25.25.1:38527)
0811 18:47:46.076364 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:46.076370 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:46.076644 (+ 274us) server_negotiation.cc:407] Connection header received
0811 18:47:46.076815 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:46.076821 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:46.076903 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:46.076988 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:46.077766 (+ 778us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36956: BlockingRecv error: recv got EOF from 127.0.0.1:36956 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260811 18:47:46.078387 25700 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/krb5cc' of type FILE: Runtime error: Bad format in credentials cache (filename: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/krb5cc)
Aug 11 18:47:46 dist-test-slave-lgr5 krb5kdc[3396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474066, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:46.079943 25700 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 18:47:46 dist-test-slave-lgr5 krb5kdc[3396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474066, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:46.081372 25700 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 18:47:46 dist-test-slave-lgr5 krb5kdc[3396](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474066, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.1@KRBTEST.COM
I20260811 18:47:46.096731 4358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:46.082965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36972 (local address 127.25.25.1:38527)
0811 18:47:46.083221 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:46.083227 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:46.083379 (+ 152us) server_negotiation.cc:407] Connection header received
0811 18:47:46.083616 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:46.083621 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:46.083694 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:46.083785 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:46.084838 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:46.085662 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:46.086942 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:46.087506 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:46.087629 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:46.091266 (+ 3637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:46.091272 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:46.091275 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:46.091326 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:46.093932 (+ 2606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:46.094641 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:46.094645 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:46.094647 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:46.094788 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:46.095168 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:46.095173 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:46.095175 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:46.095582 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:46.095834 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:46.096126 (+ 292us) server_negotiation.cc:299] Negotiation successful
0811 18:47:46.096418 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
W20260811 18:47:46.101689 4358 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:47:46.099708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36978 (local address 127.25.25.1:38527)
0811 18:47:46.099922 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:46.099928 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:46.100127 (+ 199us) server_negotiation.cc:407] Connection header received
0811 18:47:46.100380 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:46.100385 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:46.100477 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:46.100584 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:46.101409 (+ 825us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36978: BlockingRecv error: recv got EOF from 127.0.0.1:36978 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260811 18:47:46.101817 25700 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474012733352-25700-0/krb5kdc/krb5cc' of type FILE
Aug 11 18:47:46 dist-test-slave-lgr5 krb5kdc[3396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474066, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:46.103363 25700 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 18:47:46 dist-test-slave-lgr5 krb5kdc[3396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474066, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:46.104766 25700 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 18:47:46 dist-test-slave-lgr5 krb5kdc[3396](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474066, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.1@KRBTEST.COM
I20260811 18:47:46.121927 4358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:46.106289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36992 (local address 127.25.25.1:38527)
0811 18:47:46.106564 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:46.106571 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:46.106852 (+ 281us) server_negotiation.cc:407] Connection header received
0811 18:47:46.107039 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:46.107044 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:46.107112 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:46.107191 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:46.108291 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:46.109055 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:46.110375 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:46.110872 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:46.111014 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:46.115424 (+ 4410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:46.115432 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:46.115438 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:46.115497 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:46.118619 (+ 3122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:46.119614 (+ 995us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:46.119620 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:46.119624 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:46.119820 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:46.120288 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:46.120295 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:46.120298 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:46.120708 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:46.120972 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:46.121352 (+ 380us) server_negotiation.cc:299] Negotiation successful
0811 18:47:46.121568 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 18:47:46.123733 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 3597
I20260811 18:47:46.136912 4358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:46.124604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37008 (local address 127.25.25.1:38527)
0811 18:47:46.124799 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:46.124806 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:46.125196 (+ 390us) server_negotiation.cc:407] Connection header received
0811 18:47:46.125412 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:46.125417 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:46.125486 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:46.125567 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:46.126624 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:46.127334 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:46.128687 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:46.129162 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:46.129271 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:46.131391 (+ 2120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:46.131397 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:46.131400 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:46.131443 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:46.134153 (+ 2710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:46.134862 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:46.134867 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:46.134870 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:46.135049 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:46.135403 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:46.135407 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:46.135410 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:46.135715 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:46.135947 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:46.136318 (+ 371us) server_negotiation.cc:299] Negotiation successful
0811 18:47:46.136534 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 18:47:46.137593 3842 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:46.229315 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 3597
I20260811 18:47:46.255733 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 3870
Aug 11 18:47:46 dist-test-slave-lgr5 krb5kdc[3396](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474066, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.2@KRBTEST.COM
I20260811 18:47:46.273849 4381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:46.256857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59712 (local address 127.25.25.2:45693)
0811 18:47:46.257598 (+ 741us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:46.257606 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:46.257665 (+ 59us) server_negotiation.cc:407] Connection header received
0811 18:47:46.257790 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:46.257798 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:46.258060 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:46.258214 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:46.259316 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:46.260596 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:46.261999 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:46.262887 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:46.263057 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:46.267247 (+ 4190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:46.267265 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:46.267283 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:46.267332 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:46.270339 (+ 3007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:46.271200 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:46.271210 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:46.271212 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:46.271369 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:46.271843 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:46.271847 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:46.271849 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:46.272329 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:46.272671 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:46.273179 (+ 508us) server_negotiation.cc:299] Negotiation successful
0811 18:47:46.273475 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":411,"threads_started":1}
I20260811 18:47:46.275274 4106 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:46.360313 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 3870
I20260811 18:47:46.385365 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 4121
Aug 11 18:47:46 dist-test-slave-lgr5 krb5kdc[3396](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474066, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.3@KRBTEST.COM
I20260811 18:47:46.402670 4391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:46.386360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53698 (local address 127.25.25.3:46305)
0811 18:47:46.387076 (+ 716us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:46.387084 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:46.387116 (+ 32us) server_negotiation.cc:407] Connection header received
0811 18:47:46.387181 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:46.387187 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:46.387473 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:46.387606 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:46.388812 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:46.389899 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:46.391194 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:46.391835 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:46.391964 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:46.396341 (+ 4377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:46.396360 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:46.396377 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:46.396422 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:46.399448 (+ 3026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:46.400364 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:46.400373 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:46.400375 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:46.400531 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:46.400967 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:46.400971 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:46.400973 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:46.401408 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:46.401723 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:46.402068 (+ 345us) server_negotiation.cc:299] Negotiation successful
0811 18:47:46.402354 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":381,"threads_started":1}
I20260811 18:47:46.404125 4334 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:46.488878 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 4121
I20260811 18:47:46.515575 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 3429
I20260811 18:47:46.516850 3544 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:46.623292 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 3429
2026-08-11T18:47:46Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4436 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:47:46 dist-test-slave-lgr5 krb5kdc[4400](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:47:46 dist-test-slave-lgr5 krb5kdc[4400](info): set up 2 sockets
Aug 11 18:47:46 dist-test-slave-lgr5 krb5kdc[4400](info): commencing operation
krb5kdc: starting...
W20260811 18:47:47.906739 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.229s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:47:48 dist-test-slave-lgr5 krb5kdc[4400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474068, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:47:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:47:48Z Disabled control of system clock
WARNING: no policy specified for oryx/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.62.keytab.
Entry for principal oryx/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.62.keytab.
I20260811 18:47:48.182067 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:40987
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.62.keytab
--principal=oryx/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:43463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:40987
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:48.545195 4423 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:48.545562 4423 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:48.545665 4423 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:48.553225 4423 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:47:48.553359 4423 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:48.553407 4423 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:48.553493 4423 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:47:48.553540 4423 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:47:48.564010 4423 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:43463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:40987
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.62.keytab
--principal=oryx/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:40987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:48.565478 4423 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:48.566794 4423 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:48.580332 4432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:48.580291 4436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:48.580354 4431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:48.581207 4423 server_base.cc:1034] running on GCE node
I20260811 18:47:48.582089 4423 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:48.583714 4423 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:48.584959 4423 hybrid_clock.cc:648] HybridClock initialized: now 1786474068584883 us; error 49 us; skew 500 ppm
I20260811 18:47:48.585332 4423 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:48 dist-test-slave-lgr5 krb5kdc[4400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474068, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:48.588611 4423 init.cc:377] Logged in from keytab as oryx/127.25.25.62@KRBTEST.COM (short username oryx)
I20260811 18:47:48.590335 4423 webserver.cc:460] Webserver started at http://127.25.25.62:40641/ using document root <none> and password file <none>
I20260811 18:47:48.591084 4423 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:48.591197 4423 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:48.591493 4423 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:48.594756 4423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "5e617b487cf2450fb23d1122274e75dc"
format_stamp: "Formatted at 2026-08-11 18:47:48 on dist-test-slave-lgr5"
server_key: "fb5c8a7a5ba9f1bda35e2c97b52603c0"
server_key_iv: "821de448e4bed1bbf1dbc77412d5dc07"
server_key_version: "encryptionkey@0"
I20260811 18:47:48.595573 4423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "5e617b487cf2450fb23d1122274e75dc"
format_stamp: "Formatted at 2026-08-11 18:47:48 on dist-test-slave-lgr5"
server_key: "fb5c8a7a5ba9f1bda35e2c97b52603c0"
server_key_iv: "821de448e4bed1bbf1dbc77412d5dc07"
server_key_version: "encryptionkey@0"
I20260811 18:47:48.601320 4423 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260811 18:47:48.605525 4453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:48.607076 4423 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260811 18:47:48.607278 4423 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "5e617b487cf2450fb23d1122274e75dc"
format_stamp: "Formatted at 2026-08-11 18:47:48 on dist-test-slave-lgr5"
server_key: "fb5c8a7a5ba9f1bda35e2c97b52603c0"
server_key_iv: "821de448e4bed1bbf1dbc77412d5dc07"
server_key_version: "encryptionkey@0"
I20260811 18:47:48.607509 4423 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:48.624752 4423 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:48.629669 4423 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:48.629973 4423 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:48.649075 4423 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:40987
I20260811 18:47:48.649111 4560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:40987 every 8 connection(s)
I20260811 18:47:48.650589 4423 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:47:48.654719 4561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:48.660555 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 4423
I20260811 18:47:48.660773 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:47:48.661636 25700 external_mini_cluster.cc:1428] Setting key d176a0507183db97897406bd9f0c29ea
I20260811 18:47:48.667225 4561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc: Bootstrap starting.
I20260811 18:47:48.671108 4561 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:48.672209 4561 log.cc:824] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:48.675315 4561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc: No bootstrap required, opened a new log
Aug 11 18:47:48 dist-test-slave-lgr5 krb5kdc[4400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474068, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM
I20260811 18:47:48.683537 4561 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } }
I20260811 18:47:48.684202 4561 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:48.684320 4561 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e617b487cf2450fb23d1122274e75dc, State: Initialized, Role: FOLLOWER
I20260811 18:47:48.684948 4561 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } }
I20260811 18:47:48.685179 4561 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:47:48.685316 4561 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:47:48.685491 4561 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:48.685587 4565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:48.664148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56066 (local address 127.25.25.62:40987)
0811 18:47:48.665117 (+ 969us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:48.665134 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:48.665181 (+ 47us) server_negotiation.cc:407] Connection header received
0811 18:47:48.666974 (+ 1793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:48.667001 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:48.667475 (+ 474us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:48.667840 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:48.669817 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:48.671166 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:48.672540 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:48.673293 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:48.673470 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:48.677574 (+ 4104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:48.677583 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:48.677602 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:48.677650 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:48.680845 (+ 3195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:48.681597 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:48.681604 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:48.681615 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:48.681807 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:48.682208 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:48.682211 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:48.682214 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:48.682831 (+ 617us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:48.683156 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:48.683706 (+ 550us) server_negotiation.cc:299] Negotiation successful
0811 18:47:48.684271 (+ 565us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":721,"thread_start_us":465,"threads_started":1}
I20260811 18:47:48.687986 4561 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } }
I20260811 18:47:48.688596 4561 leader_election.cc:302] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5e617b487cf2450fb23d1122274e75dc; no voters:
I20260811 18:47:48.689257 4561 leader_election.cc:288] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:47:48.689373 4569 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:48.690102 4569 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [term 1 LEADER]: Becoming Leader. State: Replica: 5e617b487cf2450fb23d1122274e75dc, State: Running, Role: LEADER
I20260811 18:47:48.690629 4569 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } }
I20260811 18:47:48.691438 4561 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:47:48.693504 4574 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e617b487cf2450fb23d1122274e75dc. Latest consensus state: current_term: 1 leader_uuid: "5e617b487cf2450fb23d1122274e75dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } }
I20260811 18:47:48.693799 4574 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:48.694648 4581 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:47:48.694482 4571 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5e617b487cf2450fb23d1122274e75dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } }
I20260811 18:47:48.694783 4571 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:48.699798 4581 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:47:48.709609 4581 catalog_manager.cc:1347] Generated new cluster ID: f8699c4e063a4333b04d7b253ce41761
I20260811 18:47:48.709744 4581 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:47:48.721485 4581 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:47:48.723564 4581 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:47:48.742481 4581 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc: Generated new TSK 0
I20260811 18:47:48.743816 4581 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.25.25.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.25.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.25.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.1.keytab.
Entry for principal oryx/127.25.25.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.1.keytab.
I20260811 18:47:48.806159 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:0
--local_ip_for_outbound_sockets=127.25.25.1
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:40987
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.1.keytab
--principal=oryx/127.25.25.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:43463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:49.164314 4617 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:49.164661 4617 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:49.164811 4617 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:49.172360 4617 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:49.172516 4617 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:49.172672 4617 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:47:49.183364 4617 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:43463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.1.keytab
--principal=oryx/127.25.25.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:40987
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:49.184875 4617 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:49.186411 4617 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:49.199772 4634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:49.199710 4640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:49.199802 4633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:49.200914 4617 server_base.cc:1034] running on GCE node
I20260811 18:47:49.201618 4617 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:49.202607 4617 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:49.203811 4617 hybrid_clock.cc:648] HybridClock initialized: now 1786474069203753 us; error 54 us; skew 500 ppm
I20260811 18:47:49.204169 4617 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:49 dist-test-slave-lgr5 krb5kdc[4400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474069, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:49.213714 4617 init.cc:377] Logged in from keytab as oryx/127.25.25.1@KRBTEST.COM (short username oryx)
I20260811 18:47:49.215314 4617 webserver.cc:460] Webserver started at http://127.25.25.1:34217/ using document root <none> and password file <none>
I20260811 18:47:49.216048 4617 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:49.216210 4617 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:49.216539 4617 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:49.219566 4617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/data/instance:
uuid: "a9e2fc3f8e914bac89172067877d3ba4"
format_stamp: "Formatted at 2026-08-11 18:47:49 on dist-test-slave-lgr5"
server_key: "bb3bcf743a7c3b3d399779ea186d4a4e"
server_key_iv: "1a1b5e9162848e955873974523101eec"
server_key_version: "encryptionkey@0"
I20260811 18:47:49.220417 4617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance:
uuid: "a9e2fc3f8e914bac89172067877d3ba4"
format_stamp: "Formatted at 2026-08-11 18:47:49 on dist-test-slave-lgr5"
server_key: "bb3bcf743a7c3b3d399779ea186d4a4e"
server_key_iv: "1a1b5e9162848e955873974523101eec"
server_key_version: "encryptionkey@0"
I20260811 18:47:49.225728 4617 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 18:47:49.230389 4655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:49.232168 4617 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 18:47:49.232409 4617 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "a9e2fc3f8e914bac89172067877d3ba4"
format_stamp: "Formatted at 2026-08-11 18:47:49 on dist-test-slave-lgr5"
server_key: "bb3bcf743a7c3b3d399779ea186d4a4e"
server_key_iv: "1a1b5e9162848e955873974523101eec"
server_key_version: "encryptionkey@0"
I20260811 18:47:49.232703 4617 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:49.257578 4617 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:49.262087 4617 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:49.262391 4617 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:49.263454 4617 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:47:49.264978 4617 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:49.265058 4617 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:49.265180 4617 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:49.265231 4617 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:49.299182 4617 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:34169
I20260811 18:47:49.299264 4868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:34169 every 8 connection(s)
I20260811 18:47:49.300668 4617 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:47:49.305528 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 4617
I20260811 18:47:49.305723 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance
I20260811 18:47:49.306381 25700 external_mini_cluster.cc:1428] Setting key 9111e55e1056111713bd53c032476064
Aug 11 18:47:49 dist-test-slave-lgr5 krb5kdc[4400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474069, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM
I20260811 18:47:49.323170 4875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:49.303440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:51457 (local address 127.25.25.62:40987)
0811 18:47:49.303908 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:49.303914 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:49.305012 (+ 1098us) server_negotiation.cc:407] Connection header received
0811 18:47:49.307114 (+ 2102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:49.307119 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:49.307241 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:49.307422 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:49.309565 (+ 2143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:49.310294 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:49.312117 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:49.312709 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:49.312861 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:49.316792 (+ 3931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:49.316798 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:49.316811 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:49.316857 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:49.319574 (+ 2717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:49.320557 (+ 983us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:49.320562 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:49.320564 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:49.320703 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:49.321248 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:49.321253 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:49.321255 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:49.321555 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:49.321680 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:49.322673 (+ 993us) server_negotiation.cc:299] Negotiation successful
0811 18:47:49.322872 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":248,"threads_started":1}
I20260811 18:47:49.324680 4877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:49.303961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.25.25.1:51457)
0811 18:47:49.304821 (+ 860us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:49.304864 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:49.306756 (+ 1892us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:49.307772 (+ 1016us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:49.307786 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:49.308658 (+ 872us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:49.309358 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:49.309387 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:49.310488 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:49.310493 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:49.311888 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:49.311904 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:49.312989 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:49.312996 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:49.313254 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:49.314002 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:49.314027 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:49.316528 (+ 2501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:49.319732 (+ 3204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:49.319742 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:49.319762 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:49.320395 (+ 633us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:49.320814 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:49.320820 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:49.320823 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:49.321099 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:49.321694 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:49.321702 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:49.322229 (+ 527us) client_negotiation.cc:769] Sending connection context
0811 18:47:49.322544 (+ 315us) client_negotiation.cc:240] Negotiation successful
0811 18:47:49.323128 (+ 584us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":302,"threads_started":1}
I20260811 18:47:49.326499 4869 heartbeater.cc:347] Connected to a master server at 127.25.25.62:40987
I20260811 18:47:49.326855 4869 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:49.327865 4869 heartbeater.cc:511] Master 127.25.25.62:40987 requested a full tablet report, sending...
I20260811 18:47:49.330660 4488 ts_manager.cc:194] Registered new tserver with Master: a9e2fc3f8e914bac89172067877d3ba4 (127.25.25.1:34169)
I20260811 18:47:49.332921 4488 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.25.1@KRBTEST.COM'} at 127.25.25.1:51457
WARNING: no policy specified for oryx/127.25.25.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.25.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.25.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.2.keytab.
Entry for principal oryx/127.25.25.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.2.keytab.
I20260811 18:47:49.371258 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:0
--local_ip_for_outbound_sockets=127.25.25.2
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:40987
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.2.keytab
--principal=oryx/127.25.25.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:43463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:49.730576 4885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:49.730929 4885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:49.731082 4885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:49.738902 4885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:49.739049 4885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:49.739216 4885 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:47:49.749933 4885 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:43463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.2.keytab
--principal=oryx/127.25.25.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:40987
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:49.751370 4885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:49.752871 4885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:49.768205 4892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:49.768282 4897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:49.768440 4891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:49.769081 4885 server_base.cc:1034] running on GCE node
I20260811 18:47:49.769781 4885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:49.770834 4885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:49.772037 4885 hybrid_clock.cc:648] HybridClock initialized: now 1786474069771974 us; error 57 us; skew 500 ppm
I20260811 18:47:49.772397 4885 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:49 dist-test-slave-lgr5 krb5kdc[4400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474069, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:49.775771 4885 init.cc:377] Logged in from keytab as oryx/127.25.25.2@KRBTEST.COM (short username oryx)
I20260811 18:47:49.777527 4885 webserver.cc:460] Webserver started at http://127.25.25.2:43439/ using document root <none> and password file <none>
I20260811 18:47:49.778313 4885 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:49.778436 4885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:49.778782 4885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:49.782106 4885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/data/instance:
uuid: "282cb4f254b546dca9e2337ebb9be30b"
format_stamp: "Formatted at 2026-08-11 18:47:49 on dist-test-slave-lgr5"
server_key: "d17daa978db853a487e23f300560d416"
server_key_iv: "0a4a4b71fccad8d66c95d14af1e7d2a7"
server_key_version: "encryptionkey@0"
I20260811 18:47:49.783015 4885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance:
uuid: "282cb4f254b546dca9e2337ebb9be30b"
format_stamp: "Formatted at 2026-08-11 18:47:49 on dist-test-slave-lgr5"
server_key: "d17daa978db853a487e23f300560d416"
server_key_iv: "0a4a4b71fccad8d66c95d14af1e7d2a7"
server_key_version: "encryptionkey@0"
I20260811 18:47:49.788939 4885 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.003s
I20260811 18:47:49.792899 4916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:49.794396 4885 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:47:49.794581 4885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "282cb4f254b546dca9e2337ebb9be30b"
format_stamp: "Formatted at 2026-08-11 18:47:49 on dist-test-slave-lgr5"
server_key: "d17daa978db853a487e23f300560d416"
server_key_iv: "0a4a4b71fccad8d66c95d14af1e7d2a7"
server_key_version: "encryptionkey@0"
I20260811 18:47:49.794790 4885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:49.810892 4885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:49.815672 4885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:49.815999 4885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:49.817071 4885 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:47:49.818557 4885 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:49.818640 4885 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:49.818766 4885 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:49.818833 4885 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:49.851106 4885 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:45075
I20260811 18:47:49.851142 5120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:45075 every 8 connection(s)
I20260811 18:47:49.852656 4885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:47:49.859419 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 4885
I20260811 18:47:49.859635 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance
I20260811 18:47:49.860168 25700 external_mini_cluster.cc:1428] Setting key fb5780bda792798eadc8151a2f4afe3c
Aug 11 18:47:49 dist-test-slave-lgr5 krb5kdc[4400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474069, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM
I20260811 18:47:49.875531 5123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:49.855484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:34539 (local address 127.25.25.62:40987)
0811 18:47:49.855937 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:49.855942 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:49.857057 (+ 1115us) server_negotiation.cc:407] Connection header received
0811 18:47:49.859002 (+ 1945us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:49.859008 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:49.859112 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:49.859212 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:49.861153 (+ 1941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:49.862011 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:49.863903 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:49.864650 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:49.864826 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:49.868813 (+ 3987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:49.868821 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:49.868826 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:49.868876 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:49.872106 (+ 3230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:49.872960 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:49.872965 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:49.872968 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:49.873136 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:49.873680 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:49.873684 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:49.873687 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:49.874014 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:49.874139 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:49.875053 (+ 914us) server_negotiation.cc:299] Negotiation successful
0811 18:47:49.875247 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":229,"threads_started":1}
I20260811 18:47:49.877035 5124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:49.856026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.25.25.2:34539)
0811 18:47:49.856864 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:49.856914 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:49.858659 (+ 1745us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:49.859500 (+ 841us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:49.859510 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:49.860178 (+ 668us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:49.860895 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:49.860924 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:49.862233 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:49.862238 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:49.863668 (+ 1430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:49.863683 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:49.864967 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:49.864973 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:49.865209 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:49.865944 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:49.865969 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:49.868515 (+ 2546us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:49.872261 (+ 3746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:49.872269 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:49.872284 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:49.872776 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:49.873248 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:49.873252 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:49.873256 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:49.873530 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:49.874155 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:49.874163 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:49.874620 (+ 457us) client_negotiation.cc:769] Sending connection context
0811 18:47:49.874924 (+ 304us) client_negotiation.cc:240] Negotiation successful
0811 18:47:49.875524 (+ 600us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":323,"threads_started":1}
I20260811 18:47:49.878600 5121 heartbeater.cc:347] Connected to a master server at 127.25.25.62:40987
I20260811 18:47:49.878945 5121 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:49.879909 5121 heartbeater.cc:511] Master 127.25.25.62:40987 requested a full tablet report, sending...
I20260811 18:47:49.881613 4488 ts_manager.cc:194] Registered new tserver with Master: 282cb4f254b546dca9e2337ebb9be30b (127.25.25.2:45075)
I20260811 18:47:49.882431 4488 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.25.2@KRBTEST.COM'} at 127.25.25.2:34539
WARNING: no policy specified for oryx/127.25.25.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.25.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.25.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.3.keytab.
Entry for principal oryx/127.25.25.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.3.keytab.
I20260811 18:47:49.919971 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:0
--local_ip_for_outbound_sockets=127.25.25.3
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:40987
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.3.keytab
--principal=oryx/127.25.25.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:43463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:50.277752 5129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:50.278092 5129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:50.278240 5129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:50.285859 5129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:50.286029 5129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:50.286194 5129 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:47:50.296838 5129 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:43463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.3.keytab
--principal=oryx/127.25.25.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:40987
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:50.298332 5129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:50.300251 5129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:50.315852 5139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:50.315871 5136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:50.315918 5141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:50.316767 5129 server_base.cc:1034] running on GCE node
I20260811 18:47:50.317456 5129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:50.318490 5129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:50.319706 5129 hybrid_clock.cc:648] HybridClock initialized: now 1786474070319650 us; error 51 us; skew 500 ppm
I20260811 18:47:50.320046 5129 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:50 dist-test-slave-lgr5 krb5kdc[4400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474070, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:50.323387 5129 init.cc:377] Logged in from keytab as oryx/127.25.25.3@KRBTEST.COM (short username oryx)
I20260811 18:47:50.325129 5129 webserver.cc:460] Webserver started at http://127.25.25.3:36993/ using document root <none> and password file <none>
I20260811 18:47:50.325984 5129 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:50.326133 5129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:50.326467 5129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:50.329914 5129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/data/instance:
uuid: "a00a8043b3324336862c99cc9d44eb01"
format_stamp: "Formatted at 2026-08-11 18:47:50 on dist-test-slave-lgr5"
server_key: "6f32e66a978af6e8cef64c3804790e24"
server_key_iv: "dcb0179b1029b18214060b3a300f4346"
server_key_version: "encryptionkey@0"
I20260811 18:47:50.330834 5129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance:
uuid: "a00a8043b3324336862c99cc9d44eb01"
format_stamp: "Formatted at 2026-08-11 18:47:50 on dist-test-slave-lgr5"
server_key: "6f32e66a978af6e8cef64c3804790e24"
server_key_iv: "dcb0179b1029b18214060b3a300f4346"
server_key_version: "encryptionkey@0"
I20260811 18:47:50.336841 4869 heartbeater.cc:503] Master 127.25.25.62:40987 was elected leader, sending a full tablet report...
I20260811 18:47:50.336961 5129 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 18:47:50.341202 5157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:50.342806 5129 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 18:47:50.343005 5129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "a00a8043b3324336862c99cc9d44eb01"
format_stamp: "Formatted at 2026-08-11 18:47:50 on dist-test-slave-lgr5"
server_key: "6f32e66a978af6e8cef64c3804790e24"
server_key_iv: "dcb0179b1029b18214060b3a300f4346"
server_key_version: "encryptionkey@0"
I20260811 18:47:50.343226 5129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:50.383410 5129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:50.388200 5129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:50.388515 5129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:50.389586 5129 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:47:50.391060 5129 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:50.391139 5129 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:50.391255 5129 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:50.391305 5129 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:50.425375 5129 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:35159
I20260811 18:47:50.425413 5373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:35159 every 8 connection(s)
I20260811 18:47:50.426692 5129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:47:50.427627 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 5129
I20260811 18:47:50.427829 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance
I20260811 18:47:50.428371 25700 external_mini_cluster.cc:1428] Setting key 4518cc40bda0dcc2e4dc66122e53240e
Aug 11 18:47:50 dist-test-slave-lgr5 krb5kdc[4400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474070, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM
I20260811 18:47:50.448242 5378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:50.429495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:54547 (local address 127.25.25.62:40987)
0811 18:47:50.429932 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:50.429938 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:50.431098 (+ 1160us) server_negotiation.cc:407] Connection header received
0811 18:47:50.433128 (+ 2030us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:50.433133 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:50.433218 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:50.433310 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:50.435018 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:50.435830 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:50.437548 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:50.438030 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:50.438137 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:50.441781 (+ 3644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:50.441787 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:50.441791 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:50.441829 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:50.445070 (+ 3241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:50.445977 (+ 907us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:50.445982 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:50.445984 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:50.446117 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:50.446509 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:50.446512 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:50.446514 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:50.446790 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:50.446931 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:50.447694 (+ 763us) server_negotiation.cc:299] Negotiation successful
0811 18:47:50.447880 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":198,"threads_started":1}
I20260811 18:47:50.449323 5379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:50.430112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.25.25.3:54547)
0811 18:47:50.430932 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:50.430979 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:50.432851 (+ 1872us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:50.433615 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:50.433625 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:50.434191 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:50.434819 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:50.434839 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:50.435989 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:50.435993 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:50.437399 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:50.437413 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:50.438232 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:50.438238 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:50.438501 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:50.439139 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:50.439161 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:50.441520 (+ 2359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:50.445236 (+ 3716us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:50.445246 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:50.445263 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:50.445815 (+ 552us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:50.446208 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:50.446211 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:50.446213 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:50.446420 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:50.446895 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:50.446901 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:50.447298 (+ 397us) client_negotiation.cc:769] Sending connection context
0811 18:47:50.447566 (+ 268us) client_negotiation.cc:240] Negotiation successful
0811 18:47:50.448020 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":337,"threads_started":1}
I20260811 18:47:50.450870 5374 heartbeater.cc:347] Connected to a master server at 127.25.25.62:40987
I20260811 18:47:50.451211 5374 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:50.452150 5374 heartbeater.cc:511] Master 127.25.25.62:40987 requested a full tablet report, sending...
I20260811 18:47:50.454031 4488 ts_manager.cc:194] Registered new tserver with Master: a00a8043b3324336862c99cc9d44eb01 (127.25.25.3:35159)
I20260811 18:47:50.454929 4488 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.25.3@KRBTEST.COM'} at 127.25.25.3:54547
I20260811 18:47:50.456830 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.25.25.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.25.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.25.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.61.keytab.
Entry for principal oryx/127.25.25.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.61.keytab.
I20260811 18:47:50.515985 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.61:40099
--webserver_interface=127.25.25.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.61.keytab
--principal=oryx/127.25.25.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:43463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:40987,127.25.25.61:40099
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:50.873896 5387 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:50.874226 5387 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:50.874326 5387 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:50.881912 5387 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:47:50.882037 5387 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:50.882084 5387 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:50.882146 5387 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:47:50.882189 5387 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:47:50.885761 5121 heartbeater.cc:503] Master 127.25.25.62:40987 was elected leader, sending a full tablet report...
I20260811 18:47:50.893479 5387 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:43463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:40987,127.25.25.61:40099
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.61.keytab
--principal=oryx/127.25.25.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.61:40099
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.25.25.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
W20260811 18:47:50.893884 5387 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.25.25.62:40987,127.25.25.61:40099'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 18:47:50.895000 5387 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:50.896467 5387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:50.908530 5399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:50.908463 5394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:50.908571 5395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:50.915607 5387 server_base.cc:1034] running on GCE node
I20260811 18:47:50.916769 5387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:50.918555 5387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:50.919863 5387 hybrid_clock.cc:648] HybridClock initialized: now 1786474070919783 us; error 61 us; skew 500 ppm
I20260811 18:47:50.920303 5387 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:50 dist-test-slave-lgr5 krb5kdc[4400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474070, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:50.923738 5387 init.cc:377] Logged in from keytab as oryx/127.25.25.61@KRBTEST.COM (short username oryx)
I20260811 18:47:50.925506 5387 webserver.cc:460] Webserver started at http://127.25.25.61:35639/ using document root <none> and password file <none>
I20260811 18:47:50.926345 5387 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:50.926479 5387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:50.926811 5387 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:50.930124 5387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-1/data/instance:
uuid: "ffc129de04a54bfe8a890bc558cda5d0"
format_stamp: "Formatted at 2026-08-11 18:47:50 on dist-test-slave-lgr5"
server_key: "112e77f0d6af94f322afcd6c7179aaf5"
server_key_iv: "eb082f88b643f6f6ec85901f95a6d916"
server_key_version: "encryptionkey@0"
I20260811 18:47:50.931005 5387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-1/wal/instance:
uuid: "ffc129de04a54bfe8a890bc558cda5d0"
format_stamp: "Formatted at 2026-08-11 18:47:50 on dist-test-slave-lgr5"
server_key: "112e77f0d6af94f322afcd6c7179aaf5"
server_key_iv: "eb082f88b643f6f6ec85901f95a6d916"
server_key_version: "encryptionkey@0"
I20260811 18:47:50.937019 5387 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 18:47:50.941211 5419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:50.942736 5387 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.001s
I20260811 18:47:50.942934 5387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-1/wal
uuid: "ffc129de04a54bfe8a890bc558cda5d0"
format_stamp: "Formatted at 2026-08-11 18:47:50 on dist-test-slave-lgr5"
server_key: "112e77f0d6af94f322afcd6c7179aaf5"
server_key_iv: "eb082f88b643f6f6ec85901f95a6d916"
server_key_version: "encryptionkey@0"
I20260811 18:47:50.943173 5387 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:50.982832 5387 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:50.987604 5387 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:50.987892 5387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:51.006704 5387 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.61:40099
I20260811 18:47:51.006722 5520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.61:40099 every 8 connection(s)
I20260811 18:47:51.008419 5387 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-1/data/info.pb
I20260811 18:47:51.012601 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 5387
I20260811 18:47:51.012719 5521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:51.024037 5521 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:47:51 dist-test-slave-lgr5 krb5kdc[4400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474068, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.25.61@KRBTEST.COM
Aug 11 18:47:51 dist-test-slave-lgr5 krb5kdc[4400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474070, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.61@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM
I20260811 18:47:51.040362 5528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.015186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36858 (local address 127.25.25.61:40099)
0811 18:47:51.016430 (+ 1244us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:51.016451 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:51.016516 (+ 65us) server_negotiation.cc:407] Connection header received
0811 18:47:51.018535 (+ 2019us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:51.018575 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:51.019228 (+ 653us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:51.019745 (+ 517us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:51.021302 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.023322 (+ 2020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.024773 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.025823 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.026034 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.030989 (+ 4955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:51.030999 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:51.031014 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:51.031072 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:51.035606 (+ 4534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.036557 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.036566 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.036577 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.036800 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.037255 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.037263 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.037267 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.037946 (+ 679us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:51.038264 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:51.038759 (+ 495us) server_negotiation.cc:299] Negotiation successful
0811 18:47:51.039204 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":947,"thread_start_us":627,"threads_started":1}
I20260811 18:47:51.044910 5538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.027312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.0.0.1:46844)
0811 18:47:51.028141 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:51.028180 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:51.028339 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:51.028756 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:51.028763 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:51.029487 (+ 724us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:51.029832 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.029846 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.031073 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.031078 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.032845 (+ 1767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.032865 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.033989 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.033998 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.034209 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.034920 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:51.034950 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:51.037910 (+ 2960us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:51.041510 (+ 3600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:51.041520 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:51.041526 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:51.042046 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:51.042557 (+ 511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:51.042561 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:51.042563 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:51.042721 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:51.043675 (+ 954us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:51.043684 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:51.043951 (+ 267us) client_negotiation.cc:769] Sending connection context
0811 18:47:51.044256 (+ 305us) client_negotiation.cc:240] Negotiation successful
0811 18:47:51.044606 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":438,"threads_started":1}
I20260811 18:47:51.044936 5537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.027205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46844 (local address 127.25.25.62:40987)
0811 18:47:51.027695 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:51.027701 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:51.028271 (+ 570us) server_negotiation.cc:407] Connection header received
0811 18:47:51.028488 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:51.028492 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:51.028567 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:51.028663 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:51.030048 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.030923 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.033082 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.033741 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.033860 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.038132 (+ 4272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:51.038138 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:51.038142 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:51.038186 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:51.041331 (+ 3145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.042211 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.042218 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.042222 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.042405 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.042990 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.042995 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.042998 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.043494 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:51.043663 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:51.044428 (+ 765us) server_negotiation.cc:299] Negotiation successful
0811 18:47:51.044665 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":241,"threads_started":1}
I20260811 18:47:51.046649 5521 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:47:51 dist-test-slave-lgr5 krb5kdc[4400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474070, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.61@KRBTEST.COM for oryx/127.25.25.61@KRBTEST.COM
I20260811 18:47:51.060604 5538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.047399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:40099 (local address 127.0.0.1:36862)
0811 18:47:51.047590 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:51.047610 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:51.047742 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:51.048170 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:51.048175 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:51.048586 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:51.048732 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.048742 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.049806 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.049811 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.050807 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.050823 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.051769 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.051775 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.051933 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.052604 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:51.052625 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:51.054875 (+ 2250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:51.057943 (+ 3068us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:51.057948 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:51.057951 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:51.058401 (+ 450us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:51.058831 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:51.058836 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:51.058839 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:51.059013 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:51.059711 (+ 698us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:51.059715 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:51.059879 (+ 164us) client_negotiation.cc:769] Sending connection context
0811 18:47:51.060017 (+ 138us) client_negotiation.cc:240] Negotiation successful
0811 18:47:51.060338 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 18:47:51.060935 5528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.047655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36862 (local address 127.25.25.61:40099)
0811 18:47:51.047823 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:51.047827 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:51.047842 (+ 15us) server_negotiation.cc:407] Connection header received
0811 18:47:51.047890 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:51.047895 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:51.047968 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:51.048051 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:51.048893 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.049639 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.051082 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.051539 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.051664 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.055115 (+ 3451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:51.055120 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:51.055123 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:51.055158 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:51.057762 (+ 2604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.058546 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.058551 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.058553 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.058692 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.059142 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.059147 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.059149 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.059572 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:51.059699 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:51.060182 (+ 483us) server_negotiation.cc:299] Negotiation successful
0811 18:47:51.060599 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":138,"server-negotiator.queue_time_us":52}
I20260811 18:47:51.065982 5521 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0: Bootstrap starting.
I20260811 18:47:51.069442 5521 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:51.070595 5521 log.cc:824] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:51.073825 5521 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0: No bootstrap required, opened a new log
I20260811 18:47:51.081316 5521 raft_consensus.cc:348] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } }
I20260811 18:47:51.081707 5521 raft_consensus.cc:374] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:51.081806 5521 raft_consensus.cc:729] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffc129de04a54bfe8a890bc558cda5d0, State: Initialized, Role: FOLLOWER
I20260811 18:47:51.082422 5521 consensus_queue.cc:260] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } }
I20260811 18:47:51.083312 5541 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } } }
I20260811 18:47:51.083622 5541 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:47:51.084506 5521 sys_catalog.cc:564] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 18:47:51.093720 5559 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:47:51.093866 5559 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:47:51.097304 5387 master_runner.cc:428] Detected that this master ffc129de04a54bfe8a890bc558cda5d0 is joining an existing cluster
I20260811 18:47:51.097419 5387 master_runner.cc:432] Initiating AddMaster RPC to add 127.25.25.61:40099
I20260811 18:47:51.124467 5528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.104136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36872 (local address 127.25.25.61:40099)
0811 18:47:51.104412 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:51.104418 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:51.107799 (+ 3381us) server_negotiation.cc:407] Connection header received
0811 18:47:51.108642 (+ 843us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:51.108648 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:51.108738 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:51.108812 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:51.110295 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.111308 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.113443 (+ 2135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.114180 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.114290 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.117354 (+ 3064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:51.117361 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:51.117366 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:51.117417 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:51.121226 (+ 3809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.122103 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.122109 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.122112 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.122268 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.122683 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.122687 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.122695 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.123136 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:51.123290 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:51.123778 (+ 488us) server_negotiation.cc:299] Negotiation successful
0811 18:47:51.124045 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 18:47:51.125618 5577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.103586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:40099 (local address 127.0.0.1:36872)
0811 18:47:51.107635 (+ 4049us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:51.107672 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:51.107870 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:51.109019 (+ 1149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:51.109023 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:51.109783 (+ 760us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:51.110137 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.110148 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.111496 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.111501 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.113268 (+ 1767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.113284 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.114653 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.114659 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.114835 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.115602 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:51.115623 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:51.117096 (+ 1473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:51.121393 (+ 4297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:51.121399 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:51.121403 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:51.121966 (+ 563us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:51.122406 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:51.122410 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:51.122413 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:51.122575 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:51.123359 (+ 784us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:51.123363 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:51.123540 (+ 177us) client_negotiation.cc:769] Sending connection context
0811 18:47:51.124759 (+ 1219us) client_negotiation.cc:240] Negotiation successful
0811 18:47:51.125113 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3889,"thread_start_us":3712,"threads_started":1}
I20260811 18:47:51.126438 5537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.103629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46854 (local address 127.25.25.62:40987)
0811 18:47:51.103845 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:51.103852 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:51.108819 (+ 4967us) server_negotiation.cc:407] Connection header received
0811 18:47:51.109159 (+ 340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:51.109165 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:51.109296 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:51.109379 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:51.111606 (+ 2227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.112792 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.114831 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.115429 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.115532 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.118783 (+ 3251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:51.118791 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:51.118795 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:51.118845 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:51.122617 (+ 3772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.123386 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.123392 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.123395 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.123580 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.124038 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.124044 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.124047 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.124451 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:51.124890 (+ 439us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:51.125547 (+ 657us) server_negotiation.cc:299] Negotiation successful
0811 18:47:51.126112 (+ 565us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 18:47:51.127737 5578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.104177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.0.0.1:46854)
0811 18:47:51.108678 (+ 4501us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:51.108699 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:51.108946 (+ 247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:51.109634 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:51.109638 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:51.110461 (+ 823us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:51.110858 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.110872 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.113043 (+ 2171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.113048 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.114650 (+ 1602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.114662 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.115842 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.115858 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.116052 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.116762 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:51.116786 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:51.118505 (+ 1719us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:51.122796 (+ 4291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:51.122800 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:51.122804 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:51.123236 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:51.123734 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:51.123739 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:51.123743 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:51.123900 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:51.125004 (+ 1104us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:51.125008 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:51.125212 (+ 204us) client_negotiation.cc:769] Sending connection context
0811 18:47:51.126929 (+ 1717us) client_negotiation.cc:240] Negotiation successful
0811 18:47:51.127277 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4346,"thread_start_us":4096,"threads_started":1}
WARNING: no policy specified for oryx/127.25.25.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.25.60@KRBTEST.COM" created.
Aug 11 18:47:51 dist-test-slave-lgr5 krb5kdc[4400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474068, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.62@KRBTEST.COM for oryx/127.25.25.61@KRBTEST.COM
I20260811 18:47:51.156558 5528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.135103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36888 (local address 127.25.25.61:40099)
0811 18:47:51.135280 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:51.135286 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:51.140888 (+ 5602us) server_negotiation.cc:407] Connection header received
0811 18:47:51.141333 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:51.141340 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:51.141455 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:51.141577 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:51.143080 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.144316 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.145645 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.146115 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.146233 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.150165 (+ 3932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:51.150171 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:51.150174 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:51.150211 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:51.153166 (+ 2955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.154140 (+ 974us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.154147 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.154151 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.154346 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.154771 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.154775 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.154777 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.155147 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:51.155355 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:51.155872 (+ 517us) server_negotiation.cc:299] Negotiation successful
0811 18:47:51.156166 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 18:47:51.156616 5581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.134982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:40099 (local address 127.0.0.1:36888)
0811 18:47:51.140710 (+ 5728us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:51.140758 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:51.141065 (+ 307us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:51.141670 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:51.141678 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:51.142583 (+ 905us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:51.142882 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.142895 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.144461 (+ 1566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.144465 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.145490 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.145504 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.146299 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.146305 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.146501 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.147292 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:51.147315 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:51.149931 (+ 2616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:51.153345 (+ 3414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:51.153367 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:51.153376 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:51.153937 (+ 561us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:51.154477 (+ 540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:51.154483 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:51.154487 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:51.154651 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:51.155312 (+ 661us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:51.155322 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:51.155547 (+ 225us) client_negotiation.cc:769] Sending connection context
0811 18:47:51.155727 (+ 180us) client_negotiation.cc:240] Negotiation successful
0811 18:47:51.156168 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5420,"thread_start_us":5251,"threads_started":1}
I20260811 18:47:51.159034 4488 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.25.25.61:40099: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0"
member_type: NON_VOTER
last_known_addr {
host: "127.25.25.61"
port: 40099
}
attrs {
promote: true
}
}
dest_uuid: "5e617b487cf2450fb23d1122274e75dc"
cas_config_opid_index: -1
I20260811 18:47:51.160069 4488 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: NON_VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: true } }
I20260811 18:47:51.163424 5589 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER ffc129de04a54bfe8a890bc558cda5d0 (127.25.25.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: NON_VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: true } } }
I20260811 18:47:51.164701 5470 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:51.167675 5589 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.25.25.61:40099
I20260811 18:47:51.168738 5387 master.cc:537] Master@127.25.25.61:40099 shutting down...
I20260811 18:47:51.168828 5587 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "5e617b487cf2450fb23d1122274e75dc" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: NON_VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: true } } }
I20260811 18:47:51.169458 5587 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:51.170960 5470 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [term 1 FOLLOWER]: Refusing update from remote peer 5e617b487cf2450fb23d1122274e75dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.25.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.60.keytab.
Entry for principal oryx/127.25.25.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.60.keytab.
I20260811 18:47:51.172870 5587 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: NON_VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:47:51.173308 5541 raft_consensus.cc:482] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:47:51.173676 5541 raft_consensus.cc:504] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } }
I20260811 18:47:51.174427 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.60:37093
--webserver_interface=127.25.25.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.60.keytab
--principal=oryx/127.25.25.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:43463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:40987,127.25.25.61:40099,127.25.25.60:37093
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:47:51.175151 5541 leader_election.cc:288] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e617b487cf2450fb23d1122274e75dc (127.25.25.62:40987)
I20260811 18:47:51.175908 4511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ffc129de04a54bfe8a890bc558cda5d0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e617b487cf2450fb23d1122274e75dc" is_pre_election: true
I20260811 18:47:51.180660 5429 leader_election.cc:302] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: ffc129de04a54bfe8a890bc558cda5d0; no voters: 5e617b487cf2450fb23d1122274e75dc
W20260811 18:47:51.185123 4456 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260811 18:47:51.185427 5541 raft_consensus.cc:2726] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 18:47:51.188477 5387 raft_consensus.cc:2229] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:47:51.188925 5387 raft_consensus.cc:2258] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 18:47:51.188911 4456 consensus_peers.cc:487] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc -> Peer ffc129de04a54bfe8a890bc558cda5d0 (127.25.25.61:40099): Couldn't send request to peer ffc129de04a54bfe8a890bc558cda5d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 18:47:51.189127 5387 tablet_replica.cc:330] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0: stopping tablet replica
I20260811 18:47:51.196604 5387 master.cc:552] Master@127.25.25.61:40099 shutdown complete.
I20260811 18:47:51.196784 5387 master_runner.cc:305] Clearing existing system tablet
I20260811 18:47:51.197415 5387 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:51.197520 5387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:51.201138 5387 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 18:47:51.203068 5600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:51.203511 5387 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:51.203820 5387 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 18:47:51.203912 5387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-1/wal
uuid: "ffc129de04a54bfe8a890bc558cda5d0"
format_stamp: "Formatted at 2026-08-11 18:47:50 on dist-test-slave-lgr5"
server_key: "112e77f0d6af94f322afcd6c7179aaf5"
server_key_iv: "eb082f88b643f6f6ec85901f95a6d916"
server_key_version: "encryptionkey@0"
I20260811 18:47:51.209486 5387 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:51.217160 5387 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 18:47:51.217388 5387 log.cc:1196] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 18:47:51.217950 5387 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0: Deleting consensus metadata
I20260811 18:47:51.218261 5387 master_runner.cc:315] Copying system tablet from 127.25.25.62:40987
I20260811 18:47:51.220924 5387 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0: tablet copy: Beginning tablet copy session from remote peer at address 127.25.25.62:40987
I20260811 18:47:51.244557 5610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.221809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.0.0.1:46864)
0811 18:47:51.228501 (+ 6692us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:51.228536 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:51.228760 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:51.229255 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:51.229261 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:51.229863 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:51.230198 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.230215 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.231756 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.231761 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.233327 (+ 1566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.233348 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.234406 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.234413 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.234626 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.235411 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:51.235445 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:51.236740 (+ 1295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:51.241070 (+ 4330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:51.241077 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:51.241081 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:51.241644 (+ 563us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:51.242165 (+ 521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:51.242171 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:51.242175 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:51.242403 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:51.243267 (+ 864us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:51.243273 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:51.243498 (+ 225us) client_negotiation.cc:769] Sending connection context
0811 18:47:51.243667 (+ 169us) client_negotiation.cc:240] Negotiation successful
0811 18:47:51.244042 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6388,"thread_start_us":6182,"threads_started":1}
I20260811 18:47:51.244865 5537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.221950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46864 (local address 127.25.25.62:40987)
0811 18:47:51.222159 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:51.222166 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:51.228711 (+ 6545us) server_negotiation.cc:407] Connection header received
0811 18:47:51.228941 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:51.228948 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:51.229054 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:51.229193 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:51.230429 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.231569 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.233537 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.234214 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.234363 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.237005 (+ 2642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:51.237012 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:51.237017 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:51.237064 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:51.240876 (+ 3812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.241814 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.241820 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.241824 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.242023 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.242548 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.242553 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.242557 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.243012 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:51.243182 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:51.243846 (+ 664us) server_negotiation.cc:299] Negotiation successful
0811 18:47:51.244488 (+ 642us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 18:47:51.246212 4540 tablet_copy_service.cc:140] P 5e617b487cf2450fb23d1122274e75dc: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer ffc129de04a54bfe8a890bc558cda5d0 ({username='oryx', principal='oryx/127.25.25.61@KRBTEST.COM'} at 127.0.0.1:46864)
I20260811 18:47:51.246507 4540 tablet_copy_service.cc:161] P 5e617b487cf2450fb23d1122274e75dc: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer ffc129de04a54bfe8a890bc558cda5d0 at {username='oryx', principal='oryx/127.25.25.61@KRBTEST.COM'} at 127.0.0.1:46864: session id = ffc129de04a54bfe8a890bc558cda5d0-00000000000000000000000000000000
I20260811 18:47:51.251107 4540 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 18:47:51.253790 5387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 18:47:51.261487 5387 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0: tablet copy: Starting download of 0 data blocks...
I20260811 18:47:51.261874 5387 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0: tablet copy: Starting download of 1 WAL segments...
I20260811 18:47:51.265170 5387 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 18:47:51.270318 4540 tablet_copy_service.cc:342] P 5e617b487cf2450fb23d1122274e75dc: Request end of tablet copy session ffc129de04a54bfe8a890bc558cda5d0-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.25.25.61@KRBTEST.COM'} at 127.0.0.1:46864
I20260811 18:47:51.270537 4540 tablet_copy_service.cc:433] P 5e617b487cf2450fb23d1122274e75dc: ending tablet copy session ffc129de04a54bfe8a890bc558cda5d0-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer ffc129de04a54bfe8a890bc558cda5d0
I20260811 18:47:51.284018 5387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:51.287254 5611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:51.289659 5612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:51.304390 5387 server_base.cc:1034] running on GCE node
W20260811 18:47:51.305786 5617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:51.306433 5387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:51.307199 5387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:51.308414 5387 hybrid_clock.cc:648] HybridClock initialized: now 1786474071308339 us; error 46 us; skew 500 ppm
I20260811 18:47:51.308665 5387 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:51 dist-test-slave-lgr5 krb5kdc[4400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474071, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:51.310976 5387 init.cc:377] Logged in from keytab as oryx/127.25.25.61@KRBTEST.COM (short username oryx)
I20260811 18:47:51.317543 5387 webserver.cc:460] Webserver started at http://127.25.25.61:41681/ using document root <none> and password file <none>
I20260811 18:47:51.318048 5387 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:51.318166 5387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:51.321830 5387 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.004s
I20260811 18:47:51.324136 5625 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:51.324635 5387 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 18:47:51.324792 5387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-1/wal
uuid: "ffc129de04a54bfe8a890bc558cda5d0"
format_stamp: "Formatted at 2026-08-11 18:47:50 on dist-test-slave-lgr5"
server_key: "112e77f0d6af94f322afcd6c7179aaf5"
server_key_iv: "eb082f88b643f6f6ec85901f95a6d916"
server_key_version: "encryptionkey@0"
I20260811 18:47:51.324987 5387 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:51.338722 5387 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:51.343233 5387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:51.374871 5387 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.61:40099
I20260811 18:47:51.374915 5716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.61:40099 every 8 connection(s)
I20260811 18:47:51.375968 5387 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-1/data/info.pb
I20260811 18:47:51.382202 5717 sys_catalog.cc:263] Verifying existing consensus state
I20260811 18:47:51.386746 5717 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0: Bootstrap starting.
I20260811 18:47:51.408291 5717 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:47:51.408998 5717 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0: Bootstrap complete.
I20260811 18:47:51.410317 5717 raft_consensus.cc:348] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: NON_VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: true } }
I20260811 18:47:51.410643 5717 raft_consensus.cc:729] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ffc129de04a54bfe8a890bc558cda5d0, State: Initialized, Role: LEARNER
I20260811 18:47:51.410936 5717 consensus_queue.cc:260] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: NON_VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: true } }
I20260811 18:47:51.412473 5717 sys_catalog.cc:564] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:47:51.412305 5722 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: NON_VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: true } } }
I20260811 18:47:51.412933 5722 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [sys.catalog]: This master's current role is: LEARNER
I20260811 18:47:51.421660 5738 catalog_manager.cc:1259] Loaded cluster ID: f8699c4e063a4333b04d7b253ce41761
I20260811 18:47:51.421793 5738 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0: loading cluster ID for follower catalog manager: success
I20260811 18:47:51.425797 5738 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0: acquiring CA information for follower catalog manager: success
I20260811 18:47:51.428493 5738 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 18:47:51.458520 5374 heartbeater.cc:503] Master 127.25.25.62:40987 was elected leader, sending a full tablet report...
W20260811 18:47:51.602212 5593 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:51.602535 5593 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:51.602634 5593 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:51.610256 5593 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:47:51.610397 5593 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:51.610456 5593 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:51.610514 5593 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:47:51.610558 5593 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:47:51.621471 5593 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:43463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:40987,127.25.25.61:40099,127.25.25.60:37093
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.60.keytab
--principal=oryx/127.25.25.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.60:37093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.25.25.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:51.622884 5593 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:51.624276 5593 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:51.637029 5749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:51.637107 5752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:51.637064 5755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:51.638324 5593 server_base.cc:1034] running on GCE node
I20260811 18:47:51.639217 5593 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:51.640820 5593 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:51.642037 5593 hybrid_clock.cc:648] HybridClock initialized: now 1786474071641988 us; error 48 us; skew 500 ppm
I20260811 18:47:51.642395 5593 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:51 dist-test-slave-lgr5 krb5kdc[4400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474071, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:51.645663 5593 init.cc:377] Logged in from keytab as oryx/127.25.25.60@KRBTEST.COM (short username oryx)
I20260811 18:47:51.647351 5593 webserver.cc:460] Webserver started at http://127.25.25.60:38565/ using document root <none> and password file <none>
I20260811 18:47:51.648224 5593 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:51.648384 5593 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:51.648686 5593 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:51.651928 5593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-2/data/instance:
uuid: "45bbe6823a8b4824bf97078170308744"
format_stamp: "Formatted at 2026-08-11 18:47:51 on dist-test-slave-lgr5"
server_key: "3ae177796b3703ea70baa9523fa1deba"
server_key_iv: "78015ed359561e34f383170d7925105a"
server_key_version: "encryptionkey@0"
I20260811 18:47:51.652866 5593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-2/wal/instance:
uuid: "45bbe6823a8b4824bf97078170308744"
format_stamp: "Formatted at 2026-08-11 18:47:51 on dist-test-slave-lgr5"
server_key: "3ae177796b3703ea70baa9523fa1deba"
server_key_iv: "78015ed359561e34f383170d7925105a"
server_key_version: "encryptionkey@0"
I20260811 18:47:51.659032 5593 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 18:47:51.663129 5766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:51.664685 5593 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:47:51.664868 5593 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-2/wal
uuid: "45bbe6823a8b4824bf97078170308744"
format_stamp: "Formatted at 2026-08-11 18:47:51 on dist-test-slave-lgr5"
server_key: "3ae177796b3703ea70baa9523fa1deba"
server_key_iv: "78015ed359561e34f383170d7925105a"
server_key_version: "encryptionkey@0"
I20260811 18:47:51.665078 5593 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:51.678617 5593 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:51.683210 5593 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:51.683522 5593 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:51.703815 5593 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.60:37093
I20260811 18:47:51.703832 5870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.60:37093 every 8 connection(s)
I20260811 18:47:51.705616 5593 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-2/data/info.pb
I20260811 18:47:51.711721 5871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:51.712836 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 5593
I20260811 18:47:51.726565 5860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.700935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36892 (local address 127.25.25.61:40099)
0811 18:47:51.720587 (+ 19652us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:51.720593 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:51.720616 (+ 23us) server_negotiation.cc:407] Connection header received
0811 18:47:51.720699 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:51.720705 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:51.720818 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:51.721147 (+ 329us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:51.721651 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.722689 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.724362 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.725309 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.725443 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.725683 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:51.725944 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 18:47:51.726108 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19482,"thread_start_us":19346,"threads_started":1}
I20260811 18:47:51.726544 5857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.700794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:40099 (local address 127.0.0.1:36892)
0811 18:47:51.717013 (+ 16219us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:51.717040 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:51.717417 (+ 377us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:51.721225 (+ 3808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:51.721232 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:51.721267 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:51.721478 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.721489 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.722864 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.722869 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.724177 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.724196 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.725537 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.725544 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.725740 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.725799 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 18:47:51.725893 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 18:47:51.726156 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16048,"thread_start_us":16723,"threads_started":1}
I20260811 18:47:51.725205 5871 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:47:51.728214 5674 raft_consensus.cc:1203] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260811 18:47:51.728899 5722 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e617b487cf2450fb23d1122274e75dc. Latest consensus state: current_term: 1 leader_uuid: "5e617b487cf2450fb23d1122274e75dc" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: NON_VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: true } } }
I20260811 18:47:51.729156 5722 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [sys.catalog]: This master's current role is: LEARNER
Aug 11 18:47:51 dist-test-slave-lgr5 krb5kdc[4400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474068, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.25.60@KRBTEST.COM
Aug 11 18:47:51 dist-test-slave-lgr5 krb5kdc[4400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474071, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.60@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM
I20260811 18:47:51.746891 5537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.730946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46876 (local address 127.25.25.62:40987)
0811 18:47:51.731167 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:51.731174 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:51.731879 (+ 705us) server_negotiation.cc:407] Connection header received
0811 18:47:51.732124 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:51.732129 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:51.732206 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:51.732288 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:51.733672 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.734616 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.736169 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.736859 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.736999 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.740931 (+ 3932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:51.740938 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:51.740943 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:51.740991 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:51.743885 (+ 2894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.744758 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.744764 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.744767 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.744932 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.745286 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.745291 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.745294 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.745650 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:51.745794 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:51.746324 (+ 530us) server_negotiation.cc:299] Negotiation successful
0811 18:47:51.746556 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 18:47:51.747715 5876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.730733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.0.0.1:46876)
0811 18:47:51.731634 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:51.731690 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:51.731966 (+ 276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:51.732392 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:51.732399 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:51.733136 (+ 737us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:51.733492 (+ 356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.733505 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.734790 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.734795 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.735979 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.735993 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.737079 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.737085 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.737214 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.737844 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:51.737869 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:51.740697 (+ 2828us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:51.744022 (+ 3325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:51.744032 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:51.744037 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:51.744637 (+ 600us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:51.745042 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:51.745045 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:51.745047 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:51.745181 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:51.745787 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:51.745795 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:51.745998 (+ 203us) client_negotiation.cc:769] Sending connection context
0811 18:47:51.746210 (+ 212us) client_negotiation.cc:240] Negotiation successful
0811 18:47:51.746548 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":450,"threads_started":1}
I20260811 18:47:51.747741 5874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.716321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39160 (local address 127.25.25.60:37093)
0811 18:47:51.718917 (+ 2596us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:51.718931 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:51.718988 (+ 57us) server_negotiation.cc:407] Connection header received
0811 18:47:51.726233 (+ 7245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:51.726275 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:51.727144 (+ 869us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:51.727701 (+ 557us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:51.729722 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.731534 (+ 1812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.733026 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.733992 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.734132 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.739369 (+ 5237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:51.739384 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:51.739406 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:51.739449 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:51.743047 (+ 3598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.743791 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.743802 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.743813 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.744025 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.744497 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.744528 (+ 31us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.744530 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.745263 (+ 733us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:51.745579 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:51.745960 (+ 381us) server_negotiation.cc:299] Negotiation successful
0811 18:47:51.746364 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2308,"thread_start_us":1995,"threads_started":1}
I20260811 18:47:51.749562 5871 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:47:51 dist-test-slave-lgr5 krb5kdc[4400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474071, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.60@KRBTEST.COM for oryx/127.25.25.61@KRBTEST.COM
I20260811 18:47:51.762405 5876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.750430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:40099 (local address 127.0.0.1:36898)
0811 18:47:51.750620 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:51.750640 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:51.750746 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:51.751076 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:51.751079 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:51.751422 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:51.751566 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.751574 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.752697 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.752701 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.753630 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.753643 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.754376 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.754380 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.754509 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.755060 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:51.755078 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:51.757135 (+ 2057us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:51.760163 (+ 3028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:51.760167 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:51.760170 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:51.760613 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:51.760971 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:51.760974 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:51.760976 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:51.761111 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:51.761613 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:51.761617 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:51.761759 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 18:47:51.761882 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 18:47:51.762151 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 18:47:51.762436 5860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.750480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36898 (local address 127.25.25.61:40099)
0811 18:47:51.750694 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:51.750700 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:51.750720 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:47:51.750871 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:51.750877 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:51.750962 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:51.751041 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:51.751731 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.752564 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.753778 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.754241 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.754342 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.757322 (+ 2980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:51.757329 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:51.757333 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:51.757373 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:51.759956 (+ 2583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.760723 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.760727 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.760730 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.760887 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.761188 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.761191 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.761193 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.761476 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:51.761592 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:51.761978 (+ 386us) server_negotiation.cc:299] Negotiation successful
0811 18:47:51.762183 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 18:47:51.763773 5871 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.60" port: 37093 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:47:51 dist-test-slave-lgr5 krb5kdc[4400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474071, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.60@KRBTEST.COM for oryx/127.25.25.60@KRBTEST.COM
I20260811 18:47:51.777412 5876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.764440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:37093 (local address 127.0.0.1:39164)
0811 18:47:51.764665 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:51.764688 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:51.764829 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:51.765173 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:51.765177 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:51.765569 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:51.765717 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.765726 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.766722 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.766726 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.767591 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.767602 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.768426 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.768433 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.768671 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.769305 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:51.769326 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:51.771760 (+ 2434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:51.774829 (+ 3069us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:51.774833 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:51.774836 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:51.775252 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:51.775627 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:51.775631 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:51.775633 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:51.775823 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:51.776496 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:51.776500 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:51.776648 (+ 148us) client_negotiation.cc:769] Sending connection context
0811 18:47:51.776770 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 18:47:51.777026 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260811 18:47:51.777419 5874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.764618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39164 (local address 127.25.25.60:37093)
0811 18:47:51.764773 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:51.764780 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:51.764799 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:47:51.764944 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:51.764948 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:51.765009 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:51.765114 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:51.765876 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.766596 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.767723 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.768247 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.768390 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.771976 (+ 3586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:51.771981 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:51.771985 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:51.772015 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:51.774644 (+ 2629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.775390 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.775394 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.775396 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.775520 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.775975 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.775979 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.775981 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.776376 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:51.776508 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:51.776912 (+ 404us) server_negotiation.cc:299] Negotiation successful
0811 18:47:51.777161 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":50}
I20260811 18:47:51.782883 5871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744: Bootstrap starting.
I20260811 18:47:51.786480 5871 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:51.787670 5871 log.cc:824] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:51.790741 5871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744: No bootstrap required, opened a new log
I20260811 18:47:51.798802 5871 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 37093 } }
I20260811 18:47:51.799238 5871 raft_consensus.cc:374] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:51.799367 5871 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45bbe6823a8b4824bf97078170308744, State: Initialized, Role: FOLLOWER
I20260811 18:47:51.800149 5871 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 37093 } }
I20260811 18:47:51.801222 5878 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 37093 } } }
I20260811 18:47:51.801654 5878 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:47:51.802500 5871 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 18:47:51.812314 5902 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:47:51.812469 5902 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:47:51.814390 5878 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:47:51.814687 5878 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 37093 } }
I20260811 18:47:51.816025 5878 leader_election.cc:288] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e617b487cf2450fb23d1122274e75dc (127.25.25.62:40987), ffc129de04a54bfe8a890bc558cda5d0 (127.25.25.61:40099)
I20260811 18:47:51.816453 4511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "45bbe6823a8b4824bf97078170308744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e617b487cf2450fb23d1122274e75dc" is_pre_election: true
I20260811 18:47:51.816758 5674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "45bbe6823a8b4824bf97078170308744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc129de04a54bfe8a890bc558cda5d0" is_pre_election: true
I20260811 18:47:51.817874 5773 leader_election.cc:302] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45bbe6823a8b4824bf97078170308744; no voters: 5e617b487cf2450fb23d1122274e75dc, ffc129de04a54bfe8a890bc558cda5d0
I20260811 18:47:51.818503 5878 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 18:47:51.820333 5593 master_runner.cc:428] Detected that this master 45bbe6823a8b4824bf97078170308744 is joining an existing cluster
I20260811 18:47:51.820483 5593 master_runner.cc:432] Initiating AddMaster RPC to add 127.25.25.60:37093
I20260811 18:47:51.845693 5537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.826352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46884 (local address 127.25.25.62:40987)
0811 18:47:51.826581 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:51.826588 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:51.828164 (+ 1576us) server_negotiation.cc:407] Connection header received
0811 18:47:51.828525 (+ 361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:51.828532 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:51.828626 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:51.828704 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:51.830472 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.831780 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.833990 (+ 2210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.834684 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.834822 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.837949 (+ 3127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:51.837958 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:51.837962 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:51.838019 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:51.841796 (+ 3777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.842755 (+ 959us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.842762 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.842766 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.842962 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.843596 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.843602 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.843606 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.844025 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:51.844230 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:51.844975 (+ 745us) server_negotiation.cc:299] Negotiation successful
0811 18:47:51.845273 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 18:47:51.847399 5914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.826915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.0.0.1:46884)
0811 18:47:51.827892 (+ 977us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:51.827915 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:51.828329 (+ 414us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:51.828950 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:51.828956 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:51.829771 (+ 815us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:51.830216 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.830233 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.832007 (+ 1774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.832013 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.833759 (+ 1746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.833779 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.835224 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.835232 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.835440 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.836276 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:51.836310 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:51.837649 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:51.842043 (+ 4394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:51.842048 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:51.842051 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:51.842616 (+ 565us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:51.843124 (+ 508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:51.843128 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:51.843132 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:51.843417 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:51.844208 (+ 791us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:51.844213 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:51.844481 (+ 268us) client_negotiation.cc:769] Sending connection context
0811 18:47:51.846301 (+ 1820us) client_negotiation.cc:240] Negotiation successful
0811 18:47:51.846701 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":784,"thread_start_us":508,"threads_started":1}
I20260811 18:47:51.854439 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 4617
I20260811 18:47:51.869161 5860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.826364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36910 (local address 127.25.25.61:40099)
0811 18:47:51.826597 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:51.826603 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:51.842536 (+ 15933us) server_negotiation.cc:407] Connection header received
0811 18:47:51.842726 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:51.842731 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:51.842823 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:51.842918 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:51.845401 (+ 2483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.846509 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.849690 (+ 3181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.850366 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.850480 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.857546 (+ 7066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:51.857555 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:51.857561 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:51.857613 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:51.861445 (+ 3832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.862530 (+ 1085us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.862538 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.862542 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.862744 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.863272 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.863277 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.863280 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.863709 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:51.863846 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:51.868447 (+ 4601us) server_negotiation.cc:299] Negotiation successful
0811 18:47:51.868787 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 18:47:51.872468 5874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.828298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39174 (local address 127.25.25.60:37093)
0811 18:47:51.828514 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:51.828520 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:51.842697 (+ 14177us) server_negotiation.cc:407] Connection header received
0811 18:47:51.842924 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:51.842928 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:51.842996 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:51.843056 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:51.845354 (+ 2298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.846504 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.849232 (+ 2728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.849952 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.850071 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.863712 (+ 13641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:51.863718 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:51.863723 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:51.863759 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:51.868012 (+ 4253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.869369 (+ 1357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.869374 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.869381 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.869563 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.869970 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.869975 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.869978 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.870636 (+ 658us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:51.870857 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:51.871384 (+ 527us) server_negotiation.cc:299] Negotiation successful
0811 18:47:51.871693 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":67}
I20260811 18:47:51.880565 5917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.826915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:40099 (local address 127.0.0.1:36910)
0811 18:47:51.842225 (+ 15310us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:51.842257 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:51.842568 (+ 311us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:51.843112 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:51.843116 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:51.844666 (+ 1550us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:51.845184 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.845200 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.847078 (+ 1878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.847083 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.849480 (+ 2397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.849496 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.854397 (+ 4901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.854404 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.854639 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.855743 (+ 1104us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:51.855778 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:51.857194 (+ 1416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:51.861695 (+ 4501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:51.861700 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:51.861704 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:51.862317 (+ 613us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:51.862913 (+ 596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:51.862919 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:51.862923 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:51.863132 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:51.863936 (+ 804us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:51.863941 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:51.864229 (+ 288us) client_negotiation.cc:769] Sending connection context
0811 18:47:51.869524 (+ 5295us) client_negotiation.cc:240] Negotiation successful
0811 18:47:51.869884 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15133,"mutex_wait_us":29,"thread_start_us":14995,"threads_started":1}
I20260811 18:47:51.881289 5916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.828631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:37093 (local address 127.0.0.1:39174)
0811 18:47:51.842365 (+ 13734us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:51.842381 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:51.842793 (+ 412us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:51.843252 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:51.843256 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:51.844623 (+ 1367us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:51.845179 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.845197 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.846888 (+ 1691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.846894 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.849080 (+ 2186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.849097 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.850460 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.850468 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.850693 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.852619 (+ 1926us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:51.852643 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:51.863305 (+ 10662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:51.868226 (+ 4921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:51.868231 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:51.868235 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:51.869227 (+ 992us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:51.869691 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:51.869695 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:51.869698 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:51.869842 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:51.870801 (+ 959us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:51.870809 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:51.871061 (+ 252us) client_negotiation.cc:769] Sending connection context
0811 18:47:51.872146 (+ 1085us) client_negotiation.cc:240] Negotiation successful
0811 18:47:51.872743 (+ 597us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13612,"mutex_wait_us":29,"thread_start_us":13126,"threads_started":1}
Aug 11 18:47:51 dist-test-slave-lgr5 krb5kdc[4400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474068, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.62@KRBTEST.COM for oryx/127.25.25.60@KRBTEST.COM
Aug 11 18:47:51 dist-test-slave-lgr5 krb5kdc[4400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474068, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.25.1@KRBTEST.COM
I20260811 18:47:51.890324 5857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.854391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:37093 (local address 127.0.0.1:39190)
0811 18:47:51.854780 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:51.854800 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:51.854915 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:51.873721 (+ 18806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:51.873727 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:51.874136 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:51.874321 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.874332 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.876109 (+ 1777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.876117 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.877606 (+ 1489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:51.877631 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.878813 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.878820 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:51.879048 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.879799 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:51.879825 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:51.882392 (+ 2567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:51.886396 (+ 4004us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:51.886403 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:51.886407 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:51.887013 (+ 606us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:51.887557 (+ 544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:51.887562 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:51.887566 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:51.887742 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:51.888527 (+ 785us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:51.888532 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:51.888731 (+ 199us) client_negotiation.cc:769] Sending connection context
0811 18:47:51.888866 (+ 135us) client_negotiation.cc:240] Negotiation successful
0811 18:47:51.889958 (+ 1092us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232}
I20260811 18:47:51.891203 5874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.855146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39190 (local address 127.25.25.60:37093)
0811 18:47:51.872808 (+ 17662us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:51.872815 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:51.872839 (+ 24us) server_negotiation.cc:407] Connection header received
0811 18:47:51.873291 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:51.873298 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:51.873447 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:51.874496 (+ 1049us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:51.874704 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.875857 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.877812 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.878605 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.878757 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.882743 (+ 3986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:51.882748 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:51.882752 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:51.882785 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:51.886207 (+ 3422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.887197 (+ 990us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.887203 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.887207 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.887384 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.887896 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.887901 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.887904 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.888356 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:51.890613 (+ 2257us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:51.890732 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 18:47:51.890923 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17527,"thread_start_us":17993,"threads_started":1}
I20260811 18:47:51.892679 4488 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.25.25.60:37093: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "45bbe6823a8b4824bf97078170308744"
member_type: NON_VOTER
last_known_addr {
host: "127.25.25.60"
port: 37093
}
attrs {
promote: true
}
}
dest_uuid: "5e617b487cf2450fb23d1122274e75dc"
cas_config_opid_index: 5
I20260811 18:47:51.893846 4488 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: NON_VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: true } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: NON_VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: true } }
I20260811 18:47:51.894397 5920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:51.856039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34278 (local address 127.25.25.1:34169)
0811 18:47:51.873830 (+ 17791us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:51.873843 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:51.873879 (+ 36us) server_negotiation.cc:407] Connection header received
0811 18:47:51.873975 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:51.873986 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:51.874286 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:51.874564 (+ 278us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:51.876363 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.877525 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.879290 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:51.880126 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:51.880261 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:51.886044 (+ 5783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:51.886063 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:51.886080 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:51.886128 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:51.890301 (+ 4173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.891466 (+ 1165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.891478 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.891482 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.891744 (+ 262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:51.892276 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:51.892282 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:51.892286 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:51.892794 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:51.893127 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:51.893652 (+ 525us) server_negotiation.cc:299] Negotiation successful
0811 18:47:51.893972 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17575,"thread_start_us":17353,"threads_started":1}
I20260811 18:47:51.896209 4856 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:51.895815 5844 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 45bbe6823a8b4824bf97078170308744 (127.25.25.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: NON_VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: true } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: NON_VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: true } } }
I20260811 18:47:51.899915 5674 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [term 1 LEARNER]: Refusing update from remote peer 5e617b487cf2450fb23d1122274e75dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 18:47:51.900894 5824 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:51.901583 5844 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.25.25.60:37093
I20260811 18:47:51.905612 5824 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [term 1 FOLLOWER]: Refusing update from remote peer 5e617b487cf2450fb23d1122274e75dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 18:47:51.910429 5844 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "5e617b487cf2450fb23d1122274e75dc" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: NON_VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: true } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: NON_VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: true } } }
I20260811 18:47:51.910771 5844 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:51.909548 5925 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: NON_VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260811 18:47:51.916347 5844 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: NON_VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:47:51.926025 5674 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 45bbe6823a8b4824bf97078170308744 (127.25.25.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: NON_VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: true } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: NON_VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: true } } }
I20260811 18:47:51.929656 5722 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5e617b487cf2450fb23d1122274e75dc" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: NON_VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: true } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: NON_VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: true } } }
I20260811 18:47:51.930013 5722 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [sys.catalog]: This master's current role is: LEARNER
I20260811 18:47:51.930953 5844 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc: attempting to promote NON_VOTER ffc129de04a54bfe8a890bc558cda5d0 to VOTER
I20260811 18:47:51.931753 5844 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: NON_VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: true } }
I20260811 18:47:51.932485 5593 master.cc:537] Master@127.25.25.60:37093 shutting down...
W20260811 18:47:51.935830 5779 tablet.cc:2369] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:47:51.951874 5674 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [term 1 LEARNER]: Refusing update from remote peer 5e617b487cf2450fb23d1122274e75dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 18:47:51.954023 5927 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 18:47:51.958204 5927 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, ffc129de04a54bfe8a890bc558cda5d0 (127.25.25.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: NON_VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: true } } }
I20260811 18:47:51.961402 5673 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, ffc129de04a54bfe8a890bc558cda5d0 (127.25.25.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: NON_VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: true } } }
I20260811 18:47:51.970430 5844 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "5e617b487cf2450fb23d1122274e75dc" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: NON_VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: true } } }
I20260811 18:47:51.970814 5844 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:51.977733 5844 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5e617b487cf2450fb23d1122274e75dc" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: NON_VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: true } } }
I20260811 18:47:51.978642 5844 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:51.980310 5722 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5e617b487cf2450fb23d1122274e75dc" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: NON_VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: true } } }
I20260811 18:47:51.980767 5722 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 18:47:51.987030 4458 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.25.60:37093, user_credentials={real_user=slave}} blocked reactor thread for 49109.6us
W20260811 18:47:51.989145 4458 consensus_peers.cc:487] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc -> Peer 45bbe6823a8b4824bf97078170308744 (127.25.25.60:37093): Couldn't send request to peer 45bbe6823a8b4824bf97078170308744. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 18:47:51.989217 5824 raft_consensus.cc:858] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 37093 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: NON_VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: NON_VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: true } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: NON_VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: true } }
W20260811 18:47:51.989741 5824 raft_consensus.cc:1565] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 37093 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: NON_VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: NON_VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: true } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: NON_VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: true } }
I20260811 18:47:52.007980 5824 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER ffc129de04a54bfe8a890bc558cda5d0 (127.25.25.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: NON_VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: true } } }
I20260811 18:47:52.012346 5944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5e617b487cf2450fb23d1122274e75dc" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: NON_VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: true } } }
I20260811 18:47:52.013111 5944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260811 18:47:52.013331 5939 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5e617b487cf2450fb23d1122274e75dc" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: NON_VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: true } } }
I20260811 18:47:52.013743 5939 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260811 18:47:52.012804 5878 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e617b487cf2450fb23d1122274e75dc. Latest consensus state: current_term: 1 leader_uuid: "5e617b487cf2450fb23d1122274e75dc" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: NON_VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: true } } }
I20260811 18:47:52.013917 5878 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260811 18:47:52.016641 5593 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260811 18:47:52.017100 5593 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260811 18:47:52.017315 5593 tablet_replica.cc:330] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744: stopping tablet replica
I20260811 18:47:52.024709 5593 master.cc:552] Master@127.25.25.60:37093 shutdown complete.
I20260811 18:47:52.024816 5593 master_runner.cc:305] Clearing existing system tablet
I20260811 18:47:52.025214 5593 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:52.025322 5593 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:52.032680 5593 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.007s sys 0.001s
I20260811 18:47:52.036564 5946 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:52.037125 5593 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:52.037443 5593 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260811 18:47:52.037565 5593 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-2/wal
uuid: "45bbe6823a8b4824bf97078170308744"
format_stamp: "Formatted at 2026-08-11 18:47:51 on dist-test-slave-lgr5"
server_key: "3ae177796b3703ea70baa9523fa1deba"
server_key_iv: "78015ed359561e34f383170d7925105a"
server_key_version: "encryptionkey@0"
I20260811 18:47:52.042832 5593 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:52.050622 5593 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 18:47:52.050850 5593 log.cc:1196] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 18:47:52.051398 5593 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744: Deleting consensus metadata
I20260811 18:47:52.051714 5593 master_runner.cc:315] Copying system tablet from 127.25.25.62:40987
I20260811 18:47:52.054538 5593 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744: tablet copy: Beginning tablet copy session from remote peer at address 127.25.25.62:40987
I20260811 18:47:52.061106 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 4617
I20260811 18:47:52.072178 5537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:52.055482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46894 (local address 127.25.25.62:40987)
0811 18:47:52.055743 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:52.055750 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:52.056338 (+ 588us) server_negotiation.cc:407] Connection header received
0811 18:47:52.056571 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:52.056578 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:52.056667 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:52.056772 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:52.057842 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:52.058978 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:52.060999 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:52.061715 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:52.061823 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:52.064696 (+ 2873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:52.064704 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:52.064709 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:52.064756 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:52.068638 (+ 3882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:52.069701 (+ 1063us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:52.069708 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:52.069712 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:52.069904 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:52.070415 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:52.070421 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:52.070424 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:52.070833 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:52.070994 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:52.071478 (+ 484us) server_negotiation.cc:299] Negotiation successful
0811 18:47:52.071755 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
I20260811 18:47:52.072180 5963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:52.055398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.0.0.1:46894)
0811 18:47:52.056196 (+ 798us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:52.056228 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:52.056399 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:52.056839 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:52.056843 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:52.057371 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:52.057674 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:52.057687 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:52.059170 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:52.059177 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:52.060796 (+ 1619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:52.060816 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:52.062141 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:52.062149 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:52.062363 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:52.063140 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:52.063176 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:52.064391 (+ 1215us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:52.068902 (+ 4511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:52.068908 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:52.068911 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:52.069508 (+ 597us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:52.070045 (+ 537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:52.070051 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:52.070055 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:52.070278 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:52.070969 (+ 691us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:52.070974 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:52.071169 (+ 195us) client_negotiation.cc:769] Sending connection context
0811 18:47:52.071324 (+ 155us) client_negotiation.cc:240] Negotiation successful
0811 18:47:52.071680 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"thread_start_us":469,"threads_started":1}
I20260811 18:47:52.072785 4540 tablet_copy_service.cc:140] P 5e617b487cf2450fb23d1122274e75dc: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 45bbe6823a8b4824bf97078170308744 ({username='oryx', principal='oryx/127.25.25.60@KRBTEST.COM'} at 127.0.0.1:46894)
I20260811 18:47:52.072973 4540 tablet_copy_service.cc:161] P 5e617b487cf2450fb23d1122274e75dc: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 45bbe6823a8b4824bf97078170308744 at {username='oryx', principal='oryx/127.25.25.60@KRBTEST.COM'} at 127.0.0.1:46894: session id = 45bbe6823a8b4824bf97078170308744-00000000000000000000000000000000
I20260811 18:47:52.076614 4540 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 18:47:52.078779 5593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 18:47:52.086606 5593 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744: tablet copy: Starting download of 0 data blocks...
I20260811 18:47:52.087003 5593 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744: tablet copy: Starting download of 1 WAL segments...
I20260811 18:47:52.089977 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:34169
--local_ip_for_outbound_sockets=127.25.25.1
--tserver_master_addrs=127.25.25.62:40987
--webserver_port=34217
--webserver_interface=127.25.25.1
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.1.keytab
--principal=oryx/127.25.25.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:43463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.25.25.62:40987,127.25.25.61:40099
--tserver_master_addrs=127.25.25.62:40987,127.25.25.61:40099,127.25.25.60:37093 with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:47:52.090166 5593 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 18:47:52.095320 4540 tablet_copy_service.cc:342] P 5e617b487cf2450fb23d1122274e75dc: Request end of tablet copy session 45bbe6823a8b4824bf97078170308744-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.25.25.60@KRBTEST.COM'} at 127.0.0.1:46894
I20260811 18:47:52.095518 4540 tablet_copy_service.cc:433] P 5e617b487cf2450fb23d1122274e75dc: ending tablet copy session 45bbe6823a8b4824bf97078170308744-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 45bbe6823a8b4824bf97078170308744
I20260811 18:47:52.109803 5593 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:52.112775 5966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:52.117717 5967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:52.128360 5970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:52.134019 5593 server_base.cc:1034] running on GCE node
I20260811 18:47:52.134452 5593 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:52.135211 5593 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:52.136425 5593 hybrid_clock.cc:648] HybridClock initialized: now 1786474072136322 us; error 98 us; skew 500 ppm
I20260811 18:47:52.136698 5593 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:52 dist-test-slave-lgr5 krb5kdc[4400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474072, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:52.139489 5593 init.cc:377] Logged in from keytab as oryx/127.25.25.60@KRBTEST.COM (short username oryx)
I20260811 18:47:52.144917 5593 webserver.cc:460] Webserver started at http://127.25.25.60:45705/ using document root <none> and password file <none>
I20260811 18:47:52.145339 5593 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:52.145462 5593 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:52.148955 5593 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.003s
I20260811 18:47:52.151041 5981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:52.151531 5593 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260811 18:47:52.151677 5593 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-2/wal
uuid: "45bbe6823a8b4824bf97078170308744"
format_stamp: "Formatted at 2026-08-11 18:47:51 on dist-test-slave-lgr5"
server_key: "3ae177796b3703ea70baa9523fa1deba"
server_key_iv: "78015ed359561e34f383170d7925105a"
server_key_version: "encryptionkey@0"
I20260811 18:47:52.151890 5593 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:52.166553 5593 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:52.171192 5593 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:52.201177 5593 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.60:37093
I20260811 18:47:52.201231 6068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.60:37093 every 8 connection(s)
I20260811 18:47:52.202497 5593 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/master-2/data/info.pb
I20260811 18:47:52.208614 6069 sys_catalog.cc:263] Verifying existing consensus state
I20260811 18:47:52.212999 6069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744: Bootstrap starting.
I20260811 18:47:52.231072 6069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:47:52.231701 6069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744: Bootstrap complete.
I20260811 18:47:52.233297 6069 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: NON_VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: true } }
I20260811 18:47:52.233631 6069 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 45bbe6823a8b4824bf97078170308744, State: Initialized, Role: LEARNER
I20260811 18:47:52.233942 6069 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: NON_VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: true } }
I20260811 18:47:52.236639 6074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: NON_VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: true } } }
I20260811 18:47:52.237020 6069 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:47:52.237210 6074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [sys.catalog]: This master's current role is: LEARNER
I20260811 18:47:52.253741 6095 catalog_manager.cc:1259] Loaded cluster ID: f8699c4e063a4333b04d7b253ce41761
I20260811 18:47:52.253876 6095 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744: loading cluster ID for follower catalog manager: success
I20260811 18:47:52.257869 6095 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744: acquiring CA information for follower catalog manager: success
I20260811 18:47:52.260910 6095 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 18:47:52.388967 5857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:52.380364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:37093 (local address 127.0.0.1:39202)
0811 18:47:52.380666 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:52.380688 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:52.380884 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:52.381995 (+ 1111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:52.382001 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:52.382038 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:52.382266 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:52.382277 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:52.384239 (+ 1962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:52.384247 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:52.386119 (+ 1872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:52.386143 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:52.388004 (+ 1861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:52.388012 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:52.388307 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:52.388349 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 18:47:52.388450 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 18:47:52.388619 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174}
I20260811 18:47:52.388990 6098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:52.380517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39202 (local address 127.25.25.60:37093)
0811 18:47:52.381559 (+ 1042us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:52.381565 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:52.381585 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:47:52.381666 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:52.381672 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:52.381773 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:52.381914 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:52.382451 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:52.383998 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:52.386360 (+ 2362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:52.387745 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:52.387920 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:52.388257 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:52.388486 (+ 229us) server_negotiation.cc:299] Negotiation successful
0811 18:47:52.388642 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":893,"thread_start_us":730,"threads_started":1}
I20260811 18:47:52.390264 6028 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260811 18:47:52.390723 6074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e617b487cf2450fb23d1122274e75dc. Latest consensus state: current_term: 1 leader_uuid: "5e617b487cf2450fb23d1122274e75dc" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: NON_VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: true } } }
I20260811 18:47:52.390995 6074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [sys.catalog]: This master's current role is: LEARNER
W20260811 18:47:52.509949 5964 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:52.510268 5964 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:52.510368 5964 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:52.518503 5964 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:52.518643 5964 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:52.518769 5964 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:47:52.529281 5964 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:43463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.1.keytab
--principal=oryx/127.25.25.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:34169
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=34217
--tserver_master_addrs=127.25.25.62:40987,127.25.25.61:40099,127.25.25.60:37093
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:52.530718 5964 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:52.532245 5964 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:52.546252 6107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:52.546278 6105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:52.546516 6104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:52.547176 5964 server_base.cc:1034] running on GCE node
I20260811 18:47:52.547900 5964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:52.549072 5964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:52.550323 5964 hybrid_clock.cc:648] HybridClock initialized: now 1786474072550243 us; error 65 us; skew 500 ppm
I20260811 18:47:52.550716 5964 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:52 dist-test-slave-lgr5 krb5kdc[4400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474072, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:52.554356 5964 init.cc:377] Logged in from keytab as oryx/127.25.25.1@KRBTEST.COM (short username oryx)
I20260811 18:47:52.555927 5964 webserver.cc:460] Webserver started at http://127.25.25.1:34217/ using document root <none> and password file <none>
I20260811 18:47:52.556725 5964 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:52.556862 5964 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:52.562952 5964 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 18:47:52.566164 6122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:52.567890 5964 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 18:47:52.568140 5964 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "a9e2fc3f8e914bac89172067877d3ba4"
format_stamp: "Formatted at 2026-08-11 18:47:49 on dist-test-slave-lgr5"
server_key: "bb3bcf743a7c3b3d399779ea186d4a4e"
server_key_iv: "1a1b5e9162848e955873974523101eec"
server_key_version: "encryptionkey@0"
I20260811 18:47:52.569257 5964 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:52.602450 5964 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:52.607272 5964 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:52.607573 5964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:52.608688 5964 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:47:52.610224 5964 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:52.610320 5964 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:52.610430 5964 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:52.610507 5964 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:52.643956 5964 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:34169
I20260811 18:47:52.644049 6327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:34169 every 8 connection(s)
I20260811 18:47:52.645531 5964 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:47:52.654054 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 5964
I20260811 18:47:52.654392 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 4885
Aug 11 18:47:52 dist-test-slave-lgr5 krb5kdc[4400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474072, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.61@KRBTEST.COM
Aug 11 18:47:52 dist-test-slave-lgr5 krb5kdc[4400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474072, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.60@KRBTEST.COM
I20260811 18:47:52.682649 6336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:52.648811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:48065 (local address 127.25.25.61:40099)
0811 18:47:52.649584 (+ 773us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:52.649590 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:52.652418 (+ 2828us) server_negotiation.cc:407] Connection header received
0811 18:47:52.654515 (+ 2097us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:52.654523 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:52.654664 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:52.654781 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:52.657810 (+ 3029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:52.659162 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:52.662275 (+ 3113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:52.663044 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:52.663157 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:52.673863 (+ 10706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:52.673872 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:52.673878 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:52.673935 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:52.678065 (+ 4130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:52.679449 (+ 1384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:52.679457 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:52.679462 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:52.679643 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:52.680323 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:52.680329 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:52.680332 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:52.680740 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:52.680911 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:52.681975 (+ 1064us) server_negotiation.cc:299] Negotiation successful
0811 18:47:52.682244 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":650,"thread_start_us":805,"threads_started":1}
Aug 11 18:47:52 dist-test-slave-lgr5 krb5kdc[4400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474068, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.25.2@KRBTEST.COM
I20260811 18:47:52.685896 6338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:52.649591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:40099 (local address 127.25.25.1:48065)
0811 18:47:52.650652 (+ 1061us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:52.650707 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:52.653814 (+ 3107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:52.655474 (+ 1660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:52.655491 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:52.656467 (+ 976us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:52.657522 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:52.657555 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:52.659491 (+ 1936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:52.659498 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:52.662041 (+ 2543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:52.662063 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:52.663610 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:52.663618 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:52.664016 (+ 398us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:52.664944 (+ 928us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:52.664989 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:52.668644 (+ 3655us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:52.678283 (+ 9639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:52.678296 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:52.678319 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:52.679107 (+ 788us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:52.679793 (+ 686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:52.679797 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:52.679800 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:52.680185 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:52.680915 (+ 730us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:52.680924 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:52.681446 (+ 522us) client_negotiation.cc:769] Sending connection context
0811 18:47:52.683012 (+ 1566us) client_negotiation.cc:240] Negotiation successful
0811 18:47:52.683721 (+ 709us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":708,"thread_start_us":434,"threads_started":1}
I20260811 18:47:52.688269 6334 heartbeater.cc:347] Connected to a master server at 127.25.25.61:40099
I20260811 18:47:52.688683 6334 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:52.689698 6098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:52.649026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:51485 (local address 127.25.25.60:37093)
0811 18:47:52.649241 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:52.649247 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:52.668729 (+ 19482us) server_negotiation.cc:407] Connection header received
0811 18:47:52.669012 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:52.669017 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:52.669099 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:52.669170 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:52.672837 (+ 3667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:52.673847 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:52.675868 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:52.676500 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:52.676599 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:52.681074 (+ 4475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:52.681082 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:52.681087 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:52.681133 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:52.684858 (+ 3725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:52.685877 (+ 1019us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:52.685883 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:52.685886 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:52.686746 (+ 860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:52.687609 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:52.687615 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:52.687618 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:52.688031 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:52.688227 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:52.689065 (+ 838us) server_negotiation.cc:299] Negotiation successful
0811 18:47:52.689353 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 18:47:52.689850 6334 heartbeater.cc:511] Master 127.25.25.61:40099 requested a full tablet report, sending...
I20260811 18:47:52.690546 6339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:52.649591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:37093 (local address 127.25.25.1:51485)
0811 18:47:52.668616 (+ 19025us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:52.668634 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:52.668852 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:52.669398 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:52.669403 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:52.670083 (+ 680us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:52.670430 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:52.670445 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:52.674060 (+ 3615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:52.674064 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:52.675685 (+ 1621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:52.675705 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:52.676918 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:52.676925 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:52.677118 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:52.677956 (+ 838us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:52.677980 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:52.680822 (+ 2842us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:52.685027 (+ 4205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:52.685033 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:52.685037 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:52.685707 (+ 670us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:52.686903 (+ 1196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:52.686908 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:52.686911 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:52.687490 (+ 579us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:52.688296 (+ 806us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:52.688305 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:52.688463 (+ 158us) client_negotiation.cc:769] Sending connection context
0811 18:47:52.688606 (+ 143us) client_negotiation.cc:240] Negotiation successful
0811 18:47:52.690081 (+ 1475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18847,"mutex_wait_us":100,"spinlock_wait_cycles":18688,"thread_start_us":18488,"threads_started":1}
Aug 11 18:47:52 dist-test-slave-lgr5 krb5kdc[4400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474072, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM
I20260811 18:47:52.692698 5655 ts_manager.cc:194] Registered new tserver with Master: a9e2fc3f8e914bac89172067877d3ba4 (127.25.25.1:34169)
I20260811 18:47:52.692829 6330 heartbeater.cc:347] Connected to a master server at 127.25.25.60:37093
I20260811 18:47:52.692986 6330 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:52.693482 6330 heartbeater.cc:511] Master 127.25.25.60:37093 requested a full tablet report, sending...
I20260811 18:47:52.694693 6343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:52.655819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44896 (local address 127.25.25.2:45075)
0811 18:47:52.667197 (+ 11378us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:52.667208 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:52.668798 (+ 1590us) server_negotiation.cc:407] Connection header received
0811 18:47:52.668886 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:52.668896 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:52.669201 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:52.669359 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:52.671698 (+ 2339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:52.673329 (+ 1631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:52.676583 (+ 3254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:52.677862 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:52.677994 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:52.684702 (+ 6708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:52.684725 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:52.684745 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:52.684796 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:52.689127 (+ 4331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:52.690188 (+ 1061us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:52.690199 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:52.690203 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:52.690383 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:52.691829 (+ 1446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:52.691835 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:52.691839 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:52.692336 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:52.692680 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:52.693279 (+ 599us) server_negotiation.cc:299] Negotiation successful
0811 18:47:52.694267 (+ 988us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11138,"thread_start_us":8974,"threads_started":1}
I20260811 18:47:52.695266 6014 ts_manager.cc:194] Registered new tserver with Master: a9e2fc3f8e914bac89172067877d3ba4 (127.25.25.1:34169)
I20260811 18:47:52.696202 5113 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:52.698401 6347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:52.668936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:46357 (local address 127.25.25.62:40987)
0811 18:47:52.677772 (+ 8836us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:52.677778 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:52.680035 (+ 2257us) server_negotiation.cc:407] Connection header received
0811 18:47:52.681185 (+ 1150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:52.681192 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:52.681291 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:52.681371 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:52.682766 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:52.683962 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:52.685998 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:52.686620 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:52.686726 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:52.692193 (+ 5467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:52.692200 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:52.692203 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:52.692240 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:52.695674 (+ 3434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:52.696424 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:52.696430 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:52.696434 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:52.696574 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:52.696981 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:52.696986 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:52.696989 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:52.697256 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:52.697389 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:52.697841 (+ 452us) server_negotiation.cc:299] Negotiation successful
0811 18:47:52.698063 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8689,"thread_start_us":10278,"threads_started":1}
I20260811 18:47:52.698457 6346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:52.668829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.25.25.1:46357)
0811 18:47:52.679930 (+ 11101us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:52.679952 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:52.681029 (+ 1077us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:52.681633 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:52.681639 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:52.682221 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:52.682573 (+ 352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:52.682586 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:52.684190 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:52.684196 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:52.685790 (+ 1594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:52.685803 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:52.687052 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:52.687059 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:52.687237 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:52.687814 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:52.687837 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:52.691957 (+ 4120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:52.695837 (+ 3880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:52.695843 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:52.695846 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:52.696302 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:52.696690 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:52.696696 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:52.696700 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:52.696872 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:52.697433 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:52.697438 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:52.697586 (+ 148us) client_negotiation.cc:769] Sending connection context
0811 18:47:52.697727 (+ 141us) client_negotiation.cc:240] Negotiation successful
0811 18:47:52.698036 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10945,"thread_start_us":10763,"threads_started":1}
I20260811 18:47:52.699478 6331 heartbeater.cc:347] Connected to a master server at 127.25.25.62:40987
I20260811 18:47:52.699609 6331 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:52.700033 6331 heartbeater.cc:511] Master 127.25.25.62:40987 requested a full tablet report, sending...
I20260811 18:47:52.701351 4488 ts_manager.cc:194] Re-registered known tserver with Master: a9e2fc3f8e914bac89172067877d3ba4 (127.25.25.1:34169)
I20260811 18:47:52.702454 4488 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.25.1@KRBTEST.COM'} at 127.25.25.1:46357
I20260811 18:47:52.791889 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 4885
I20260811 18:47:52.818750 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:45075
--local_ip_for_outbound_sockets=127.25.25.2
--tserver_master_addrs=127.25.25.62:40987
--webserver_port=43439
--webserver_interface=127.25.25.2
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.2.keytab
--principal=oryx/127.25.25.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:43463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.25.25.62:40987,127.25.25.61:40099
--tserver_master_addrs=127.25.25.62:40987,127.25.25.61:40099,127.25.25.60:37093 with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:47:52.974632 5927 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5e617b487cf2450fb23d1122274e75dc" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: NON_VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: true } } }
I20260811 18:47:52.975042 5927 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:52.976210 5927 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc: attempting to promote NON_VOTER 45bbe6823a8b4824bf97078170308744 to VOTER
I20260811 18:47:52.977025 5927 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: false } }
I20260811 18:47:52.979425 5674 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [term 1 FOLLOWER]: Refusing update from remote peer 5e617b487cf2450fb23d1122274e75dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260811 18:47:52.979480 6028 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [term 1 LEARNER]: Refusing update from remote peer 5e617b487cf2450fb23d1122274e75dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260811 18:47:52.980137 5927 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260811 18:47:52.980515 6354 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260811 18:47:52.983863 6355 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 45bbe6823a8b4824bf97078170308744 (127.25.25.60) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: false } } }
I20260811 18:47:52.984618 6028 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 45bbe6823a8b4824bf97078170308744 (127.25.25.60) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: false } } }
I20260811 18:47:52.986920 6355 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "5e617b487cf2450fb23d1122274e75dc" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: false } } }
I20260811 18:47:52.987205 6355 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:52.987458 6355 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5e617b487cf2450fb23d1122274e75dc" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: false } } }
I20260811 18:47:52.987515 6354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5e617b487cf2450fb23d1122274e75dc" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: false } } }
I20260811 18:47:52.987722 6355 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:52.987756 6354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:52.988503 5674 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 45bbe6823a8b4824bf97078170308744 (127.25.25.60) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: false } } }
I20260811 18:47:52.988912 6364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5e617b487cf2450fb23d1122274e75dc" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: false } } }
I20260811 18:47:52.989338 6364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:47:52.991876 6365 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5e617b487cf2450fb23d1122274e75dc" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: false } } }
I20260811 18:47:52.992311 6365 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 18:47:53.186388 6350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:53.186779 6350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:53.186932 6350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:53.194442 6350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:53.194576 6350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:53.194737 6350 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:47:53.209374 6350 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:43463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.2.keytab
--principal=oryx/127.25.25.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:45075
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=43439
--tserver_master_addrs=127.25.25.62:40987,127.25.25.61:40099,127.25.25.60:37093
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:53.211151 6350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:53.213325 6350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:53.228374 6374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:53.228440 6377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:53.228405 6375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:53.229044 6350 server_base.cc:1034] running on GCE node
I20260811 18:47:53.229736 6350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:53.230786 6350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:53.232002 6350 hybrid_clock.cc:648] HybridClock initialized: now 1786474073231942 us; error 52 us; skew 500 ppm
I20260811 18:47:53.232352 6350 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:53 dist-test-slave-lgr5 krb5kdc[4400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474073, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:53.235623 6350 init.cc:377] Logged in from keytab as oryx/127.25.25.2@KRBTEST.COM (short username oryx)
I20260811 18:47:53.237146 6350 webserver.cc:460] Webserver started at http://127.25.25.2:43439/ using document root <none> and password file <none>
I20260811 18:47:53.237973 6350 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:53.238122 6350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:53.244306 6350 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 18:47:53.247437 6391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:53.249001 6350 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:47:53.249168 6350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "282cb4f254b546dca9e2337ebb9be30b"
format_stamp: "Formatted at 2026-08-11 18:47:49 on dist-test-slave-lgr5"
server_key: "d17daa978db853a487e23f300560d416"
server_key_iv: "0a4a4b71fccad8d66c95d14af1e7d2a7"
server_key_version: "encryptionkey@0"
I20260811 18:47:53.250257 6350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:53.269979 6350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:53.274781 6350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:53.275100 6350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:53.276271 6350 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:47:53.277910 6350 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:53.278028 6350 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:53.278141 6350 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:53.278211 6350 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:53.311674 6350 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:45075
I20260811 18:47:53.311743 6594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:45075 every 8 connection(s)
I20260811 18:47:53.313294 6350 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:47:53.317544 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 6350
I20260811 18:47:53.317868 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 5129
Aug 11 18:47:53 dist-test-slave-lgr5 krb5kdc[4400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474068, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.25.3@KRBTEST.COM
I20260811 18:47:53.364750 6618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:53.318954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35356 (local address 127.25.25.3:35159)
0811 18:47:53.334338 (+ 15384us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:53.334351 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:53.337141 (+ 2790us) server_negotiation.cc:407] Connection header received
0811 18:47:53.337257 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:53.337269 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:53.337727 (+ 458us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:53.337901 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:53.341010 (+ 3109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:53.343019 (+ 2009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:53.345325 (+ 2306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:53.346461 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:53.346611 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:53.354119 (+ 7508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:53.354143 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:53.354165 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:53.354236 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:53.359174 (+ 4938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:53.360325 (+ 1151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:53.360336 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:53.360340 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:53.360555 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:53.361060 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:53.361066 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:53.361069 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:53.361574 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:53.361936 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:53.363895 (+ 1959us) server_negotiation.cc:299] Negotiation successful
0811 18:47:53.364280 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15123,"thread_start_us":15401,"threads_started":1}
I20260811 18:47:53.366566 5365 generic_service.cc:196] Checking for leaks (request via RPC)
Aug 11 18:47:53 dist-test-slave-lgr5 krb5kdc[4400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474073, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.61@KRBTEST.COM
Aug 11 18:47:53 dist-test-slave-lgr5 krb5kdc[4400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474073, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.60@KRBTEST.COM
I20260811 18:47:53.379259 6610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:53.316978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:40099 (local address 127.25.25.2:34541)
0811 18:47:53.349430 (+ 32452us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:53.349448 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:53.352288 (+ 2840us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:53.354017 (+ 1729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:53.354032 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:53.355087 (+ 1055us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:53.356133 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:53.356171 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:53.358084 (+ 1913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:53.358092 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:53.360508 (+ 2416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:53.360526 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:53.362068 (+ 1542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:53.362077 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:53.362471 (+ 394us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:53.363594 (+ 1123us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:53.363630 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:53.368368 (+ 4738us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:53.373162 (+ 4794us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:53.373175 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:53.373201 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:53.373990 (+ 789us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:53.374640 (+ 650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:53.374647 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:53.374651 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:53.374991 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:53.375971 (+ 980us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:53.375980 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:53.376556 (+ 576us) client_negotiation.cc:769] Sending connection context
0811 18:47:53.376974 (+ 418us) client_negotiation.cc:240] Negotiation successful
0811 18:47:53.377614 (+ 640us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31904,"mutex_wait_us":206,"thread_start_us":31351,"threads_started":1}
I20260811 18:47:53.380851 6609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:53.316268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:34541 (local address 127.25.25.61:40099)
0811 18:47:53.316747 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:53.316752 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:53.349531 (+ 32779us) server_negotiation.cc:407] Connection header received
0811 18:47:53.352818 (+ 3287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:53.352827 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:53.352961 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:53.353142 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:53.356533 (+ 3391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:53.357830 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:53.360719 (+ 2889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:53.361420 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:53.361541 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:53.368764 (+ 7223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:53.368785 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:53.368792 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:53.368860 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:53.372926 (+ 4066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:53.374194 (+ 1268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:53.374202 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:53.374206 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:53.374470 (+ 264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:53.375173 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:53.375180 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:53.375184 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:53.375657 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:53.375874 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:53.380126 (+ 4252us) server_negotiation.cc:299] Negotiation successful
0811 18:47:53.380398 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":236,"threads_started":1}
I20260811 18:47:53.384248 6600 heartbeater.cc:347] Connected to a master server at 127.25.25.61:40099
I20260811 18:47:53.384667 6600 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:53.385828 6600 heartbeater.cc:511] Master 127.25.25.61:40099 requested a full tablet report, sending...
I20260811 18:47:53.388136 5655 ts_manager.cc:194] Registered new tserver with Master: 282cb4f254b546dca9e2337ebb9be30b (127.25.25.2:45075)
I20260811 18:47:53.394119 6611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:53.316978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:37093 (local address 127.25.25.2:59701)
0811 18:47:53.349134 (+ 32156us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:53.349207 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:53.357605 (+ 8398us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:53.358722 (+ 1117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:53.358727 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:53.359476 (+ 749us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:53.359864 (+ 388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:53.359879 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:53.362887 (+ 3008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:53.362893 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:53.364610 (+ 1717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:53.364629 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:53.365921 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:53.365929 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:53.366129 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:53.366852 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:53.366883 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:53.371717 (+ 4834us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:53.390840 (+ 19123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:53.390846 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:53.390851 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:53.391475 (+ 624us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:53.392161 (+ 686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:53.392166 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:53.392170 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:53.392353 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:53.393037 (+ 684us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:53.393042 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:53.393219 (+ 177us) client_negotiation.cc:769] Sending connection context
0811 18:47:53.393356 (+ 137us) client_negotiation.cc:240] Negotiation successful
0811 18:47:53.393664 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31763,"thread_start_us":32603,"threads_started":1}
I20260811 18:47:53.395469 6614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:53.317408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:59701 (local address 127.25.25.60:37093)
0811 18:47:53.348471 (+ 31063us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:53.348476 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:53.349696 (+ 1220us) server_negotiation.cc:407] Connection header received
0811 18:47:53.357837 (+ 8141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:53.357843 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:53.357945 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:53.358292 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:53.360118 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:53.361298 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:53.365116 (+ 3818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:53.365677 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:53.365818 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:53.372047 (+ 6229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:53.372056 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:53.372062 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:53.372172 (+ 110us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:53.388490 (+ 16318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:53.391678 (+ 3188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:53.391684 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:53.391688 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:53.391995 (+ 307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:53.392496 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:53.392501 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:53.392505 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:53.392897 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:53.394654 (+ 1757us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:53.394782 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 18:47:53.395064 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30920,"thread_start_us":30741,"threads_started":1}
I20260811 18:47:53.396512 6595 heartbeater.cc:347] Connected to a master server at 127.25.25.60:37093
I20260811 18:47:53.396680 6595 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:53.397285 6595 heartbeater.cc:511] Master 127.25.25.60:37093 requested a full tablet report, sending...
I20260811 18:47:53.398598 6014 ts_manager.cc:194] Registered new tserver with Master: 282cb4f254b546dca9e2337ebb9be30b (127.25.25.2:45075)
Aug 11 18:47:53 dist-test-slave-lgr5 krb5kdc[4400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474073, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM
I20260811 18:47:53.410315 6610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:53.350248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.25.25.2:51331)
0811 18:47:53.381801 (+ 31553us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:53.381823 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:53.382031 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:53.382938 (+ 907us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:53.382945 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:53.389890 (+ 6945us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:53.390148 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:53.390166 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:53.392388 (+ 2222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:53.392394 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:53.394041 (+ 1647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:53.394058 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:53.395696 (+ 1638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:53.395703 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:53.396042 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:53.397072 (+ 1030us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:53.397104 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:53.400940 (+ 3836us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:53.406982 (+ 6042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:53.406987 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:53.406990 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:53.407682 (+ 692us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:53.408315 (+ 633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:53.408318 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:53.408321 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:53.408540 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:53.409249 (+ 709us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:53.409252 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:53.409471 (+ 219us) client_negotiation.cc:769] Sending connection context
0811 18:47:53.409629 (+ 158us) client_negotiation.cc:240] Negotiation successful
0811 18:47:53.409893 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31414,"thread_start_us":40238,"threads_started":1}
I20260811 18:47:53.410696 6621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:53.350382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:51331 (local address 127.25.25.62:40987)
0811 18:47:53.363372 (+ 12990us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:53.363379 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:53.381913 (+ 18534us) server_negotiation.cc:407] Connection header received
0811 18:47:53.382201 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:53.382208 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:53.382337 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:53.382624 (+ 287us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:53.390836 (+ 8212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:53.392150 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:53.394249 (+ 2099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:53.395276 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:53.395395 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:53.401232 (+ 5837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:53.401241 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:53.401247 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:53.401337 (+ 90us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:53.406764 (+ 5427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:53.407848 (+ 1084us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:53.407855 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:53.407860 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:53.408196 (+ 336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:53.408663 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:53.408669 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:53.408674 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:53.409141 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:53.409298 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:53.409838 (+ 540us) server_negotiation.cc:299] Negotiation successful
0811 18:47:53.410149 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12825,"thread_start_us":20380,"threads_started":1}
I20260811 18:47:53.411682 6599 heartbeater.cc:347] Connected to a master server at 127.25.25.62:40987
I20260811 18:47:53.411892 6599 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:53.412730 6599 heartbeater.cc:511] Master 127.25.25.62:40987 requested a full tablet report, sending...
I20260811 18:47:53.413933 4488 ts_manager.cc:194] Re-registered known tserver with Master: 282cb4f254b546dca9e2337ebb9be30b (127.25.25.2:45075)
I20260811 18:47:53.414759 4488 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.25.2@KRBTEST.COM'} at 127.25.25.2:51331
I20260811 18:47:53.480827 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 5129
I20260811 18:47:53.505635 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:35159
--local_ip_for_outbound_sockets=127.25.25.3
--tserver_master_addrs=127.25.25.62:40987
--webserver_port=36993
--webserver_interface=127.25.25.3
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.3.keytab
--principal=oryx/127.25.25.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:43463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.25.25.62:40987,127.25.25.61:40099
--tserver_master_addrs=127.25.25.62:40987,127.25.25.61:40099,127.25.25.60:37093 with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:47:53.705165 6331 heartbeater.cc:503] Master 127.25.25.62:40987 was elected leader, sending a full tablet report...
W20260811 18:47:53.871630 6624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:53.871954 6624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:53.872056 6624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:53.879751 6624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:53.879886 6624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:53.880048 6624 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:47:53.890688 6624 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:43463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.3.keytab
--principal=oryx/127.25.25.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:35159
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=36993
--tserver_master_addrs=127.25.25.62:40987,127.25.25.61:40099,127.25.25.60:37093
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:53.892364 6624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:53.893838 6624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:53.907667 6634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:53.907711 6639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:53.907902 6637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:53.908715 6624 server_base.cc:1034] running on GCE node
I20260811 18:47:53.909603 6624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:53.910686 6624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:53.911929 6624 hybrid_clock.cc:648] HybridClock initialized: now 1786474073911865 us; error 60 us; skew 500 ppm
I20260811 18:47:53.912312 6624 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:53 dist-test-slave-lgr5 krb5kdc[4400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474073, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:53.915784 6624 init.cc:377] Logged in from keytab as oryx/127.25.25.3@KRBTEST.COM (short username oryx)
I20260811 18:47:53.917546 6624 webserver.cc:460] Webserver started at http://127.25.25.3:36993/ using document root <none> and password file <none>
I20260811 18:47:53.918248 6624 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:53.918375 6624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:53.924443 6624 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 18:47:53.927433 6652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:53.928936 6624 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:47:53.929111 6624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "a00a8043b3324336862c99cc9d44eb01"
format_stamp: "Formatted at 2026-08-11 18:47:50 on dist-test-slave-lgr5"
server_key: "6f32e66a978af6e8cef64c3804790e24"
server_key_iv: "dcb0179b1029b18214060b3a300f4346"
server_key_version: "encryptionkey@0"
I20260811 18:47:53.930154 6624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:53.952323 6624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:53.957232 6624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:53.957535 6624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:53.958637 6624 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:47:53.960155 6624 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:53.960244 6624 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:53.960354 6624 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:53.960433 6624 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:53.998553 6624 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:35159
I20260811 18:47:53.998610 6839 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:35159 every 8 connection(s)
I20260811 18:47:54.000208 6624 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:47:54.002802 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 6624
Aug 11 18:47:54 dist-test-slave-lgr5 krb5kdc[4400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474073, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.61@KRBTEST.COM
Aug 11 18:47:54 dist-test-slave-lgr5 krb5kdc[4400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474073, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM
Aug 11 18:47:54 dist-test-slave-lgr5 krb5kdc[4400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474073, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.60@KRBTEST.COM
I20260811 18:47:54.065069 6846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:54.003985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:57741 (local address 127.25.25.61:40099)
0811 18:47:54.025667 (+ 21682us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:54.025675 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:54.025699 (+ 24us) server_negotiation.cc:407] Connection header received
0811 18:47:54.025770 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:54.025776 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:54.025883 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:54.026502 (+ 619us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:54.029150 (+ 2648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.030320 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.033213 (+ 2893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.033957 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.034091 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:54.048577 (+ 14486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:54.048588 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:54.048593 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:54.048650 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:54.057979 (+ 9329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:54.061675 (+ 3696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:54.061683 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:54.061688 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:54.062047 (+ 359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:54.062686 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:54.062693 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:54.062697 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:54.063186 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:54.063351 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:54.064302 (+ 951us) server_negotiation.cc:299] Negotiation successful
0811 18:47:54.064591 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21536,"thread_start_us":21398,"threads_started":1}
I20260811 18:47:54.066076 6852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:54.025010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:37093 (local address 127.25.25.3:40781)
0811 18:47:54.031928 (+ 6918us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:54.031953 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:54.032240 (+ 287us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:54.033080 (+ 840us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:54.033085 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:54.033729 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:54.034167 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:54.034181 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.035714 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.035718 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:54.037425 (+ 1707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:54.037443 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.038807 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.038814 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:54.039037 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:54.039854 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:54.039879 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:54.044206 (+ 4327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:54.058312 (+ 14106us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:54.058325 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:54.058348 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:54.059425 (+ 1077us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:54.060889 (+ 1464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:54.060895 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:54.060899 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:54.061344 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:54.062423 (+ 1079us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:54.062435 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:54.062970 (+ 535us) client_negotiation.cc:769] Sending connection context
0811 18:47:54.063430 (+ 460us) client_negotiation.cc:240] Negotiation successful
0811 18:47:54.064176 (+ 746us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6757,"mutex_wait_us":4,"thread_start_us":7309,"threads_started":1}
I20260811 18:47:54.067107 6848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:54.004631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:38445 (local address 127.25.25.62:40987)
0811 18:47:54.024258 (+ 19627us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:54.024265 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:54.024289 (+ 24us) server_negotiation.cc:407] Connection header received
0811 18:47:54.024366 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:54.024371 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:54.024481 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:54.024814 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:54.032369 (+ 7555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.033766 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.036206 (+ 2440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.036966 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.038029 (+ 1063us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:54.048528 (+ 10499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:54.048537 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:54.048542 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:54.048600 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:54.058353 (+ 9753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:54.064183 (+ 5830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:54.064189 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:54.064192 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:54.064418 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:54.064950 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:54.064955 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:54.064958 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:54.065434 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:54.066234 (+ 800us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:54.066387 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 18:47:54.066672 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19462,"thread_start_us":19297,"threads_started":1}
I20260811 18:47:54.067377 6850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:54.004385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.25.25.3:38445)
0811 18:47:54.020067 (+ 15682us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:54.020187 (+ 120us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:54.023345 (+ 3158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:54.026010 (+ 2665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:54.026026 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:54.028662 (+ 2636us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:54.029008 (+ 346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:54.029022 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.033993 (+ 4971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.033999 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:54.035883 (+ 1884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:54.035906 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.037253 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.037260 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:54.037529 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:54.038330 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:54.038356 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:54.042045 (+ 3689us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:54.060130 (+ 18085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:54.060137 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:54.060142 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:54.061019 (+ 877us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:54.064570 (+ 3551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:54.064574 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:54.064578 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:54.064763 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:54.065594 (+ 831us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:54.065599 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:54.065810 (+ 211us) client_negotiation.cc:769] Sending connection context
0811 18:47:54.065953 (+ 143us) client_negotiation.cc:240] Negotiation successful
0811 18:47:54.066286 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15243,"mutex_wait_us":27,"thread_start_us":19679,"threads_started":1}
I20260811 18:47:54.068192 6853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:54.025001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:40781 (local address 127.25.25.60:37093)
0811 18:47:54.027486 (+ 2485us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:54.027490 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:54.032198 (+ 4708us) server_negotiation.cc:407] Connection header received
0811 18:47:54.032639 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:54.032645 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:54.032738 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:54.032824 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:54.034368 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.035439 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.037610 (+ 2171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.038341 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.038450 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:54.044653 (+ 6203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:54.044664 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:54.044670 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:54.044724 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:54.054916 (+ 10192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:54.059651 (+ 4735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:54.059659 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:54.059663 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:54.059988 (+ 325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:54.061558 (+ 1570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:54.061565 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:54.061569 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:54.062146 (+ 577us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:54.062319 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:54.067310 (+ 4991us) server_negotiation.cc:299] Negotiation successful
0811 18:47:54.067645 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2378,"thread_start_us":2264,"threads_started":1}
I20260811 18:47:54.068629 6849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:54.004392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:40099 (local address 127.25.25.3:57741)
0811 18:47:54.024589 (+ 20197us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:54.024613 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:54.025010 (+ 397us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:54.026309 (+ 1299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:54.026315 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:54.027655 (+ 1340us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:54.028844 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:54.028881 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.030587 (+ 1706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.030593 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:54.033006 (+ 2413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:54.033023 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.034452 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.034461 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:54.034787 (+ 326us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:54.035850 (+ 1063us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:54.035887 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:54.045599 (+ 9712us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:54.060247 (+ 14648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:54.060253 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:54.060258 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:54.061487 (+ 1229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:54.062224 (+ 737us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:54.062231 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:54.062235 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:54.062498 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:54.063425 (+ 927us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:54.063430 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:54.063605 (+ 175us) client_negotiation.cc:769] Sending connection context
0811 18:47:54.063824 (+ 219us) client_negotiation.cc:240] Negotiation successful
0811 18:47:54.067596 (+ 3772us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20002,"mutex_wait_us":3438,"spinlock_wait_cycles":58752,"thread_start_us":14915,"threads_started":1}
I20260811 18:47:54.069676 6841 heartbeater.cc:347] Connected to a master server at 127.25.25.62:40987
I20260811 18:47:54.069902 6840 heartbeater.cc:347] Connected to a master server at 127.25.25.60:37093
I20260811 18:47:54.070026 6842 heartbeater.cc:347] Connected to a master server at 127.25.25.61:40099
I20260811 18:47:54.070144 6840 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:54.070147 6841 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:54.070266 6842 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:54.071887 6840 heartbeater.cc:511] Master 127.25.25.60:37093 requested a full tablet report, sending...
I20260811 18:47:54.072120 6841 heartbeater.cc:511] Master 127.25.25.62:40987 requested a full tablet report, sending...
I20260811 18:47:54.072490 6842 heartbeater.cc:511] Master 127.25.25.61:40099 requested a full tablet report, sending...
I20260811 18:47:54.074354 5655 ts_manager.cc:194] Registered new tserver with Master: a00a8043b3324336862c99cc9d44eb01 (127.25.25.3:35159)
I20260811 18:47:54.075528 6014 ts_manager.cc:194] Registered new tserver with Master: a00a8043b3324336862c99cc9d44eb01 (127.25.25.3:35159)
I20260811 18:47:54.077193 4488 ts_manager.cc:194] Re-registered known tserver with Master: a00a8043b3324336862c99cc9d44eb01 (127.25.25.3:35159)
I20260811 18:47:54.078702 4488 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.25.3@KRBTEST.COM'} at 127.25.25.3:38445
I20260811 18:47:54.097910 6861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:54.042437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36918 (local address 127.25.25.61:40099)
0811 18:47:54.065957 (+ 23520us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:54.065963 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:54.072210 (+ 6247us) server_negotiation.cc:407] Connection header received
0811 18:47:54.072290 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:54.072296 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:54.072403 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:54.072693 (+ 290us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:54.076875 (+ 4182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.078734 (+ 1859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.081651 (+ 2917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.082669 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.082758 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:54.088770 (+ 6012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:54.088790 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:54.088796 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:54.088855 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:54.093470 (+ 4615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:54.094625 (+ 1155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:54.094631 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:54.094633 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:54.094867 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:54.095471 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:54.095477 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:54.095481 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:54.095961 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:54.096335 (+ 374us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:54.096812 (+ 477us) server_negotiation.cc:299] Negotiation successful
0811 18:47:54.097108 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23386,"thread_start_us":23604,"threads_started":1}
I20260811 18:47:54.103533 6862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:54.042402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46902 (local address 127.25.25.62:40987)
0811 18:47:54.059845 (+ 17443us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:54.059852 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:54.078296 (+ 18444us) server_negotiation.cc:407] Connection header received
0811 18:47:54.078758 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:54.078765 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:54.078931 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:54.079027 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:54.085289 (+ 6262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.086570 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.089041 (+ 2471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.089937 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.090093 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:54.093999 (+ 3906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:54.094008 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:54.094012 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:54.094064 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:54.099223 (+ 5159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:54.100214 (+ 991us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:54.100219 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:54.100221 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:54.100571 (+ 350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:54.101118 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:54.101122 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:54.101124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:54.101757 (+ 633us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:54.102202 (+ 445us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:54.102573 (+ 371us) server_negotiation.cc:299] Negotiation successful
0811 18:47:54.102842 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17275,"thread_start_us":17449,"threads_started":1}
I20260811 18:47:54.107429 6853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:54.078057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39218 (local address 127.25.25.60:37093)
0811 18:47:54.078245 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:54.078251 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:54.085443 (+ 7192us) server_negotiation.cc:407] Connection header received
0811 18:47:54.085657 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:54.085665 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:54.085819 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:54.085946 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:54.089477 (+ 3531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.091008 (+ 1531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.093722 (+ 2714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.094370 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.094516 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:54.098971 (+ 4455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:54.098979 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:54.098982 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:54.099019 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:54.103437 (+ 4418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:54.104570 (+ 1133us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:54.104577 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:54.104582 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:54.104841 (+ 259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:54.105426 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:54.105431 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:54.105433 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:54.105833 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:54.106114 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:54.106733 (+ 619us) server_negotiation.cc:299] Negotiation successful
0811 18:47:54.107036 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 18:47:54.109294 4488 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46902:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:47:54.121176 4488 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:47:54.167083 6887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:54.150743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44900 (local address 127.25.25.2:45075)
0811 18:47:54.151754 (+ 1011us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:54.151764 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:54.152902 (+ 1138us) server_negotiation.cc:407] Connection header received
0811 18:47:54.153466 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:54.153477 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:54.153895 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:54.154400 (+ 505us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:54.158029 (+ 3629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.159875 (+ 1846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.163472 (+ 3597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.165402 (+ 1930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.165563 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:54.165821 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:54.166340 (+ 519us) server_negotiation.cc:299] Negotiation successful
0811 18:47:54.166577 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":863,"thread_start_us":669,"threads_started":1}
I20260811 18:47:54.167209 6886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:54.150048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:45075 (local address 127.0.0.1:44900)
0811 18:47:54.152713 (+ 2665us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:54.152736 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:54.152940 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:54.156469 (+ 3529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:54.156476 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:54.156513 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:54.157390 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:54.157407 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.160128 (+ 2721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.160134 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:54.163219 (+ 3085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:54.163240 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.165756 (+ 2516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.165766 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:54.166097 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:54.166137 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 18:47:54.166228 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 18:47:54.166382 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2456,"mutex_wait_us":104,"thread_start_us":3322,"threads_started":1}
I20260811 18:47:54.170857 6894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:54.154900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34294 (local address 127.25.25.1:34169)
0811 18:47:54.156667 (+ 1767us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:54.156676 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:54.159498 (+ 2822us) server_negotiation.cc:407] Connection header received
0811 18:47:54.159668 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:54.159677 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:54.159982 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:54.160360 (+ 378us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:54.161869 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.163714 (+ 1845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.167349 (+ 3635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.169337 (+ 1988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.169430 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:54.169654 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:54.170378 (+ 724us) server_negotiation.cc:299] Negotiation successful
0811 18:47:54.170570 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1417,"thread_start_us":1258,"threads_started":1}
I20260811 18:47:54.170888 6889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:54.153311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:35159 (local address 127.0.0.1:35358)
0811 18:47:54.154701 (+ 1390us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:54.154748 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:54.154958 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:54.157292 (+ 2334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:54.157297 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:54.157334 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:54.158686 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:54.158707 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.161519 (+ 2812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.161525 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:54.164743 (+ 3218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:54.164764 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.167839 (+ 3075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.167846 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:54.168040 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:54.168067 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 18:47:54.168200 (+ 133us) client_negotiation.cc:240] Negotiation successful
0811 18:47:54.168357 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1134,"mutex_wait_us":2,"thread_start_us":878,"threads_started":1}
I20260811 18:47:54.171032 6891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:54.154557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:34169 (local address 127.0.0.1:34294)
0811 18:47:54.159166 (+ 4609us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:54.159188 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:54.159347 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:54.160313 (+ 966us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:54.160317 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:54.160345 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:54.161600 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:54.161618 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.163925 (+ 2307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.163932 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:54.167116 (+ 3184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:54.167137 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.169939 (+ 2802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.169944 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:54.170158 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:54.170184 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 18:47:54.170276 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 18:47:54.170423 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4388,"thread_start_us":3818,"threads_started":1}
I20260811 18:47:54.172607 6462 tablet_service.cc:1467] Processing CreateTablet for tablet a500532b5aa54c5a81d08e08de880963 (DEFAULT_TABLE table=test-table [id=f29a74a72c9043a289b6e714c5acb814]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:54.174243 6462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a500532b5aa54c5a81d08e08de880963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:54.175076 6201 tablet_service.cc:1467] Processing CreateTablet for tablet a500532b5aa54c5a81d08e08de880963 (DEFAULT_TABLE table=test-table [id=f29a74a72c9043a289b6e714c5acb814]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:54.176827 6201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a500532b5aa54c5a81d08e08de880963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:54.180518 6890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:54.153563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35358 (local address 127.25.25.3:35159)
0811 18:47:54.156223 (+ 2660us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:54.156231 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:54.156293 (+ 62us) server_negotiation.cc:407] Connection header received
0811 18:47:54.156415 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:54.156424 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:54.156895 (+ 471us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:54.157292 (+ 397us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:54.159108 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.161365 (+ 2257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.164980 (+ 3615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.167136 (+ 2156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.167284 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:54.167550 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:54.168279 (+ 729us) server_negotiation.cc:299] Negotiation successful
0811 18:47:54.168548 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2384,"thread_start_us":1903,"threads_started":1}
I20260811 18:47:54.185791 6732 tablet_service.cc:1467] Processing CreateTablet for tablet a500532b5aa54c5a81d08e08de880963 (DEFAULT_TABLE table=test-table [id=f29a74a72c9043a289b6e714c5acb814]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:54.187536 6732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a500532b5aa54c5a81d08e08de880963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:54.195936 6895 tablet_bootstrap.cc:492] T a500532b5aa54c5a81d08e08de880963 P 282cb4f254b546dca9e2337ebb9be30b: Bootstrap starting.
I20260811 18:47:54.202272 6895 tablet_bootstrap.cc:654] T a500532b5aa54c5a81d08e08de880963 P 282cb4f254b546dca9e2337ebb9be30b: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:54.207026 6895 log.cc:824] T a500532b5aa54c5a81d08e08de880963 P 282cb4f254b546dca9e2337ebb9be30b: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:54.209574 6896 tablet_bootstrap.cc:492] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4: Bootstrap starting.
I20260811 18:47:54.213011 6900 tablet_bootstrap.cc:492] T a500532b5aa54c5a81d08e08de880963 P a00a8043b3324336862c99cc9d44eb01: Bootstrap starting.
I20260811 18:47:54.216820 6896 tablet_bootstrap.cc:654] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:54.218899 6900 tablet_bootstrap.cc:654] T a500532b5aa54c5a81d08e08de880963 P a00a8043b3324336862c99cc9d44eb01: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:54.219300 6896 log.cc:824] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:54.222409 6900 log.cc:824] T a500532b5aa54c5a81d08e08de880963 P a00a8043b3324336862c99cc9d44eb01: Log is configured to *not* fsync() on all Append() calls
I20260811 18:47:54.223963 6895 tablet_bootstrap.cc:492] T a500532b5aa54c5a81d08e08de880963 P 282cb4f254b546dca9e2337ebb9be30b: No bootstrap required, opened a new log
I20260811 18:47:54.224380 6896 tablet_bootstrap.cc:492] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4: No bootstrap required, opened a new log
I20260811 18:47:54.224409 6895 ts_tablet_manager.cc:1397] T a500532b5aa54c5a81d08e08de880963 P 282cb4f254b546dca9e2337ebb9be30b: Time spent bootstrapping tablet: real 0.029s user 0.011s sys 0.012s
I20260811 18:47:54.224798 6896 ts_tablet_manager.cc:1397] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.012s
I20260811 18:47:54.227118 6900 tablet_bootstrap.cc:492] T a500532b5aa54c5a81d08e08de880963 P a00a8043b3324336862c99cc9d44eb01: No bootstrap required, opened a new log
I20260811 18:47:54.227627 6900 ts_tablet_manager.cc:1397] T a500532b5aa54c5a81d08e08de880963 P a00a8043b3324336862c99cc9d44eb01: Time spent bootstrapping tablet: real 0.016s user 0.011s sys 0.000s
I20260811 18:47:54.236400 6895 raft_consensus.cc:348] T a500532b5aa54c5a81d08e08de880963 P 282cb4f254b546dca9e2337ebb9be30b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "282cb4f254b546dca9e2337ebb9be30b" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45075 } } peers { permanent_uuid: "a00a8043b3324336862c99cc9d44eb01" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35159 } } peers { permanent_uuid: "a9e2fc3f8e914bac89172067877d3ba4" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34169 } }
I20260811 18:47:54.237177 6895 raft_consensus.cc:374] T a500532b5aa54c5a81d08e08de880963 P 282cb4f254b546dca9e2337ebb9be30b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:54.237304 6895 raft_consensus.cc:729] T a500532b5aa54c5a81d08e08de880963 P 282cb4f254b546dca9e2337ebb9be30b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 282cb4f254b546dca9e2337ebb9be30b, State: Initialized, Role: FOLLOWER
I20260811 18:47:54.238132 6895 consensus_queue.cc:260] T a500532b5aa54c5a81d08e08de880963 P 282cb4f254b546dca9e2337ebb9be30b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "282cb4f254b546dca9e2337ebb9be30b" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45075 } } peers { permanent_uuid: "a00a8043b3324336862c99cc9d44eb01" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35159 } } peers { permanent_uuid: "a9e2fc3f8e914bac89172067877d3ba4" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34169 } }
I20260811 18:47:54.240962 6895 ts_tablet_manager.cc:1428] T a500532b5aa54c5a81d08e08de880963 P 282cb4f254b546dca9e2337ebb9be30b: Time spent starting tablet: real 0.016s user 0.010s sys 0.006s
I20260811 18:47:54.241380 6599 heartbeater.cc:503] Master 127.25.25.62:40987 was elected leader, sending a full tablet report...
I20260811 18:47:54.241197 6896 raft_consensus.cc:348] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "282cb4f254b546dca9e2337ebb9be30b" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45075 } } peers { permanent_uuid: "a00a8043b3324336862c99cc9d44eb01" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35159 } } peers { permanent_uuid: "a9e2fc3f8e914bac89172067877d3ba4" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34169 } }
I20260811 18:47:54.241874 6896 raft_consensus.cc:374] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:54.242100 6896 raft_consensus.cc:729] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9e2fc3f8e914bac89172067877d3ba4, State: Initialized, Role: FOLLOWER
I20260811 18:47:54.243111 6896 consensus_queue.cc:260] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "282cb4f254b546dca9e2337ebb9be30b" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45075 } } peers { permanent_uuid: "a00a8043b3324336862c99cc9d44eb01" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35159 } } peers { permanent_uuid: "a9e2fc3f8e914bac89172067877d3ba4" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34169 } }
I20260811 18:47:54.245319 6900 raft_consensus.cc:348] T a500532b5aa54c5a81d08e08de880963 P a00a8043b3324336862c99cc9d44eb01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "282cb4f254b546dca9e2337ebb9be30b" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45075 } } peers { permanent_uuid: "a00a8043b3324336862c99cc9d44eb01" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35159 } } peers { permanent_uuid: "a9e2fc3f8e914bac89172067877d3ba4" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34169 } }
I20260811 18:47:54.246142 6900 raft_consensus.cc:374] T a500532b5aa54c5a81d08e08de880963 P a00a8043b3324336862c99cc9d44eb01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:54.246344 6900 raft_consensus.cc:729] T a500532b5aa54c5a81d08e08de880963 P a00a8043b3324336862c99cc9d44eb01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a00a8043b3324336862c99cc9d44eb01, State: Initialized, Role: FOLLOWER
I20260811 18:47:54.247506 6900 consensus_queue.cc:260] T a500532b5aa54c5a81d08e08de880963 P a00a8043b3324336862c99cc9d44eb01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "282cb4f254b546dca9e2337ebb9be30b" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45075 } } peers { permanent_uuid: "a00a8043b3324336862c99cc9d44eb01" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35159 } } peers { permanent_uuid: "a9e2fc3f8e914bac89172067877d3ba4" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34169 } }
I20260811 18:47:54.249547 6896 ts_tablet_manager.cc:1428] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4: Time spent starting tablet: real 0.025s user 0.018s sys 0.006s
I20260811 18:47:54.255666 6900 ts_tablet_manager.cc:1428] T a500532b5aa54c5a81d08e08de880963 P a00a8043b3324336862c99cc9d44eb01: Time spent starting tablet: real 0.028s user 0.023s sys 0.004s
I20260811 18:47:54.256235 6841 heartbeater.cc:503] Master 127.25.25.62:40987 was elected leader, sending a full tablet report...
W20260811 18:47:54.317503 6608 tablet.cc:2369] T a500532b5aa54c5a81d08e08de880963 P 282cb4f254b546dca9e2337ebb9be30b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:47:54.351806 6905 raft_consensus.cc:482] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:47:54.352345 6905 raft_consensus.cc:504] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "282cb4f254b546dca9e2337ebb9be30b" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45075 } } peers { permanent_uuid: "a00a8043b3324336862c99cc9d44eb01" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35159 } } peers { permanent_uuid: "a9e2fc3f8e914bac89172067877d3ba4" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34169 } }
I20260811 18:47:54.354755 6905 leader_election.cc:288] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 282cb4f254b546dca9e2337ebb9be30b (127.25.25.2:45075), a00a8043b3324336862c99cc9d44eb01 (127.25.25.3:35159)
I20260811 18:47:54.364329 6887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:54.355105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:47645 (local address 127.25.25.2:45075)
0811 18:47:54.355360 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:54.355367 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:54.356527 (+ 1160us) server_negotiation.cc:407] Connection header received
0811 18:47:54.356778 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:54.356783 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:54.356848 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:54.356943 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:54.358091 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.359032 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.361943 (+ 2911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.363098 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.363225 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:54.363436 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:54.363826 (+ 390us) server_negotiation.cc:299] Negotiation successful
0811 18:47:54.363971 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 18:47:54.364601 6907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:54.354958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:45075 (local address 127.25.25.1:47645)
0811 18:47:54.356244 (+ 1286us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:54.356263 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:54.356599 (+ 336us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:54.357009 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:54.357015 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:54.357043 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:54.357929 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:54.357943 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.359211 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.359215 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:54.361720 (+ 2505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:54.361738 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.363440 (+ 1702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.363448 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:54.363644 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:54.363673 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 18:47:54.363765 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 18:47:54.363922 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1071,"thread_start_us":692,"threads_started":1}
I20260811 18:47:54.365666 6890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:54.355314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:36471 (local address 127.25.25.3:35159)
0811 18:47:54.355566 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:54.355571 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:54.357999 (+ 2428us) server_negotiation.cc:407] Connection header received
0811 18:47:54.358202 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:54.358207 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:54.358283 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:54.358362 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:54.359338 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.360499 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.363003 (+ 2504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.364340 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.364814 (+ 474us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:54.364925 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:54.365322 (+ 397us) server_negotiation.cc:299] Negotiation successful
0811 18:47:54.365446 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 18:47:54.365751 6909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:54.355600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:35159 (local address 127.25.25.1:36471)
0811 18:47:54.357764 (+ 2164us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:54.357782 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:54.358059 (+ 277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:54.358393 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:54.358397 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:54.358421 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:54.359094 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:54.359106 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.360667 (+ 1561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.360671 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:54.362804 (+ 2133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:54.362819 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.364746 (+ 1927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.364933 (+ 187us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:54.365148 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:54.365175 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 18:47:54.365265 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 18:47:54.365407 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1916,"thread_start_us":1391,"threads_started":1}
I20260811 18:47:54.366102 6503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a500532b5aa54c5a81d08e08de880963" candidate_uuid: "a9e2fc3f8e914bac89172067877d3ba4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "282cb4f254b546dca9e2337ebb9be30b" is_pre_election: true
I20260811 18:47:54.366884 6503 raft_consensus.cc:2454] T a500532b5aa54c5a81d08e08de880963 P 282cb4f254b546dca9e2337ebb9be30b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9e2fc3f8e914bac89172067877d3ba4 in term 0.
I20260811 18:47:54.367307 6764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a500532b5aa54c5a81d08e08de880963" candidate_uuid: "a9e2fc3f8e914bac89172067877d3ba4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a00a8043b3324336862c99cc9d44eb01" is_pre_election: true
I20260811 18:47:54.367873 6127 leader_election.cc:302] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 282cb4f254b546dca9e2337ebb9be30b, a9e2fc3f8e914bac89172067877d3ba4; no voters:
I20260811 18:47:54.368265 6764 raft_consensus.cc:2454] T a500532b5aa54c5a81d08e08de880963 P a00a8043b3324336862c99cc9d44eb01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9e2fc3f8e914bac89172067877d3ba4 in term 0.
I20260811 18:47:54.368486 6905 raft_consensus.cc:2781] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:47:54.368741 6905 raft_consensus.cc:482] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:47:54.368937 6905 raft_consensus.cc:3037] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:54.372779 6905 raft_consensus.cc:504] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "282cb4f254b546dca9e2337ebb9be30b" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45075 } } peers { permanent_uuid: "a00a8043b3324336862c99cc9d44eb01" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35159 } } peers { permanent_uuid: "a9e2fc3f8e914bac89172067877d3ba4" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34169 } }
I20260811 18:47:54.373893 6905 leader_election.cc:288] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4 [CANDIDATE]: Term 1 election: Requested vote from peers 282cb4f254b546dca9e2337ebb9be30b (127.25.25.2:45075), a00a8043b3324336862c99cc9d44eb01 (127.25.25.3:35159)
I20260811 18:47:54.374652 6764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a500532b5aa54c5a81d08e08de880963" candidate_uuid: "a9e2fc3f8e914bac89172067877d3ba4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a00a8043b3324336862c99cc9d44eb01"
I20260811 18:47:54.374678 6503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a500532b5aa54c5a81d08e08de880963" candidate_uuid: "a9e2fc3f8e914bac89172067877d3ba4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "282cb4f254b546dca9e2337ebb9be30b"
I20260811 18:47:54.374951 6764 raft_consensus.cc:3037] T a500532b5aa54c5a81d08e08de880963 P a00a8043b3324336862c99cc9d44eb01 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:54.375049 6503 raft_consensus.cc:3037] T a500532b5aa54c5a81d08e08de880963 P 282cb4f254b546dca9e2337ebb9be30b [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:54.378624 6764 raft_consensus.cc:2454] T a500532b5aa54c5a81d08e08de880963 P a00a8043b3324336862c99cc9d44eb01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9e2fc3f8e914bac89172067877d3ba4 in term 1.
I20260811 18:47:54.379252 6128 leader_election.cc:302] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a00a8043b3324336862c99cc9d44eb01, a9e2fc3f8e914bac89172067877d3ba4; no voters:
I20260811 18:47:54.379654 6905 raft_consensus.cc:2781] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:54.379742 6503 raft_consensus.cc:2454] T a500532b5aa54c5a81d08e08de880963 P 282cb4f254b546dca9e2337ebb9be30b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9e2fc3f8e914bac89172067877d3ba4 in term 1.
I20260811 18:47:54.384832 6905 raft_consensus.cc:686] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4 [term 1 LEADER]: Becoming Leader. State: Replica: a9e2fc3f8e914bac89172067877d3ba4, State: Running, Role: LEADER
I20260811 18:47:54.385704 6905 consensus_queue.cc:237] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "282cb4f254b546dca9e2337ebb9be30b" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45075 } } peers { permanent_uuid: "a00a8043b3324336862c99cc9d44eb01" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35159 } } peers { permanent_uuid: "a9e2fc3f8e914bac89172067877d3ba4" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34169 } }
I20260811 18:47:54.394645 4488 catalog_manager.cc:5495] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9e2fc3f8e914bac89172067877d3ba4 (127.25.25.1). New cstate: current_term: 1 leader_uuid: "a9e2fc3f8e914bac89172067877d3ba4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "282cb4f254b546dca9e2337ebb9be30b" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a00a8043b3324336862c99cc9d44eb01" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9e2fc3f8e914bac89172067877d3ba4" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34169 } health_report { overall_health: HEALTHY } } }
W20260811 18:47:54.401678 6335 tablet.cc:2369] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:47:54.469580 6894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:54.463707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34310 (local address 127.25.25.1:34169)
0811 18:47:54.463996 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:54.464001 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:54.464021 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:47:54.464167 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:54.464172 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:54.464264 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:54.464412 (+ 148us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:47:54.464753 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.465778 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.467182 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.467623 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.467720 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:54.468284 (+ 564us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:47:54.468863 (+ 579us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:47:54.468982 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:54.469149 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 18:47:54.469237 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 18:47:54.479295 6764 raft_consensus.cc:1261] T a500532b5aa54c5a81d08e08de880963 P a00a8043b3324336862c99cc9d44eb01 [term 1 FOLLOWER]: Refusing update from remote peer a9e2fc3f8e914bac89172067877d3ba4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:47:54.479293 6503 raft_consensus.cc:1261] T a500532b5aa54c5a81d08e08de880963 P 282cb4f254b546dca9e2337ebb9be30b [term 1 FOLLOWER]: Refusing update from remote peer a9e2fc3f8e914bac89172067877d3ba4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:47:54.480542 6905 consensus_queue.cc:1035] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "282cb4f254b546dca9e2337ebb9be30b" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:47:54.480933 6910 consensus_queue.cc:1035] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a00a8043b3324336862c99cc9d44eb01" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:47:54.526093 4487 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46902:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:47:54.526433 4487 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46902:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:47:54.533975 4487 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5e617b487cf2450fb23d1122274e75dc: Sending DeleteTablet for 3 replicas of tablet a500532b5aa54c5a81d08e08de880963
I20260811 18:47:54.536073 6732 tablet_service.cc:1514] Processing DeleteTablet for tablet a500532b5aa54c5a81d08e08de880963 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:54 UTC) from {username='oryx', principal='oryx/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:35358
I20260811 18:47:54.537106 6462 tablet_service.cc:1514] Processing DeleteTablet for tablet a500532b5aa54c5a81d08e08de880963 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:54 UTC) from {username='oryx', principal='oryx/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:44900
I20260811 18:47:54.538866 6201 tablet_service.cc:1514] Processing DeleteTablet for tablet a500532b5aa54c5a81d08e08de880963 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:54 UTC) from {username='oryx', principal='oryx/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:34294
I20260811 18:47:54.547894 6944 tablet_replica.cc:330] T a500532b5aa54c5a81d08e08de880963 P 282cb4f254b546dca9e2337ebb9be30b: stopping tablet replica
I20260811 18:47:54.548623 6944 raft_consensus.cc:2229] T a500532b5aa54c5a81d08e08de880963 P 282cb4f254b546dca9e2337ebb9be30b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:47:54.549484 6944 raft_consensus.cc:2258] T a500532b5aa54c5a81d08e08de880963 P 282cb4f254b546dca9e2337ebb9be30b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:54.552870 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 4423
I20260811 18:47:54.552706 6948 tablet_replica.cc:330] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4: stopping tablet replica
I20260811 18:47:54.553424 6948 raft_consensus.cc:2229] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:47:54.554390 6948 raft_consensus.cc:2258] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:54.557252 4552 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:54.557431 6948 ts_tablet_manager.cc:1905] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:54.553645 6943 tablet_replica.cc:330] T a500532b5aa54c5a81d08e08de880963 P a00a8043b3324336862c99cc9d44eb01: stopping tablet replica
I20260811 18:47:54.559219 6944 ts_tablet_manager.cc:1905] T a500532b5aa54c5a81d08e08de880963 P 282cb4f254b546dca9e2337ebb9be30b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:54.559160 6943 raft_consensus.cc:2229] T a500532b5aa54c5a81d08e08de880963 P a00a8043b3324336862c99cc9d44eb01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:47:54.560165 6943 raft_consensus.cc:2258] T a500532b5aa54c5a81d08e08de880963 P a00a8043b3324336862c99cc9d44eb01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:54.563485 6943 ts_tablet_manager.cc:1905] T a500532b5aa54c5a81d08e08de880963 P a00a8043b3324336862c99cc9d44eb01: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:54.568979 6944 ts_tablet_manager.cc:1918] T a500532b5aa54c5a81d08e08de880963 P 282cb4f254b546dca9e2337ebb9be30b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:47:54.569407 6944 log.cc:1196] T a500532b5aa54c5a81d08e08de880963 P 282cb4f254b546dca9e2337ebb9be30b: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/wal/wals/a500532b5aa54c5a81d08e08de880963
I20260811 18:47:54.570372 6944 ts_tablet_manager.cc:1939] T a500532b5aa54c5a81d08e08de880963 P 282cb4f254b546dca9e2337ebb9be30b: Deleting consensus metadata
I20260811 18:47:54.571382 6948 ts_tablet_manager.cc:1918] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:47:54.571622 6948 log.cc:1196] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/wal/wals/a500532b5aa54c5a81d08e08de880963
I20260811 18:47:54.574127 6948 ts_tablet_manager.cc:1939] T a500532b5aa54c5a81d08e08de880963 P a9e2fc3f8e914bac89172067877d3ba4: Deleting consensus metadata
I20260811 18:47:54.580727 6943 ts_tablet_manager.cc:1918] T a500532b5aa54c5a81d08e08de880963 P a00a8043b3324336862c99cc9d44eb01: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:47:54.581045 6943 log.cc:1196] T a500532b5aa54c5a81d08e08de880963 P a00a8043b3324336862c99cc9d44eb01: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/wal/wals/a500532b5aa54c5a81d08e08de880963
I20260811 18:47:54.581956 6943 ts_tablet_manager.cc:1939] T a500532b5aa54c5a81d08e08de880963 P a00a8043b3324336862c99cc9d44eb01: Deleting consensus metadata
I20260811 18:47:54.588792 6861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:54.537818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36926 (local address 127.25.25.61:40099)
0811 18:47:54.538035 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:54.538041 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:54.551128 (+ 13087us) server_negotiation.cc:407] Connection header received
0811 18:47:54.551488 (+ 360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:54.551495 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:54.551593 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:54.551721 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:54.566702 (+ 14981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.568361 (+ 1659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.571347 (+ 2986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.572172 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.572285 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:54.578205 (+ 5920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:54.578213 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:54.578218 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:54.578272 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:54.583545 (+ 5273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:54.584945 (+ 1400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:54.584952 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:54.584956 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:54.585238 (+ 282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:54.585984 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:54.585992 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:54.585996 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:54.586560 (+ 564us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:54.586967 (+ 407us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:54.587816 (+ 849us) server_negotiation.cc:299] Negotiation successful
0811 18:47:54.588183 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 18:47:54.611207 6853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:54.551081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39230 (local address 127.25.25.60:37093)
0811 18:47:54.551322 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:54.551328 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:54.590331 (+ 39003us) server_negotiation.cc:407] Connection header received
0811 18:47:54.590598 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:54.590604 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:54.590689 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:54.590758 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:54.593192 (+ 2434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.594626 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.596658 (+ 2032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.597659 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.597826 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:54.602120 (+ 4294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:54.602128 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:54.602134 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:54.602186 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:54.607349 (+ 5163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:54.608473 (+ 1124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:54.608480 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:54.608484 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:54.608718 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:54.609203 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:54.609208 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:54.609212 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:54.609741 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:54.610238 (+ 497us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:54.610414 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 18:47:54.610676 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 18:47:54.713847 4456 catalog_manager.cc:4841] TS 282cb4f254b546dca9e2337ebb9be30b (127.25.25.2:45075): tablet a500532b5aa54c5a81d08e08de880963 (table test-table [id=f29a74a72c9043a289b6e714c5acb814]) successfully deleted
I20260811 18:47:54.714964 4457 catalog_manager.cc:4841] TS a00a8043b3324336862c99cc9d44eb01 (127.25.25.3:35159): tablet a500532b5aa54c5a81d08e08de880963 (table test-table [id=f29a74a72c9043a289b6e714c5acb814]) successfully deleted
I20260811 18:47:54.715240 4457 catalog_manager.cc:4841] TS a9e2fc3f8e914bac89172067877d3ba4 (127.25.25.1:34169): tablet a500532b5aa54c5a81d08e08de880963 (table test-table [id=f29a74a72c9043a289b6e714c5acb814]) successfully deleted
I20260811 18:47:54.724390 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 4423
I20260811 18:47:54.783519 6861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:54.765649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36942 (local address 127.25.25.61:40099)
0811 18:47:54.765875 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:54.765896 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:54.767078 (+ 1182us) server_negotiation.cc:407] Connection header received
0811 18:47:54.768102 (+ 1024us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:54.768108 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:54.768188 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:54.768285 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:54.770536 (+ 2251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.771521 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.772989 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.773527 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.773648 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:54.776657 (+ 3009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:54.776663 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:54.776666 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:54.776704 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:54.780054 (+ 3350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:54.781045 (+ 991us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:54.781051 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:54.781055 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:54.781222 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:54.781777 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:54.781781 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:54.781783 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:54.782159 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:54.782447 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:54.782866 (+ 419us) server_negotiation.cc:299] Negotiation successful
0811 18:47:54.783135 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 18:47:54.784608 6853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:54.766840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39240 (local address 127.25.25.60:37093)
0811 18:47:54.767077 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:54.767083 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:54.767685 (+ 602us) server_negotiation.cc:407] Connection header received
0811 18:47:54.768013 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:54.768020 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:54.768270 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:54.768355 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:54.770053 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.771083 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.773175 (+ 2092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:54.773889 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:54.774005 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:54.777531 (+ 3526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:54.777538 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:54.777543 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:54.777588 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:54.781164 (+ 3576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:54.782058 (+ 894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:54.782065 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:54.782068 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:54.782269 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:54.782698 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:54.782704 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:54.782706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:54.783128 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:54.783366 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:54.783965 (+ 599us) server_negotiation.cc:299] Negotiation successful
0811 18:47:54.784263 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 18:47:55.506470 6968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:55.505531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.25.25.3:43177)
0811 18:47:55.506043 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:55.506217 (+ 174us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":236,"threads_started":1}
W20260811 18:47:55.507189 6841 heartbeater.cc:644] Failed to heartbeat to 127.25.25.62:40987 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
I20260811 18:47:55.517853 6969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:55.516156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.25.25.2:41695)
0811 18:47:55.516790 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:55.516954 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":280,"threads_started":1}
W20260811 18:47:55.518308 6599 heartbeater.cc:644] Failed to heartbeat to 127.25.25.62:40987 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
I20260811 18:47:55.518687 6970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:55.517626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.25.25.1:52787)
0811 18:47:55.518341 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:55.518495 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":616,"thread_start_us":274,"threads_started":1}
W20260811 18:47:55.519151 6331 heartbeater.cc:644] Failed to heartbeat to 127.25.25.62:40987 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
I20260811 18:47:56.035606 6971 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e617b487cf2450fb23d1122274e75dc)
I20260811 18:47:56.035925 6973 raft_consensus.cc:482] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e617b487cf2450fb23d1122274e75dc)
I20260811 18:47:56.035866 6971 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: false } }
I20260811 18:47:56.036150 6973 raft_consensus.cc:504] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: false } }
I20260811 18:47:56.036849 6971 leader_election.cc:288] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e617b487cf2450fb23d1122274e75dc (127.25.25.62:40987), ffc129de04a54bfe8a890bc558cda5d0 (127.25.25.61:40099)
I20260811 18:47:56.036990 6973 leader_election.cc:288] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e617b487cf2450fb23d1122274e75dc (127.25.25.62:40987), 45bbe6823a8b4824bf97078170308744 (127.25.25.60:37093)
I20260811 18:47:56.038266 6977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.036993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.0.0.1:47358)
0811 18:47:56.037680 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.037930 (+ 250us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":329,"threads_started":1}
W20260811 18:47:56.038623 5988 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
I20260811 18:47:56.039065 6980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.037310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.0.0.1:47374)
0811 18:47:56.038638 (+ 1328us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.038831 (+ 193us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1229,"thread_start_us":1184,"threads_started":1}
W20260811 18:47:56.041081 5631 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
I20260811 18:47:56.042241 6977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.041764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.0.0.1:47378)
0811 18:47:56.041974 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.042060 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
W20260811 18:47:56.042565 5988 leader_election.cc:334] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5e617b487cf2450fb23d1122274e75dc (127.25.25.62:40987): Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
I20260811 18:47:56.044454 6982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.043786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.0.0.1:47386)
0811 18:47:56.044001 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.044213 (+ 212us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260811 18:47:56.045259 5631 leader_election.cc:334] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5e617b487cf2450fb23d1122274e75dc (127.25.25.62:40987): Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
I20260811 18:47:56.046738 6979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.037100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:40099 (local address 127.0.0.1:36954)
0811 18:47:56.037992 (+ 892us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.038020 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:56.038181 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:56.039398 (+ 1217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:56.039403 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:56.039445 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:56.039831 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:56.039845 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.042319 (+ 2474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.042324 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:56.044350 (+ 2026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:56.044367 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.045971 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.045976 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:56.046156 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:56.046188 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 18:47:56.046263 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 18:47:56.046367 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":735,"mutex_wait_us":30,"thread_start_us":590,"threads_started":1}
I20260811 18:47:56.046814 6981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.037459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36954 (local address 127.25.25.61:40099)
0811 18:47:56.039090 (+ 1631us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:56.039096 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:56.039116 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:47:56.039188 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:56.039192 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:56.039267 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:56.039375 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:56.040022 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.042134 (+ 2112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.044512 (+ 2378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.045789 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.045936 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:56.046036 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:56.046315 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 18:47:56.046456 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":46,"server-negotiator.queue_time_us":997,"thread_start_us":796,"threads_started":1}
I20260811 18:47:56.047448 5674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "45bbe6823a8b4824bf97078170308744" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "ffc129de04a54bfe8a890bc558cda5d0" is_pre_election: true
I20260811 18:47:56.047830 6980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.038849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:37093 (local address 127.0.0.1:39256)
0811 18:47:56.040027 (+ 1178us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.040043 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:56.040182 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:56.041046 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:56.041052 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:56.041085 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:56.041451 (+ 366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:56.041465 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.043384 (+ 1919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.043389 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:56.045213 (+ 1824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:56.045229 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.047062 (+ 1833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.047069 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:56.047243 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:56.047278 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 18:47:56.047377 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 18:47:56.047521 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":434,"mutex_wait_us":1,"thread_start_us":1917,"threads_started":1}
I20260811 18:47:56.047874 6986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.039129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39256 (local address 127.25.25.60:37093)
0811 18:47:56.040695 (+ 1566us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:56.040701 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:56.040722 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:47:56.040813 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:56.040818 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:56.040887 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:56.041603 (+ 716us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:56.041943 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.043250 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.045399 (+ 2149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.046654 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.046800 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:56.046982 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:56.047465 (+ 483us) server_negotiation.cc:299] Negotiation successful
0811 18:47:56.047578 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":1444,"thread_start_us":1302,"threads_started":1}
I20260811 18:47:56.047806 5674 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45bbe6823a8b4824bf97078170308744 in term 1.
I20260811 18:47:56.048481 5985 leader_election.cc:302] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45bbe6823a8b4824bf97078170308744, ffc129de04a54bfe8a890bc558cda5d0; no voters: 5e617b487cf2450fb23d1122274e75dc
I20260811 18:47:56.048591 6028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ffc129de04a54bfe8a890bc558cda5d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "45bbe6823a8b4824bf97078170308744" is_pre_election: true
I20260811 18:47:56.048867 6971 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 18:47:56.048995 6971 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e617b487cf2450fb23d1122274e75dc)
I20260811 18:47:56.049088 6971 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [term 1 FOLLOWER]: Advancing to term 2
I20260811 18:47:56.051354 6971 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: false } }
I20260811 18:47:56.051921 6028 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ffc129de04a54bfe8a890bc558cda5d0 in current term 2: Already voted for candidate 45bbe6823a8b4824bf97078170308744 in this term.
I20260811 18:47:56.052227 6971 leader_election.cc:288] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [CANDIDATE]: Term 2 election: Requested vote from peers 5e617b487cf2450fb23d1122274e75dc (127.25.25.62:40987), ffc129de04a54bfe8a890bc558cda5d0 (127.25.25.61:40099)
I20260811 18:47:56.052915 6979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.052351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.0.0.1:47392)
0811 18:47:56.052627 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.052734 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141}
I20260811 18:47:56.052892 5674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "45bbe6823a8b4824bf97078170308744" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "ffc129de04a54bfe8a890bc558cda5d0"
I20260811 18:47:56.053049 5631 leader_election.cc:302] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ffc129de04a54bfe8a890bc558cda5d0; no voters: 45bbe6823a8b4824bf97078170308744, 5e617b487cf2450fb23d1122274e75dc
I20260811 18:47:56.053186 5674 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [term 1 FOLLOWER]: Advancing to term 2
I20260811 18:47:56.054042 6979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.053596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.0.0.1:47396)
0811 18:47:56.053769 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.053888 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260811 18:47:56.054219 5988 leader_election.cc:334] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5e617b487cf2450fb23d1122274e75dc (127.25.25.62:40987): Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
I20260811 18:47:56.055918 5674 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45bbe6823a8b4824bf97078170308744 in term 2.
I20260811 18:47:56.056137 6973 raft_consensus.cc:2726] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 18:47:56.056435 5985 leader_election.cc:302] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45bbe6823a8b4824bf97078170308744, ffc129de04a54bfe8a890bc558cda5d0; no voters: 5e617b487cf2450fb23d1122274e75dc
I20260811 18:47:56.056761 6971 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 18:47:56.057219 6971 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [term 2 LEADER]: Becoming Leader. State: Replica: 45bbe6823a8b4824bf97078170308744, State: Running, Role: LEADER
I20260811 18:47:56.057649 6971 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: false } }
I20260811 18:47:56.059386 6988 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45bbe6823a8b4824bf97078170308744. Latest consensus state: current_term: 2 leader_uuid: "45bbe6823a8b4824bf97078170308744" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: false } } }
I20260811 18:47:56.059849 6988 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:56.060603 6990 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:47:56.064570 6990 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:47:56.065495 6990 catalog_manager.cc:1259] Loaded cluster ID: f8699c4e063a4333b04d7b253ce41761
I20260811 18:47:56.065580 6990 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:47:56.066820 6990 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:47:56.067688 6990 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744: Loaded TSK: 0
I20260811 18:47:56.068642 6990 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:47:56.082011 6010 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39240:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:47:56.089399 6010 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:47:56.093880 6979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.093423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.0.0.1:47418)
0811 18:47:56.093630 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.093738 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 18:47:56.094034 5674 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [term 2 FOLLOWER]: Refusing update from remote peer 45bbe6823a8b4824bf97078170308744: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260811 18:47:56.095006 6979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.094571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.0.0.1:47420)
0811 18:47:56.094743 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.094828 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 18:47:56.094933 6988 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260811 18:47:56.095294 5988 consensus_peers.cc:487] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 -> Peer 5e617b487cf2450fb23d1122274e75dc (127.25.25.62:40987): Couldn't send request to peer 5e617b487cf2450fb23d1122274e75dc. Status: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 18:47:56.097869 6973 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45bbe6823a8b4824bf97078170308744. Latest consensus state: current_term: 2 leader_uuid: "45bbe6823a8b4824bf97078170308744" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: false } } }
I20260811 18:47:56.098217 6973 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:47:56.099973 6988 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "45bbe6823a8b4824bf97078170308744" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: false } } }
I20260811 18:47:56.100379 6988 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744 [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:56.100816 6973 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "45bbe6823a8b4824bf97078170308744" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "5e617b487cf2450fb23d1122274e75dc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40987 } } peers { permanent_uuid: "ffc129de04a54bfe8a890bc558cda5d0" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 40099 } attrs { promote: false } } peers { permanent_uuid: "45bbe6823a8b4824bf97078170308744" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 37093 } attrs { promote: false } } }
I20260811 18:47:56.101097 6973 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffc129de04a54bfe8a890bc558cda5d0 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:47:56.132884 6979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.109491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:35159 (local address 127.0.0.1:35366)
0811 18:47:56.109663 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.109685 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:56.109812 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:56.125745 (+ 15933us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:56.125753 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:56.125789 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:56.126019 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:56.126034 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.127856 (+ 1822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.127863 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:56.130035 (+ 2172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:56.130056 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.131693 (+ 1637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.131702 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:56.132205 (+ 503us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:56.132252 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 18:47:56.132357 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 18:47:56.132506 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 18:47:56.134395 7000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.109642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35366 (local address 127.25.25.3:35159)
0811 18:47:56.125178 (+ 15536us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:56.125187 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:56.125218 (+ 31us) server_negotiation.cc:407] Connection header received
0811 18:47:56.125318 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:56.125325 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:56.125417 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:56.126187 (+ 770us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:56.126402 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.127617 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.130305 (+ 2688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.131353 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.133787 (+ 2434us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:56.133892 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:56.133944 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 18:47:56.134092 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15363,"thread_start_us":15906,"threads_started":1}
I20260811 18:47:56.135219 6732 tablet_service.cc:1467] Processing CreateTablet for tablet aadf6d278e7d4af3804147f78788cd18 (DEFAULT_TABLE table=test-table [id=b4a51217368b4565b56a7791c04fec4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:56.135727 6732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aadf6d278e7d4af3804147f78788cd18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:56.135875 6977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.109881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:34169 (local address 127.0.0.1:34312)
0811 18:47:56.110230 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.110261 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:56.110396 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:56.127990 (+ 17594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:56.127998 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:56.128037 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:56.128536 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:56.128554 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.131373 (+ 2819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.131380 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:56.133513 (+ 2133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:56.133528 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.135110 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.135117 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:56.135286 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:56.135326 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 18:47:56.135422 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 18:47:56.135593 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"mutex_wait_us":3}
I20260811 18:47:56.135979 7007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.110674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34312 (local address 127.25.25.1:34169)
0811 18:47:56.127387 (+ 16713us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:56.127396 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:56.127425 (+ 29us) server_negotiation.cc:407] Connection header received
0811 18:47:56.127524 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:56.127531 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:56.127632 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:56.128774 (+ 1142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:56.129057 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.130255 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.133702 (+ 3447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.134808 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.135012 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:56.135158 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:56.135477 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 18:47:56.135642 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16525,"thread_start_us":17100,"threads_started":1}
I20260811 18:47:56.136803 6201 tablet_service.cc:1467] Processing CreateTablet for tablet aadf6d278e7d4af3804147f78788cd18 (DEFAULT_TABLE table=test-table [id=b4a51217368b4565b56a7791c04fec4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:56.137367 6201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aadf6d278e7d4af3804147f78788cd18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:56.139237 7004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.110100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:45075 (local address 127.0.0.1:44904)
0811 18:47:56.130975 (+ 20875us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.131000 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:56.131176 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:56.132517 (+ 1341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:56.132522 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:56.132549 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:56.133000 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:56.133014 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.134406 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.134411 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:56.136562 (+ 2151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:56.136578 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.138239 (+ 1661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.138246 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:56.138423 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:56.138465 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 18:47:56.138567 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 18:47:56.138712 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20713,"thread_start_us":20467,"threads_started":1}
I20260811 18:47:56.139328 7006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.110269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44904 (local address 127.25.25.2:45075)
0811 18:47:56.132006 (+ 21737us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:56.132012 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:56.132035 (+ 23us) server_negotiation.cc:407] Connection header received
0811 18:47:56.132140 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:56.132146 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:56.132231 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:56.132342 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:56.133205 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.134241 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.136813 (+ 2572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.138010 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.138167 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:56.138301 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:56.138689 (+ 388us) server_negotiation.cc:299] Negotiation successful
0811 18:47:56.138944 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21575,"thread_start_us":21440,"threads_started":1}
I20260811 18:47:56.140204 6462 tablet_service.cc:1467] Processing CreateTablet for tablet aadf6d278e7d4af3804147f78788cd18 (DEFAULT_TABLE table=test-table [id=b4a51217368b4565b56a7791c04fec4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:47:56.140703 6462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aadf6d278e7d4af3804147f78788cd18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:56.143498 7008 tablet_bootstrap.cc:492] T aadf6d278e7d4af3804147f78788cd18 P a00a8043b3324336862c99cc9d44eb01: Bootstrap starting.
I20260811 18:47:56.145774 7008 tablet_bootstrap.cc:654] T aadf6d278e7d4af3804147f78788cd18 P a00a8043b3324336862c99cc9d44eb01: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:56.147475 7011 tablet_bootstrap.cc:492] T aadf6d278e7d4af3804147f78788cd18 P 282cb4f254b546dca9e2337ebb9be30b: Bootstrap starting.
I20260811 18:47:56.149708 7011 tablet_bootstrap.cc:654] T aadf6d278e7d4af3804147f78788cd18 P 282cb4f254b546dca9e2337ebb9be30b: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:56.150180 7008 tablet_bootstrap.cc:492] T aadf6d278e7d4af3804147f78788cd18 P a00a8043b3324336862c99cc9d44eb01: No bootstrap required, opened a new log
I20260811 18:47:56.150381 7008 ts_tablet_manager.cc:1397] T aadf6d278e7d4af3804147f78788cd18 P a00a8043b3324336862c99cc9d44eb01: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 18:47:56.151376 7013 tablet_bootstrap.cc:492] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4: Bootstrap starting.
I20260811 18:47:56.151310 7008 raft_consensus.cc:348] T aadf6d278e7d4af3804147f78788cd18 P a00a8043b3324336862c99cc9d44eb01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00a8043b3324336862c99cc9d44eb01" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35159 } } peers { permanent_uuid: "a9e2fc3f8e914bac89172067877d3ba4" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34169 } } peers { permanent_uuid: "282cb4f254b546dca9e2337ebb9be30b" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45075 } }
I20260811 18:47:56.151645 7008 raft_consensus.cc:374] T aadf6d278e7d4af3804147f78788cd18 P a00a8043b3324336862c99cc9d44eb01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:56.151777 7008 raft_consensus.cc:729] T aadf6d278e7d4af3804147f78788cd18 P a00a8043b3324336862c99cc9d44eb01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a00a8043b3324336862c99cc9d44eb01, State: Initialized, Role: FOLLOWER
I20260811 18:47:56.152164 7008 consensus_queue.cc:260] T aadf6d278e7d4af3804147f78788cd18 P a00a8043b3324336862c99cc9d44eb01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00a8043b3324336862c99cc9d44eb01" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35159 } } peers { permanent_uuid: "a9e2fc3f8e914bac89172067877d3ba4" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34169 } } peers { permanent_uuid: "282cb4f254b546dca9e2337ebb9be30b" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45075 } }
I20260811 18:47:56.153264 7008 ts_tablet_manager.cc:1428] T aadf6d278e7d4af3804147f78788cd18 P a00a8043b3324336862c99cc9d44eb01: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:47:56.153374 7011 tablet_bootstrap.cc:492] T aadf6d278e7d4af3804147f78788cd18 P 282cb4f254b546dca9e2337ebb9be30b: No bootstrap required, opened a new log
I20260811 18:47:56.153373 7013 tablet_bootstrap.cc:654] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:56.153548 7011 ts_tablet_manager.cc:1397] T aadf6d278e7d4af3804147f78788cd18 P 282cb4f254b546dca9e2337ebb9be30b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 18:47:56.154858 7011 raft_consensus.cc:348] T aadf6d278e7d4af3804147f78788cd18 P 282cb4f254b546dca9e2337ebb9be30b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00a8043b3324336862c99cc9d44eb01" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35159 } } peers { permanent_uuid: "a9e2fc3f8e914bac89172067877d3ba4" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34169 } } peers { permanent_uuid: "282cb4f254b546dca9e2337ebb9be30b" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45075 } }
I20260811 18:47:56.155229 7011 raft_consensus.cc:374] T aadf6d278e7d4af3804147f78788cd18 P 282cb4f254b546dca9e2337ebb9be30b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:56.155344 7011 raft_consensus.cc:729] T aadf6d278e7d4af3804147f78788cd18 P 282cb4f254b546dca9e2337ebb9be30b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 282cb4f254b546dca9e2337ebb9be30b, State: Initialized, Role: FOLLOWER
I20260811 18:47:56.155608 7011 consensus_queue.cc:260] T aadf6d278e7d4af3804147f78788cd18 P 282cb4f254b546dca9e2337ebb9be30b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00a8043b3324336862c99cc9d44eb01" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35159 } } peers { permanent_uuid: "a9e2fc3f8e914bac89172067877d3ba4" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34169 } } peers { permanent_uuid: "282cb4f254b546dca9e2337ebb9be30b" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45075 } }
I20260811 18:47:56.158707 7011 ts_tablet_manager.cc:1428] T aadf6d278e7d4af3804147f78788cd18 P 282cb4f254b546dca9e2337ebb9be30b: Time spent starting tablet: real 0.005s user 0.002s sys 0.003s
I20260811 18:47:56.159597 7013 tablet_bootstrap.cc:492] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4: No bootstrap required, opened a new log
I20260811 18:47:56.159864 7013 ts_tablet_manager.cc:1397] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260811 18:47:56.160984 7013 raft_consensus.cc:348] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00a8043b3324336862c99cc9d44eb01" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35159 } } peers { permanent_uuid: "a9e2fc3f8e914bac89172067877d3ba4" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34169 } } peers { permanent_uuid: "282cb4f254b546dca9e2337ebb9be30b" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45075 } }
I20260811 18:47:56.161334 7013 raft_consensus.cc:374] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:56.161507 7013 raft_consensus.cc:729] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9e2fc3f8e914bac89172067877d3ba4, State: Initialized, Role: FOLLOWER
I20260811 18:47:56.161815 7013 consensus_queue.cc:260] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00a8043b3324336862c99cc9d44eb01" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35159 } } peers { permanent_uuid: "a9e2fc3f8e914bac89172067877d3ba4" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34169 } } peers { permanent_uuid: "282cb4f254b546dca9e2337ebb9be30b" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45075 } }
I20260811 18:47:56.162204 6595 heartbeater.cc:503] Master 127.25.25.60:37093 was elected leader, sending a full tablet report...
I20260811 18:47:56.162719 7021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.159535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.25.25.2:52129)
0811 18:47:56.161992 (+ 2457us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.162231 (+ 239us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2264,"thread_start_us":2064,"threads_started":1}
I20260811 18:47:56.163475 7013 ts_tablet_manager.cc:1428] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 18:47:56.168023 7024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.164293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.25.25.1:42243)
0811 18:47:56.166609 (+ 2316us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.167672 (+ 1063us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2172,"thread_start_us":2001,"threads_started":1}
I20260811 18:47:56.168151 7021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.167486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.25.25.2:43177)
0811 18:47:56.167833 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.167944 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205}
I20260811 18:47:56.168356 6330 heartbeater.cc:503] Master 127.25.25.60:37093 was elected leader, sending a full tablet report...
I20260811 18:47:56.168776 7018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.154240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.25.25.3:57935)
0811 18:47:56.168242 (+ 14002us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.168419 (+ 177us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13819,"thread_start_us":14233,"threads_started":1}
I20260811 18:47:56.168980 6840 heartbeater.cc:503] Master 127.25.25.60:37093 was elected leader, sending a full tablet report...
I20260811 18:47:56.170825 7024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.170344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.25.25.1:35555)
0811 18:47:56.170570 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.170660 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260811 18:47:56.170830 7018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.170385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.25.25.3:57943)
0811 18:47:56.170610 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.170699 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135}
I20260811 18:47:56.235219 7022 raft_consensus.cc:482] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:47:56.235446 7022 raft_consensus.cc:504] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00a8043b3324336862c99cc9d44eb01" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35159 } } peers { permanent_uuid: "a9e2fc3f8e914bac89172067877d3ba4" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34169 } } peers { permanent_uuid: "282cb4f254b546dca9e2337ebb9be30b" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45075 } }
I20260811 18:47:56.236186 7022 leader_election.cc:288] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a00a8043b3324336862c99cc9d44eb01 (127.25.25.3:35159), 282cb4f254b546dca9e2337ebb9be30b (127.25.25.2:45075)
I20260811 18:47:56.236702 7015 raft_consensus.cc:482] T aadf6d278e7d4af3804147f78788cd18 P a00a8043b3324336862c99cc9d44eb01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:47:56.236758 6764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aadf6d278e7d4af3804147f78788cd18" candidate_uuid: "a9e2fc3f8e914bac89172067877d3ba4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a00a8043b3324336862c99cc9d44eb01" is_pre_election: true
I20260811 18:47:56.236763 6503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aadf6d278e7d4af3804147f78788cd18" candidate_uuid: "a9e2fc3f8e914bac89172067877d3ba4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "282cb4f254b546dca9e2337ebb9be30b" is_pre_election: true
I20260811 18:47:56.237049 6503 raft_consensus.cc:2454] T aadf6d278e7d4af3804147f78788cd18 P 282cb4f254b546dca9e2337ebb9be30b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9e2fc3f8e914bac89172067877d3ba4 in term 0.
I20260811 18:47:56.236963 7015 raft_consensus.cc:504] T aadf6d278e7d4af3804147f78788cd18 P a00a8043b3324336862c99cc9d44eb01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00a8043b3324336862c99cc9d44eb01" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35159 } } peers { permanent_uuid: "a9e2fc3f8e914bac89172067877d3ba4" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34169 } } peers { permanent_uuid: "282cb4f254b546dca9e2337ebb9be30b" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45075 } }
I20260811 18:47:56.237564 6127 leader_election.cc:302] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 282cb4f254b546dca9e2337ebb9be30b, a9e2fc3f8e914bac89172067877d3ba4; no voters:
I20260811 18:47:56.237670 6764 raft_consensus.cc:2454] T aadf6d278e7d4af3804147f78788cd18 P a00a8043b3324336862c99cc9d44eb01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9e2fc3f8e914bac89172067877d3ba4 in term 0.
I20260811 18:47:56.237888 7022 raft_consensus.cc:2781] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:47:56.238112 7022 raft_consensus.cc:482] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:47:56.238229 7022 raft_consensus.cc:3037] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:56.238809 7015 leader_election.cc:288] T aadf6d278e7d4af3804147f78788cd18 P a00a8043b3324336862c99cc9d44eb01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9e2fc3f8e914bac89172067877d3ba4 (127.25.25.1:34169), 282cb4f254b546dca9e2337ebb9be30b (127.25.25.2:45075)
I20260811 18:47:56.241325 7022 raft_consensus.cc:504] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00a8043b3324336862c99cc9d44eb01" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35159 } } peers { permanent_uuid: "a9e2fc3f8e914bac89172067877d3ba4" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34169 } } peers { permanent_uuid: "282cb4f254b546dca9e2337ebb9be30b" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45075 } }
I20260811 18:47:56.242039 7022 leader_election.cc:288] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4 [CANDIDATE]: Term 1 election: Requested vote from peers a00a8043b3324336862c99cc9d44eb01 (127.25.25.3:35159), 282cb4f254b546dca9e2337ebb9be30b (127.25.25.2:45075)
I20260811 18:47:56.242537 6764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aadf6d278e7d4af3804147f78788cd18" candidate_uuid: "a9e2fc3f8e914bac89172067877d3ba4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a00a8043b3324336862c99cc9d44eb01"
I20260811 18:47:56.242751 6764 raft_consensus.cc:3037] T aadf6d278e7d4af3804147f78788cd18 P a00a8043b3324336862c99cc9d44eb01 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:56.243409 6503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aadf6d278e7d4af3804147f78788cd18" candidate_uuid: "a9e2fc3f8e914bac89172067877d3ba4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "282cb4f254b546dca9e2337ebb9be30b"
I20260811 18:47:56.243640 6503 raft_consensus.cc:3037] T aadf6d278e7d4af3804147f78788cd18 P 282cb4f254b546dca9e2337ebb9be30b [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:56.246098 6764 raft_consensus.cc:2454] T aadf6d278e7d4af3804147f78788cd18 P a00a8043b3324336862c99cc9d44eb01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9e2fc3f8e914bac89172067877d3ba4 in term 1.
I20260811 18:47:56.246531 6128 leader_election.cc:302] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a00a8043b3324336862c99cc9d44eb01, a9e2fc3f8e914bac89172067877d3ba4; no voters:
I20260811 18:47:56.246757 7006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.239558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:44505 (local address 127.25.25.2:45075)
0811 18:47:56.239762 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:56.239768 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:56.239788 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:47:56.239863 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:56.239869 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:56.239961 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:56.240043 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:56.240700 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.241608 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.244229 (+ 2621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.245536 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.245633 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:56.245746 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:56.246336 (+ 590us) server_negotiation.cc:299] Negotiation successful
0811 18:47:56.246488 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 18:47:56.246894 7022 raft_consensus.cc:2781] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:56.247210 6503 raft_consensus.cc:2454] T aadf6d278e7d4af3804147f78788cd18 P 282cb4f254b546dca9e2337ebb9be30b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9e2fc3f8e914bac89172067877d3ba4 in term 1.
I20260811 18:47:56.247452 7018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.239077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:45075 (local address 127.25.25.3:44505)
0811 18:47:56.239438 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.239463 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:56.239612 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:56.240309 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:56.240314 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:56.240341 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:56.240551 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:56.240559 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.241777 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.241783 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:56.243979 (+ 2196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:56.243998 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.245933 (+ 1935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.245939 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:56.246138 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:56.246173 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 18:47:56.247021 (+ 848us) client_negotiation.cc:240] Negotiation successful
0811 18:47:56.247176 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243}
I20260811 18:47:56.247793 7007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.239229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:39619 (local address 127.25.25.1:34169)
0811 18:47:56.239449 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:56.239455 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:56.240036 (+ 581us) server_negotiation.cc:407] Connection header received
0811 18:47:56.240287 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:56.240292 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:56.240376 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:56.240460 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:47:56.241173 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.242287 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.245389 (+ 3102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.246582 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.246704 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:56.246802 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:56.247338 (+ 536us) server_negotiation.cc:299] Negotiation successful
0811 18:47:56.247496 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 18:47:56.248206 6501 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aadf6d278e7d4af3804147f78788cd18" candidate_uuid: "a00a8043b3324336862c99cc9d44eb01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "282cb4f254b546dca9e2337ebb9be30b" is_pre_election: true
I20260811 18:47:56.248504 7026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.239119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:34169 (local address 127.25.25.3:39619)
0811 18:47:56.239913 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.239932 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:56.240067 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:56.240645 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:56.240651 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:56.240678 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:47:56.241000 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:56.241013 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.243030 (+ 2017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.243036 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:56.245183 (+ 2147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:56.245201 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.246969 (+ 1768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.246975 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:56.247152 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:56.247184 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 18:47:56.247947 (+ 763us) client_negotiation.cc:240] Negotiation successful
0811 18:47:56.248114 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"mutex_wait_us":1,"thread_start_us":1048,"threads_started":1}
I20260811 18:47:56.248636 6501 raft_consensus.cc:2379] T aadf6d278e7d4af3804147f78788cd18 P 282cb4f254b546dca9e2337ebb9be30b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a00a8043b3324336862c99cc9d44eb01 in current term 1: Already voted for candidate a9e2fc3f8e914bac89172067877d3ba4 in this term.
I20260811 18:47:56.248605 7022 raft_consensus.cc:686] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4 [term 1 LEADER]: Becoming Leader. State: Replica: a9e2fc3f8e914bac89172067877d3ba4, State: Running, Role: LEADER
I20260811 18:47:56.249133 7022 consensus_queue.cc:237] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00a8043b3324336862c99cc9d44eb01" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35159 } } peers { permanent_uuid: "a9e2fc3f8e914bac89172067877d3ba4" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34169 } } peers { permanent_uuid: "282cb4f254b546dca9e2337ebb9be30b" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45075 } }
I20260811 18:47:56.249393 6241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aadf6d278e7d4af3804147f78788cd18" candidate_uuid: "a00a8043b3324336862c99cc9d44eb01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9e2fc3f8e914bac89172067877d3ba4" is_pre_election: true
I20260811 18:47:56.250176 7024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.249686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.25.25.1:44955)
0811 18:47:56.249895 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.250014 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260811 18:47:56.250692 6657 leader_election.cc:302] T aadf6d278e7d4af3804147f78788cd18 P a00a8043b3324336862c99cc9d44eb01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a00a8043b3324336862c99cc9d44eb01; no voters: 282cb4f254b546dca9e2337ebb9be30b, a9e2fc3f8e914bac89172067877d3ba4
I20260811 18:47:56.251442 7015 raft_consensus.cc:2726] T aadf6d278e7d4af3804147f78788cd18 P a00a8043b3324336862c99cc9d44eb01 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 18:47:56.252472 6010 catalog_manager.cc:5495] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9e2fc3f8e914bac89172067877d3ba4 (127.25.25.1). New cstate: current_term: 1 leader_uuid: "a9e2fc3f8e914bac89172067877d3ba4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00a8043b3324336862c99cc9d44eb01" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9e2fc3f8e914bac89172067877d3ba4" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "282cb4f254b546dca9e2337ebb9be30b" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45075 } health_report { overall_health: UNKNOWN } } }
W20260811 18:47:56.257128 6844 tablet.cc:2369] T aadf6d278e7d4af3804147f78788cd18 P a00a8043b3324336862c99cc9d44eb01: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:47:56.275975 7007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.271125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34314 (local address 127.25.25.1:34169)
0811 18:47:56.271324 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:56.271330 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:56.271350 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:47:56.271561 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:56.271565 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:56.271637 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:56.271715 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:47:56.272138 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.272912 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.274261 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.274691 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.274809 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:56.275218 (+ 409us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:47:56.275347 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:47:56.275425 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:56.275594 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 18:47:56.275683 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 18:47:56.279511 6764 raft_consensus.cc:1261] T aadf6d278e7d4af3804147f78788cd18 P a00a8043b3324336862c99cc9d44eb01 [term 1 FOLLOWER]: Refusing update from remote peer a9e2fc3f8e914bac89172067877d3ba4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:47:56.279531 6501 raft_consensus.cc:1261] T aadf6d278e7d4af3804147f78788cd18 P 282cb4f254b546dca9e2337ebb9be30b [term 1 FOLLOWER]: Refusing update from remote peer a9e2fc3f8e914bac89172067877d3ba4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:47:56.280220 7022 consensus_queue.cc:1035] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a00a8043b3324336862c99cc9d44eb01" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:47:56.280519 7027 consensus_queue.cc:1035] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "282cb4f254b546dca9e2337ebb9be30b" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:47:56.284469 7018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.283151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.25.25.3:45413)
0811 18:47:56.284127 (+ 976us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.284264 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":805}
I20260811 18:47:56.284543 7021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.284068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.25.25.2:59459)
0811 18:47:56.284269 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.284375 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 18:47:56.289126 7030 mvcc.cc:205] Tried to move back new op lower bound from 7317397816434368512 to 7317397816319152128. Current Snapshot: MvccSnapshot[applied={T|T < 7317397816434368512}]
I20260811 18:47:56.290460 7021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.289908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.25.25.2:60563)
0811 18:47:56.290181 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.290277 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155}
I20260811 18:47:56.293576 7031 mvcc.cc:205] Tried to move back new op lower bound from 7317397816434368512 to 7317397816319152128. Current Snapshot: MvccSnapshot[applied={T|T < 7317397816434368512}]
I20260811 18:47:56.295271 7018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.294620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.25.25.3:46467)
0811 18:47:56.294971 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.295074 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240}
I20260811 18:47:56.298202 7024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.297628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.25.25.1:53717)
0811 18:47:56.297937 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.298038 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183}
I20260811 18:47:56.298231 6014 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39240:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:47:56.298535 6014 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39240:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:47:56.303869 6014 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 45bbe6823a8b4824bf97078170308744: Sending DeleteTablet for 3 replicas of tablet aadf6d278e7d4af3804147f78788cd18
I20260811 18:47:56.304965 6732 tablet_service.cc:1514] Processing DeleteTablet for tablet aadf6d278e7d4af3804147f78788cd18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:56 UTC) from {username='oryx', principal='oryx/127.25.25.60@KRBTEST.COM'} at 127.0.0.1:35366
I20260811 18:47:56.305142 6462 tablet_service.cc:1514] Processing DeleteTablet for tablet aadf6d278e7d4af3804147f78788cd18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:56 UTC) from {username='oryx', principal='oryx/127.25.25.60@KRBTEST.COM'} at 127.0.0.1:44904
I20260811 18:47:56.305486 6201 tablet_service.cc:1514] Processing DeleteTablet for tablet aadf6d278e7d4af3804147f78788cd18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:47:56 UTC) from {username='oryx', principal='oryx/127.25.25.60@KRBTEST.COM'} at 127.0.0.1:34312
I20260811 18:47:56.305938 7042 tablet_replica.cc:330] T aadf6d278e7d4af3804147f78788cd18 P 282cb4f254b546dca9e2337ebb9be30b: stopping tablet replica
I20260811 18:47:56.306164 7047 tablet_replica.cc:330] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4: stopping tablet replica
I20260811 18:47:56.306183 7042 raft_consensus.cc:2229] T aadf6d278e7d4af3804147f78788cd18 P 282cb4f254b546dca9e2337ebb9be30b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:47:56.306380 7047 raft_consensus.cc:2229] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:47:56.306633 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 5964
I20260811 18:47:56.306752 7042 raft_consensus.cc:2258] T aadf6d278e7d4af3804147f78788cd18 P 282cb4f254b546dca9e2337ebb9be30b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:56.306788 7047 raft_consensus.cc:2258] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:56.308142 7042 ts_tablet_manager.cc:1905] T aadf6d278e7d4af3804147f78788cd18 P 282cb4f254b546dca9e2337ebb9be30b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:56.309788 7047 ts_tablet_manager.cc:1905] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:56.316885 7047 ts_tablet_manager.cc:1918] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:47:56.317060 7047 log.cc:1196] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-0/wal/wals/aadf6d278e7d4af3804147f78788cd18
I20260811 18:47:56.317555 7047 ts_tablet_manager.cc:1939] T aadf6d278e7d4af3804147f78788cd18 P a9e2fc3f8e914bac89172067877d3ba4: Deleting consensus metadata
I20260811 18:47:56.318804 5986 catalog_manager.cc:4841] TS a9e2fc3f8e914bac89172067877d3ba4 (127.25.25.1:34169): tablet aadf6d278e7d4af3804147f78788cd18 (table test-table [id=b4a51217368b4565b56a7791c04fec4d]) successfully deleted
I20260811 18:47:56.320827 7041 tablet_replica.cc:330] T aadf6d278e7d4af3804147f78788cd18 P a00a8043b3324336862c99cc9d44eb01: stopping tablet replica
I20260811 18:47:56.321053 7041 raft_consensus.cc:2229] T aadf6d278e7d4af3804147f78788cd18 P a00a8043b3324336862c99cc9d44eb01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:47:56.321403 7041 raft_consensus.cc:2258] T aadf6d278e7d4af3804147f78788cd18 P a00a8043b3324336862c99cc9d44eb01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:47:56.322829 7041 ts_tablet_manager.cc:1905] T aadf6d278e7d4af3804147f78788cd18 P a00a8043b3324336862c99cc9d44eb01: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:47:56.324900 7042 ts_tablet_manager.cc:1918] T aadf6d278e7d4af3804147f78788cd18 P 282cb4f254b546dca9e2337ebb9be30b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:47:56.325088 7042 log.cc:1196] T aadf6d278e7d4af3804147f78788cd18 P 282cb4f254b546dca9e2337ebb9be30b: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-1/wal/wals/aadf6d278e7d4af3804147f78788cd18
I20260811 18:47:56.325668 7042 ts_tablet_manager.cc:1939] T aadf6d278e7d4af3804147f78788cd18 P 282cb4f254b546dca9e2337ebb9be30b: Deleting consensus metadata
I20260811 18:47:56.326929 5985 catalog_manager.cc:4841] TS 282cb4f254b546dca9e2337ebb9be30b (127.25.25.2:45075): tablet aadf6d278e7d4af3804147f78788cd18 (table test-table [id=b4a51217368b4565b56a7791c04fec4d]) successfully deleted
I20260811 18:47:56.327044 7007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.307879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34330 (local address 127.25.25.1:34169)
0811 18:47:56.308070 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:56.308098 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:56.308362 (+ 264us) server_negotiation.cc:407] Connection header received
0811 18:47:56.308553 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:56.308558 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:56.308638 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:56.308727 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:56.310607 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.311399 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.313487 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.314008 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.314131 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:56.318045 (+ 3914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:56.318070 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:56.318095 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:56.318155 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:56.322607 (+ 4452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:56.323637 (+ 1030us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:56.323649 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:56.323652 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:56.323833 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:56.324383 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:56.324390 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:56.324393 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:56.324901 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:56.325371 (+ 470us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:56.326430 (+ 1059us) server_negotiation.cc:299] Negotiation successful
0811 18:47:56.326709 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 18:47:56.328361 6318 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:56.330622 7041 ts_tablet_manager.cc:1918] T aadf6d278e7d4af3804147f78788cd18 P a00a8043b3324336862c99cc9d44eb01: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:47:56.330788 7041 log.cc:1196] T aadf6d278e7d4af3804147f78788cd18 P a00a8043b3324336862c99cc9d44eb01: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474012733352-25700-0/minicluster-data/ts-2/wal/wals/aadf6d278e7d4af3804147f78788cd18
I20260811 18:47:56.331373 7041 ts_tablet_manager.cc:1939] T aadf6d278e7d4af3804147f78788cd18 P a00a8043b3324336862c99cc9d44eb01: Deleting consensus metadata
I20260811 18:47:56.332808 5986 catalog_manager.cc:4841] TS a00a8043b3324336862c99cc9d44eb01 (127.25.25.3:35159): tablet aadf6d278e7d4af3804147f78788cd18 (table test-table [id=b4a51217368b4565b56a7791c04fec4d]) successfully deleted
I20260811 18:47:56.454177 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 5964
I20260811 18:47:56.488994 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 6350
I20260811 18:47:56.503783 7006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.489837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44920 (local address 127.25.25.2:45075)
0811 18:47:56.490031 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:56.490038 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:56.490060 (+ 22us) server_negotiation.cc:407] Connection header received
0811 18:47:56.490260 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:56.490265 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:56.490338 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:56.490469 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:56.491844 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.492792 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.494122 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.494552 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.494672 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:56.497537 (+ 2865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:56.497557 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:56.497576 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:56.497618 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:56.500645 (+ 3027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:56.501460 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:56.501469 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:56.501471 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:56.501617 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:56.502040 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:56.502044 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:56.502046 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:56.502502 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:56.502819 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:56.503146 (+ 327us) server_negotiation.cc:299] Negotiation successful
0811 18:47:56.503433 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 18:47:56.504678 6583 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:56.527709 7004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.527177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.0.0.1:47428)
0811 18:47:56.527395 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.527515 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 18:47:56.529047 7004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.528553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40987 (local address 127.0.0.1:47434)
0811 18:47:56.528741 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:56.528865 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:40987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 18:47:56.602661 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 6350
I20260811 18:47:56.630422 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 6624
I20260811 18:47:56.645273 7000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:56.631285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35370 (local address 127.25.25.3:35159)
0811 18:47:56.631508 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:56.631513 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:56.631555 (+ 42us) server_negotiation.cc:407] Connection header received
0811 18:47:56.631672 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:56.631676 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:56.631743 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:56.631839 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:56.633334 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.634211 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.635626 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:56.636063 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:56.636251 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:56.639100 (+ 2849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:56.639120 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:56.639138 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:56.639181 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:56.642285 (+ 3104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:56.643048 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:56.643057 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:56.643059 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:56.643198 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:56.643632 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:56.643637 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:56.643638 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:56.644037 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:56.644376 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:56.644706 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 18:47:56.644960 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 18:47:56.646052 6830 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:56.742867 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 6624
I20260811 18:47:56.775290 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 5387
I20260811 18:47:56.776510 5710 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:56.898219 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 5387
I20260811 18:47:56.928386 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 5593
I20260811 18:47:56.929539 6064 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:47:57.055552 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 5593
2026-08-11T18:47:57Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (10438 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:47:57 dist-test-slave-lgr5 krb5kdc[7065](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:47:57 dist-test-slave-lgr5 krb5kdc[7065](info): set up 2 sockets
Aug 11 18:47:57 dist-test-slave-lgr5 krb5kdc[7065](info): commencing operation
krb5kdc: starting...
W20260811 18:47:58.340194 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.007s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:47:58 dist-test-slave-lgr5 krb5kdc[7065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474078, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:47:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:47:58Z Disabled control of system clock
WARNING: no policy specified for oryx/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.62.keytab.
Entry for principal oryx/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.62.keytab.
I20260811 18:47:58.620756 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:40933
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.62.keytab
--principal=oryx/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:46343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:40933
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:58.978663 7089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:58.978997 7089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:58.979135 7089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:58.987118 7089 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:47:58.987253 7089 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 18:47:58.987323 7089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:58.987406 7089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:58.987481 7089 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:47:58.987568 7089 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:47:58.998157 7089 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:46343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:40933
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.62.keytab
--principal=oryx/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:40933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:58.999573 7089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:59.001078 7089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:59.013983 7094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:59.013932 7096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:59.014005 7099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:59.014935 7089 server_base.cc:1034] running on GCE node
I20260811 18:47:59.015833 7089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:59.017419 7089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:59.018651 7089 hybrid_clock.cc:648] HybridClock initialized: now 1786474079018579 us; error 50 us; skew 500 ppm
I20260811 18:47:59.019003 7089 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:59 dist-test-slave-lgr5 krb5kdc[7065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474079, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:59.022297 7089 init.cc:377] Logged in from keytab as oryx/127.25.25.62@KRBTEST.COM (short username oryx)
I20260811 18:47:59.023940 7089 webserver.cc:460] Webserver started at http://127.25.25.62:36405/ using document root <none> and password file <none>
I20260811 18:47:59.024748 7089 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:59.024863 7089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:59.025224 7089 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:59.028649 7089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "bf841b3c6e4342d5bf1eaca79cd3616b"
format_stamp: "Formatted at 2026-08-11 18:47:59 on dist-test-slave-lgr5"
server_key: "da062e4db3093036c6592f53aea95765"
server_key_iv: "ef3c74bc522203bf031dfe8d839fbdf2"
server_key_version: "encryptionkey@0"
I20260811 18:47:59.029594 7089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "bf841b3c6e4342d5bf1eaca79cd3616b"
format_stamp: "Formatted at 2026-08-11 18:47:59 on dist-test-slave-lgr5"
server_key: "da062e4db3093036c6592f53aea95765"
server_key_iv: "ef3c74bc522203bf031dfe8d839fbdf2"
server_key_version: "encryptionkey@0"
I20260811 18:47:59.035507 7089 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 18:47:59.039535 7112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:59.041079 7089 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:47:59.041272 7089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "bf841b3c6e4342d5bf1eaca79cd3616b"
format_stamp: "Formatted at 2026-08-11 18:47:59 on dist-test-slave-lgr5"
server_key: "da062e4db3093036c6592f53aea95765"
server_key_iv: "ef3c74bc522203bf031dfe8d839fbdf2"
server_key_version: "encryptionkey@0"
I20260811 18:47:59.041502 7089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:59.075048 7089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:59.079649 7089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:59.079931 7089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:59.101536 7089 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:40933
I20260811 18:47:59.101558 7213 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:40933 every 8 connection(s)
I20260811 18:47:59.103056 7089 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:47:59.107177 7214 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:47:59.109290 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 7089
I20260811 18:47:59.109520 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:47:59.110217 25700 external_mini_cluster.cc:1428] Setting key f02c046799231a1cec73057984837d4f
I20260811 18:47:59.121026 7214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf841b3c6e4342d5bf1eaca79cd3616b: Bootstrap starting.
I20260811 18:47:59.125002 7214 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bf841b3c6e4342d5bf1eaca79cd3616b: Neither blocks nor log segments found. Creating new log.
I20260811 18:47:59.126096 7214 log.cc:824] T 00000000000000000000000000000000 P bf841b3c6e4342d5bf1eaca79cd3616b: Log is configured to *not* fsync() on all Append() calls
Aug 11 18:47:59 dist-test-slave-lgr5 krb5kdc[7065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474078, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM
I20260811 18:47:59.129851 7214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf841b3c6e4342d5bf1eaca79cd3616b: No bootstrap required, opened a new log
I20260811 18:47:59.136914 7219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:59.112539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56822 (local address 127.25.25.62:40933)
0811 18:47:59.113424 (+ 885us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:59.113453 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:59.113511 (+ 58us) server_negotiation.cc:407] Connection header received
0811 18:47:59.115977 (+ 2466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:59.116012 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:59.116594 (+ 582us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:59.117098 (+ 504us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:59.118520 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:59.120503 (+ 1983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:59.121886 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:59.122992 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:59.123207 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:59.127725 (+ 4518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:59.127737 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:59.127758 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:59.127804 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:59.131821 (+ 4017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:59.132648 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:59.132662 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:59.132672 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:59.132911 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:59.133259 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:59.133264 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:59.133267 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:59.134076 (+ 809us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:59.134386 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:59.134825 (+ 439us) server_negotiation.cc:299] Negotiation successful
0811 18:47:59.135352 (+ 527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":605,"thread_start_us":371,"threads_started":1}
I20260811 18:47:59.140348 7214 raft_consensus.cc:348] T 00000000000000000000000000000000 P bf841b3c6e4342d5bf1eaca79cd3616b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf841b3c6e4342d5bf1eaca79cd3616b" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40933 } }
I20260811 18:47:59.140710 7214 raft_consensus.cc:374] T 00000000000000000000000000000000 P bf841b3c6e4342d5bf1eaca79cd3616b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:47:59.140789 7214 raft_consensus.cc:729] T 00000000000000000000000000000000 P bf841b3c6e4342d5bf1eaca79cd3616b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf841b3c6e4342d5bf1eaca79cd3616b, State: Initialized, Role: FOLLOWER
I20260811 18:47:59.141292 7214 consensus_queue.cc:260] T 00000000000000000000000000000000 P bf841b3c6e4342d5bf1eaca79cd3616b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf841b3c6e4342d5bf1eaca79cd3616b" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40933 } }
I20260811 18:47:59.141537 7214 raft_consensus.cc:388] T 00000000000000000000000000000000 P bf841b3c6e4342d5bf1eaca79cd3616b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:47:59.141691 7214 raft_consensus.cc:482] T 00000000000000000000000000000000 P bf841b3c6e4342d5bf1eaca79cd3616b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:47:59.141878 7214 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bf841b3c6e4342d5bf1eaca79cd3616b [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:47:59.144161 7214 raft_consensus.cc:504] T 00000000000000000000000000000000 P bf841b3c6e4342d5bf1eaca79cd3616b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf841b3c6e4342d5bf1eaca79cd3616b" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40933 } }
I20260811 18:47:59.144682 7214 leader_election.cc:302] T 00000000000000000000000000000000 P bf841b3c6e4342d5bf1eaca79cd3616b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bf841b3c6e4342d5bf1eaca79cd3616b; no voters:
I20260811 18:47:59.145295 7214 leader_election.cc:288] T 00000000000000000000000000000000 P bf841b3c6e4342d5bf1eaca79cd3616b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:47:59.145416 7221 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bf841b3c6e4342d5bf1eaca79cd3616b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:47:59.146126 7221 raft_consensus.cc:686] T 00000000000000000000000000000000 P bf841b3c6e4342d5bf1eaca79cd3616b [term 1 LEADER]: Becoming Leader. State: Replica: bf841b3c6e4342d5bf1eaca79cd3616b, State: Running, Role: LEADER
I20260811 18:47:59.146719 7221 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf841b3c6e4342d5bf1eaca79cd3616b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf841b3c6e4342d5bf1eaca79cd3616b" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40933 } }
I20260811 18:47:59.147425 7214 sys_catalog.cc:564] T 00000000000000000000000000000000 P bf841b3c6e4342d5bf1eaca79cd3616b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:47:59.149456 7222 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf841b3c6e4342d5bf1eaca79cd3616b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bf841b3c6e4342d5bf1eaca79cd3616b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf841b3c6e4342d5bf1eaca79cd3616b" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40933 } } }
I20260811 18:47:59.149864 7222 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf841b3c6e4342d5bf1eaca79cd3616b [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:59.151541 7229 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:47:59.151463 7223 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf841b3c6e4342d5bf1eaca79cd3616b [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf841b3c6e4342d5bf1eaca79cd3616b. Latest consensus state: current_term: 1 leader_uuid: "bf841b3c6e4342d5bf1eaca79cd3616b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf841b3c6e4342d5bf1eaca79cd3616b" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40933 } } }
I20260811 18:47:59.151703 7223 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf841b3c6e4342d5bf1eaca79cd3616b [sys.catalog]: This master's current role is: LEADER
I20260811 18:47:59.157553 7229 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:47:59.167972 7229 catalog_manager.cc:1347] Generated new cluster ID: 13d0f45fe1584f6d9e9d3ef332005b8a
I20260811 18:47:59.168129 7229 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:47:59.181995 7229 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:47:59.183476 7229 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:47:59.203949 7229 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bf841b3c6e4342d5bf1eaca79cd3616b: Generated new TSK 0
I20260811 18:47:59.205006 7229 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.25.25.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.25.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.25.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.1.keytab.
Entry for principal oryx/127.25.25.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.1.keytab.
I20260811 18:47:59.288852 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:0
--local_ip_for_outbound_sockets=127.25.25.1
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:40933
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.1.keytab
--principal=oryx/127.25.25.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:46343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:47:59.647977 7261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:47:59.648411 7261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:47:59.648586 7261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:47:59.657399 7261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:47:59.657555 7261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:47:59.657684 7261 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:47:59.657797 7261 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:47:59.668298 7261 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:46343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.1.keytab
--principal=oryx/127.25.25.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.25.62:40933
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:47:59.669770 7261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:47:59.671206 7261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:47:59.686244 7269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:59.686390 7268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:47:59.686230 7272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:47:59.686966 7261 server_base.cc:1034] running on GCE node
I20260811 18:47:59.687727 7261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:47:59.688913 7261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:47:59.690210 7261 hybrid_clock.cc:648] HybridClock initialized: now 1786474079690108 us; error 69 us; skew 500 ppm
I20260811 18:47:59.690598 7261 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:47:59 dist-test-slave-lgr5 krb5kdc[7065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474079, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:47:59.698274 7261 init.cc:377] Logged in from keytab as oryx/127.25.25.1@KRBTEST.COM (short username oryx)
I20260811 18:47:59.700112 7261 webserver.cc:460] Webserver started at http://127.25.25.1:37117/ using document root <none> and password file <none>
I20260811 18:47:59.700927 7261 fs_manager.cc:359] Metadata directory not provided
I20260811 18:47:59.701036 7261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:47:59.701357 7261 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:47:59.705277 7261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-0/data/instance:
uuid: "c5efdbece203419ba8936c49cacd3c8c"
format_stamp: "Formatted at 2026-08-11 18:47:59 on dist-test-slave-lgr5"
server_key: "081381b10b6c1c97d295ffe20792e4cc"
server_key_iv: "5563790ffc8a649aa51d9cf612d5cac0"
server_key_version: "encryptionkey@0"
I20260811 18:47:59.706202 7261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance:
uuid: "c5efdbece203419ba8936c49cacd3c8c"
format_stamp: "Formatted at 2026-08-11 18:47:59 on dist-test-slave-lgr5"
server_key: "081381b10b6c1c97d295ffe20792e4cc"
server_key_iv: "5563790ffc8a649aa51d9cf612d5cac0"
server_key_version: "encryptionkey@0"
I20260811 18:47:59.712327 7261 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 18:47:59.716594 7288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:59.718137 7261 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:47:59.718341 7261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "c5efdbece203419ba8936c49cacd3c8c"
format_stamp: "Formatted at 2026-08-11 18:47:59 on dist-test-slave-lgr5"
server_key: "081381b10b6c1c97d295ffe20792e4cc"
server_key_iv: "5563790ffc8a649aa51d9cf612d5cac0"
server_key_version: "encryptionkey@0"
I20260811 18:47:59.718593 7261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:47:59.732057 7261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:47:59.737075 7261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:47:59.737392 7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:47:59.740460 7261 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:47:59.740592 7261 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:47:59.740772 7261 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:47:59.740833 7261 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:47:59 dist-test-slave-lgr5 krb5kdc[7065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474079, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM
I20260811 18:47:59.765575 7300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:59.740947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:58417 (local address 127.25.25.62:40933)
0811 18:47:59.741818 (+ 871us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:59.741822 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:59.742812 (+ 990us) server_negotiation.cc:407] Connection header received
0811 18:47:59.745079 (+ 2267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:59.745085 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:59.745188 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:59.745289 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:59.747613 (+ 2324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:59.748571 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:59.751170 (+ 2599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:59.751752 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:59.751883 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:59.757459 (+ 5576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:59.757467 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:59.757473 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:59.757514 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:59.761104 (+ 3590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:59.762476 (+ 1372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:59.762483 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:59.762487 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:59.762672 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:59.763318 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:59.763324 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:59.763332 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:59.763775 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:59.763937 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:59.764931 (+ 994us) server_negotiation.cc:299] Negotiation successful
0811 18:47:59.765194 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":756,"thread_start_us":649,"threads_started":1}
I20260811 18:47:59.766673 7301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:59.741726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40933 (local address 127.25.25.1:58417)
0811 18:47:59.742613 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:59.742668 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:59.744703 (+ 2035us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:59.745592 (+ 889us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:59.745601 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:59.746518 (+ 917us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:59.747418 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:59.747441 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:59.748817 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:59.748823 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:59.750909 (+ 2086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:59.750931 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:59.752028 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:59.752036 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:59.752308 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:59.753146 (+ 838us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:59.753185 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:59.757138 (+ 3953us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:59.761341 (+ 4203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:59.761351 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:59.761375 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:59.762261 (+ 886us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:59.762824 (+ 563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:59.762831 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:59.762838 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:59.763181 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:59.763965 (+ 784us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:59.763975 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:59.764489 (+ 514us) client_negotiation.cc:769] Sending connection context
0811 18:47:59.764799 (+ 310us) client_negotiation.cc:240] Negotiation successful
0811 18:47:59.765404 (+ 605us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"thread_start_us":375,"threads_started":1}
I20260811 18:47:59.791435 7261 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:41681
I20260811 18:47:59.791457 7507 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:41681 every 8 connection(s)
I20260811 18:47:59.792884 7300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:59.777004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:46051 (local address 127.25.25.62:40933)
0811 18:47:59.777233 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 18:47:59.777239 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:47:59.778112 (+ 873us) server_negotiation.cc:407] Connection header received
0811 18:47:59.778276 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:47:59.778282 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:47:59.778386 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:47:59.778526 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:47:59.780186 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:59.781417 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:59.782956 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:47:59.783695 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:47:59.783843 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:59.786489 (+ 2646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:47:59.786497 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:47:59.786502 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:47:59.786552 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:47:59.789725 (+ 3173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:59.790663 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:59.790670 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:59.790672 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:59.790826 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:47:59.791275 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:47:59.791281 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:47:59.791285 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:47:59.791622 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:47:59.791810 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0811 18:47:59.792284 (+ 474us) server_negotiation.cc:299] Negotiation successful
0811 18:47:59.792533 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260811 18:47:59.792912 7261 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:47:59.793030 7457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:47:59.777057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40933 (local address 127.25.25.1:46051)
0811 18:47:59.777953 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0811 18:47:59.777982 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 18:47:59.778148 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:47:59.778600 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:47:59.778606 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:47:59.779372 (+ 766us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:47:59.779899 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:59.779921 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:59.781659 (+ 1738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:59.781664 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:59.782784 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:47:59.782801 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:47:59.783963 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:47:59.783969 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:47:59.784175 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:47:59.784911 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:47:59.784939 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:47:59.786229 (+ 1290us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:47:59.789950 (+ 3721us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:59.789958 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:59.789962 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:59.790506 (+ 544us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:59.790978 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:47:59.790984 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:47:59.790988 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:47:59.791146 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:47:59.791778 (+ 632us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:47:59.791783 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:47:59.791987 (+ 204us) client_negotiation.cc:769] Sending connection context
0811 18:47:59.792162 (+ 175us) client_negotiation.cc:240] Negotiation successful
0811 18:47:59.792581 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":717,"thread_start_us":544,"threads_started":1}
I20260811 18:47:59.796154 7508 heartbeater.cc:347] Connected to a master server at 127.25.25.62:40933
I20260811 18:47:59.796413 7508 heartbeater.cc:464] Registering TS with master...
I20260811 18:47:59.797354 7508 heartbeater.cc:511] Master 127.25.25.62:40933 requested a full tablet report, sending...
I20260811 18:47:59.799649 7145 ts_manager.cc:194] Registered new tserver with Master: c5efdbece203419ba8936c49cacd3c8c (127.25.25.1:41681)
I20260811 18:47:59.800654 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 7261
I20260811 18:47:59.800835 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance
I20260811 18:47:59.801362 7145 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.25.1@KRBTEST.COM'} at 127.25.25.1:58417
I20260811 18:47:59.801466 25700 external_mini_cluster.cc:1428] Setting key 2239ab9b214636bdf8bfd5c82db8cee6
WARNING: no policy specified for oryx/127.25.25.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.25.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.25.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.2.keytab.
Entry for principal oryx/127.25.25.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.2.keytab.
I20260811 18:47:59.864269 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:0
--local_ip_for_outbound_sockets=127.25.25.2
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:40933
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.2.keytab
--principal=oryx/127.25.25.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:46343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:48:00.232844 7513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:48:00.233160 7513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:48:00.233260 7513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:48:00.240703 7513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:48:00.240831 7513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:48:00.240916 7513 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:48:00.240998 7513 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:48:00.251510 7513 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:46343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.2.keytab
--principal=oryx/127.25.25.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.25.62:40933
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:48:00.253160 7513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:48:00.254817 7513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:48:00.270174 7523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:00.270182 7530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:00.270314 7521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:48:00.270911 7513 server_base.cc:1034] running on GCE node
I20260811 18:48:00.271667 7513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:48:00.272806 7513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:48:00.274094 7513 hybrid_clock.cc:648] HybridClock initialized: now 1786474080274008 us; error 47 us; skew 500 ppm
I20260811 18:48:00.274518 7513 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:48:00 dist-test-slave-lgr5 krb5kdc[7065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474080, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:48:00.278234 7513 init.cc:377] Logged in from keytab as oryx/127.25.25.2@KRBTEST.COM (short username oryx)
I20260811 18:48:00.279985 7513 webserver.cc:460] Webserver started at http://127.25.25.2:45411/ using document root <none> and password file <none>
I20260811 18:48:00.280884 7513 fs_manager.cc:359] Metadata directory not provided
I20260811 18:48:00.281021 7513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:48:00.281358 7513 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:48:00.284907 7513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-1/data/instance:
uuid: "d27622cce74344aba7dcedcce7f2cc28"
format_stamp: "Formatted at 2026-08-11 18:48:00 on dist-test-slave-lgr5"
server_key: "084cf7dbe2f13aa222e37081b9b0013f"
server_key_iv: "dacec0a665ad556cf23048d4c65245af"
server_key_version: "encryptionkey@0"
I20260811 18:48:00.285952 7513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance:
uuid: "d27622cce74344aba7dcedcce7f2cc28"
format_stamp: "Formatted at 2026-08-11 18:48:00 on dist-test-slave-lgr5"
server_key: "084cf7dbe2f13aa222e37081b9b0013f"
server_key_iv: "dacec0a665ad556cf23048d4c65245af"
server_key_version: "encryptionkey@0"
I20260811 18:48:00.292716 7513 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 18:48:00.297639 7547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:00.299422 7513 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 18:48:00.299615 7513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "d27622cce74344aba7dcedcce7f2cc28"
format_stamp: "Formatted at 2026-08-11 18:48:00 on dist-test-slave-lgr5"
server_key: "084cf7dbe2f13aa222e37081b9b0013f"
server_key_iv: "dacec0a665ad556cf23048d4c65245af"
server_key_version: "encryptionkey@0"
I20260811 18:48:00.299836 7513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:48:00.323339 7513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:48:00.328073 7513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:48:00.328380 7513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:48:00.331236 7513 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:48:00.331341 7513 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:00.331501 7513 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:48:00.331561 7513 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:48:00 dist-test-slave-lgr5 krb5kdc[7065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474080, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM
I20260811 18:48:00.357770 7564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:00.332187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:43135 (local address 127.25.25.62:40933)
0811 18:48:00.332704 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:00.332710 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:00.334076 (+ 1366us) server_negotiation.cc:407] Connection header received
0811 18:48:00.336651 (+ 2575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:00.336657 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:00.336766 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:00.336905 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:00.339204 (+ 2299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:00.340519 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:00.342781 (+ 2262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:00.343340 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:00.343481 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:00.349271 (+ 5790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:00.349280 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:00.349285 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:00.349338 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:00.352986 (+ 3648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:00.354453 (+ 1467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:00.354460 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:00.354463 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:00.354676 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:00.355425 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:00.355431 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:00.355435 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:00.355862 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:00.356027 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:00.357099 (+ 1072us) server_negotiation.cc:299] Negotiation successful
0811 18:48:00.357382 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":246,"threads_started":1}
I20260811 18:48:00.359704 7566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:00.332828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40933 (local address 127.25.25.2:43135)
0811 18:48:00.333828 (+ 1000us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:00.333901 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:00.336264 (+ 2363us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:00.337222 (+ 958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:00.337232 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:00.338052 (+ 820us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:00.338974 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:00.339002 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:00.340707 (+ 1705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:00.340713 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:00.342623 (+ 1910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:00.342637 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:00.343840 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:00.343853 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:00.344233 (+ 380us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:00.345147 (+ 914us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:00.345200 (+ 53us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:00.348853 (+ 3653us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:48:00.353262 (+ 4409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:48:00.353276 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:48:00.353303 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:48:00.354257 (+ 954us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:48:00.354842 (+ 585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:48:00.354853 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:48:00.354857 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:48:00.355271 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:48:00.356023 (+ 752us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:48:00.356034 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:48:00.356590 (+ 556us) client_negotiation.cc:769] Sending connection context
0811 18:48:00.356996 (+ 406us) client_negotiation.cc:240] Negotiation successful
0811 18:48:00.357650 (+ 654us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":676,"thread_start_us":421,"threads_started":1}
I20260811 18:48:00.373116 7513 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:45963
I20260811 18:48:00.373284 7755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:45963 every 8 connection(s)
I20260811 18:48:00.375108 7513 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:48:00.377591 7758 heartbeater.cc:347] Connected to a master server at 127.25.25.62:40933
I20260811 18:48:00.377885 7758 heartbeater.cc:464] Registering TS with master...
I20260811 18:48:00.378258 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 7513
I20260811 18:48:00.378448 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance
I20260811 18:48:00.378875 7758 heartbeater.cc:511] Master 127.25.25.62:40933 requested a full tablet report, sending...
I20260811 18:48:00.379019 25700 external_mini_cluster.cc:1428] Setting key 2266ddf1c8db108808c95aab939a2b15
I20260811 18:48:00.381419 7143 ts_manager.cc:194] Registered new tserver with Master: d27622cce74344aba7dcedcce7f2cc28 (127.25.25.2:45963)
I20260811 18:48:00.382712 7143 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.25.2@KRBTEST.COM'} at 127.25.25.2:43135
I20260811 18:48:00.383200 7564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:00.366897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:50851 (local address 127.25.25.62:40933)
0811 18:48:00.367098 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:00.367104 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:00.367848 (+ 744us) server_negotiation.cc:407] Connection header received
0811 18:48:00.368140 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:00.368147 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:00.368253 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:00.368397 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:00.370242 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:00.371434 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:00.373583 (+ 2149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:00.374222 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:00.374400 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:00.376858 (+ 2458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:00.376867 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:00.376872 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:00.376921 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:00.379920 (+ 2999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:00.380856 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:00.380861 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:00.380864 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:00.381040 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:00.381544 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:00.381559 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:00.381563 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:00.382005 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:00.382169 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:00.382621 (+ 452us) server_negotiation.cc:299] Negotiation successful
0811 18:48:00.382866 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 18:48:00.383582 7735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:00.366939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40933 (local address 127.25.25.2:50851)
0811 18:48:00.367716 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:00.367739 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:00.367938 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:00.368451 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:00.368457 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:00.369317 (+ 860us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:00.369814 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:00.369835 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:00.371624 (+ 1789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:00.371631 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:00.373306 (+ 1675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:00.373334 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:00.374472 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:00.374478 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:00.374623 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:00.375331 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:00.375350 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:00.376564 (+ 1214us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:48:00.380147 (+ 3583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:48:00.380153 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:48:00.380155 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:48:00.380680 (+ 525us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:48:00.381201 (+ 521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:48:00.381206 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:48:00.381209 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:48:00.381349 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:48:00.382155 (+ 806us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:48:00.382161 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:48:00.382347 (+ 186us) client_negotiation.cc:769] Sending connection context
0811 18:48:00.382469 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 18:48:00.382918 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":443,"threads_started":1}
WARNING: no policy specified for oryx/127.25.25.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.25.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.25.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.3.keytab.
Entry for principal oryx/127.25.25.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.3.keytab.
I20260811 18:48:00.439042 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:0
--local_ip_for_outbound_sockets=127.25.25.3
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:40933
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.3.keytab
--principal=oryx/127.25.25.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:46343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:48:00.799458 7764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:48:00.799865 7764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:48:00.800036 7764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260811 18:48:00.804702 7508 heartbeater.cc:503] Master 127.25.25.62:40933 was elected leader, sending a full tablet report...
W20260811 18:48:00.808477 7764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:48:00.808595 7764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:48:00.808722 7764 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:48:00.808826 7764 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:48:00.819133 7764 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:46343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.3.keytab
--principal=oryx/127.25.25.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.25.62:40933
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:48:00.820881 7764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:48:00.822540 7764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:48:00.842962 7775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:00.843060 7773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:00.843246 7772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:48:00.844295 7764 server_base.cc:1034] running on GCE node
I20260811 18:48:00.845052 7764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:48:00.846165 7764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:48:00.847368 7764 hybrid_clock.cc:648] HybridClock initialized: now 1786474080847285 us; error 66 us; skew 500 ppm
I20260811 18:48:00.847707 7764 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:48:00 dist-test-slave-lgr5 krb5kdc[7065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474080, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:48:00.851195 7764 init.cc:377] Logged in from keytab as oryx/127.25.25.3@KRBTEST.COM (short username oryx)
I20260811 18:48:00.852828 7764 webserver.cc:460] Webserver started at http://127.25.25.3:34783/ using document root <none> and password file <none>
I20260811 18:48:00.853621 7764 fs_manager.cc:359] Metadata directory not provided
I20260811 18:48:00.853735 7764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:48:00.854092 7764 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:48:00.857394 7764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-2/data/instance:
uuid: "504e79e08a2f45bba278f82d3f886136"
format_stamp: "Formatted at 2026-08-11 18:48:00 on dist-test-slave-lgr5"
server_key: "74c83a36f52494e202f43708b99cf1a6"
server_key_iv: "5f21c86aa3371949cff40da7a305b00e"
server_key_version: "encryptionkey@0"
I20260811 18:48:00.858243 7764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance:
uuid: "504e79e08a2f45bba278f82d3f886136"
format_stamp: "Formatted at 2026-08-11 18:48:00 on dist-test-slave-lgr5"
server_key: "74c83a36f52494e202f43708b99cf1a6"
server_key_iv: "5f21c86aa3371949cff40da7a305b00e"
server_key_version: "encryptionkey@0"
I20260811 18:48:00.864342 7764 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 18:48:00.868517 7785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:00.870126 7764 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 18:48:00.870311 7764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "504e79e08a2f45bba278f82d3f886136"
format_stamp: "Formatted at 2026-08-11 18:48:00 on dist-test-slave-lgr5"
server_key: "74c83a36f52494e202f43708b99cf1a6"
server_key_iv: "5f21c86aa3371949cff40da7a305b00e"
server_key_version: "encryptionkey@0"
I20260811 18:48:00.870613 7764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:48:00.893143 7764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:48:00.897399 7764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:48:00.897663 7764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:48:00.900840 7764 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:48:00.900938 7764 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:00.901070 7764 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:48:00.901125 7764 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:48:00 dist-test-slave-lgr5 krb5kdc[7065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474080, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM
I20260811 18:48:00.926232 7803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:00.901443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:40165 (local address 127.25.25.62:40933)
0811 18:48:00.902021 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:00.902028 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:00.903575 (+ 1547us) server_negotiation.cc:407] Connection header received
0811 18:48:00.905757 (+ 2182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:00.905764 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:00.905871 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:00.905974 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:00.908429 (+ 2455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:00.909467 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:00.911925 (+ 2458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:00.912591 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:00.912715 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:00.918188 (+ 5473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:00.918197 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:00.918201 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:00.918254 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:00.921665 (+ 3411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:00.922917 (+ 1252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:00.922924 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:00.922927 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:00.923132 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:00.923769 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:00.923776 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:00.923779 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:00.924223 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:00.924391 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:00.925457 (+ 1066us) server_negotiation.cc:299] Negotiation successful
0811 18:48:00.925759 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":260,"threads_started":1}
I20260811 18:48:00.927112 7804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:00.902262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40933 (local address 127.25.25.3:40165)
0811 18:48:00.903208 (+ 946us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:00.903262 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:00.905436 (+ 2174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:00.906294 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:00.906310 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:00.907195 (+ 885us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:00.908176 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:00.908215 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:00.909630 (+ 1415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:00.909633 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:00.911755 (+ 2122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:00.911780 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:00.912869 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:00.912879 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:00.913168 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:00.914167 (+ 999us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:00.914217 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:00.917831 (+ 3614us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:48:00.921911 (+ 4080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:48:00.921935 (+ 24us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:48:00.921963 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:48:00.922690 (+ 727us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:48:00.923286 (+ 596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:48:00.923290 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:48:00.923292 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:48:00.923592 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:48:00.924391 (+ 799us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:48:00.924400 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:48:00.924937 (+ 537us) client_negotiation.cc:769] Sending connection context
0811 18:48:00.925316 (+ 379us) client_negotiation.cc:240] Negotiation successful
0811 18:48:00.925829 (+ 513us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":386,"threads_started":1}
I20260811 18:48:00.946031 7764 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:34613
I20260811 18:48:00.946050 7987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:34613 every 8 connection(s)
I20260811 18:48:00.947355 7764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:48:00.948416 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 7764
I20260811 18:48:00.948583 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance
I20260811 18:48:00.949129 25700 external_mini_cluster.cc:1428] Setting key 5ee2101cdf0ebec828de1d2293b6db8c
I20260811 18:48:00.949735 7988 heartbeater.cc:347] Connected to a master server at 127.25.25.62:40933
I20260811 18:48:00.950533 7961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:00.935299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40933 (local address 127.25.25.3:49177)
0811 18:48:00.935990 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:00.936010 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:00.936207 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:00.936609 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:00.936615 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:00.937267 (+ 652us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:00.937795 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:00.937816 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:00.939443 (+ 1627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:00.939447 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:00.940674 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:00.940694 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:00.941726 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:00.941734 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:00.941948 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:00.942670 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:00.942692 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:00.943958 (+ 1266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:48:00.947346 (+ 3388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:48:00.947352 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:48:00.947356 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:48:00.947808 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:48:00.948339 (+ 531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:48:00.948343 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:48:00.948347 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:48:00.948512 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:48:00.949273 (+ 761us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:48:00.949277 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:48:00.949488 (+ 211us) client_negotiation.cc:769] Sending connection context
0811 18:48:00.949614 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 18:48:00.949981 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":395,"threads_started":1}
I20260811 18:48:00.950845 7803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:00.935058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:49177 (local address 127.25.25.62:40933)
0811 18:48:00.935277 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:00.935285 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:00.936134 (+ 849us) server_negotiation.cc:407] Connection header received
0811 18:48:00.936330 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:00.936336 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:00.936430 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:00.936549 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:00.937983 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:00.939250 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:00.940899 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:00.941490 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:00.941620 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:00.944188 (+ 2568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:00.944193 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:00.944196 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:00.944231 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:00.947212 (+ 2981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:00.947927 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:00.947933 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:00.947935 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:00.948197 (+ 262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:00.948722 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:00.948727 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:00.948730 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:00.949123 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:00.950175 (+ 1052us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:00.950293 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 18:48:00.950525 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 18:48:00.950057 7988 heartbeater.cc:464] Registering TS with master...
I20260811 18:48:00.951855 7988 heartbeater.cc:511] Master 127.25.25.62:40933 requested a full tablet report, sending...
I20260811 18:48:00.953542 7143 ts_manager.cc:194] Registered new tserver with Master: 504e79e08a2f45bba278f82d3f886136 (127.25.25.3:34613)
I20260811 18:48:00.954551 7143 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.25.3@KRBTEST.COM'} at 127.25.25.3:40165
I20260811 18:48:00.967568 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 18:48:01 dist-test-slave-lgr5 krb5kdc[7065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474081, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 18:48:01 dist-test-slave-lgr5 krb5kdc[7065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:01 dist-test-slave-lgr5 krb5kdc[7065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 18:48:01.029867 7803 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:01.018749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46148 (local address 127.25.25.62:40933)
0811 18:48:01.019014 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:01.019022 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:01.019189 (+ 167us) server_negotiation.cc:407] Connection header received
0811 18:48:01.019412 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:01.019419 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:01.019508 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:01.019601 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:01.021064 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.021807 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.023186 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.023675 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.023795 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.029580 (+ 5785us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46148: BlockingRecv error: recv got EOF from 127.0.0.1:46148 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
Aug 11 18:48:01 dist-test-slave-lgr5 krb5kdc[7065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474081, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM
I20260811 18:48:01.046262 7803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.032767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46150 (local address 127.25.25.62:40933)
0811 18:48:01.032968 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:01.032974 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:01.033284 (+ 310us) server_negotiation.cc:407] Connection header received
0811 18:48:01.033459 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:01.033465 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:01.033535 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:01.033626 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:01.034784 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.035554 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.036882 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.037354 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.037494 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.041169 (+ 3675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:01.041174 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:01.041178 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:01.041215 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:01.043566 (+ 2351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:01.044289 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:01.044293 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:01.044296 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:01.044426 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:01.044795 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:01.044798 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:01.044801 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:01.045113 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:01.045406 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:01.045713 (+ 307us) server_negotiation.cc:299] Negotiation successful
0811 18:48:01.045966 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 18:48:01.050155 7143 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46150:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:48:01.057657 7143 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:48:01.093041 8017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.073169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57690 (local address 127.25.25.2:45963)
0811 18:48:01.083878 (+ 10709us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:01.083886 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:01.084535 (+ 649us) server_negotiation.cc:407] Connection header received
0811 18:48:01.084964 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:01.084974 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:01.085229 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:01.085400 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:48:01.086359 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.087418 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.090048 (+ 2630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.091373 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.091520 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.091757 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:01.092485 (+ 728us) server_negotiation.cc:299] Negotiation successful
0811 18:48:01.092697 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10533,"thread_start_us":10378,"threads_started":1}
I20260811 18:48:01.093307 8020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.074247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34020 (local address 127.25.25.1:41681)
0811 18:48:01.083208 (+ 8961us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:01.083218 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:01.084929 (+ 1711us) server_negotiation.cc:407] Connection header received
0811 18:48:01.085254 (+ 325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:01.085260 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:01.085426 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:01.085552 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:48:01.086536 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.088038 (+ 1502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.090641 (+ 2603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.091906 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.092032 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.092279 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:01.092806 (+ 527us) server_negotiation.cc:299] Negotiation successful
0811 18:48:01.092990 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8781,"thread_start_us":8642,"threads_started":1}
I20260811 18:48:01.093618 8016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.073582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:41681 (local address 127.0.0.1:34020)
0811 18:48:01.084796 (+ 11214us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:01.084815 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:01.085053 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:01.085747 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:01.085750 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:01.085778 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:48:01.086306 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:01.086322 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.088249 (+ 1927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.088253 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:01.090483 (+ 2230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:01.090495 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.092435 (+ 1940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.092442 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:01.092624 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.092648 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 18:48:01.092730 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 18:48:01.092946 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11092,"mutex_wait_us":3,"thread_start_us":8336,"threads_started":1}
I20260811 18:48:01.093986 8014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.072376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39346 (local address 127.25.25.3:34613)
0811 18:48:01.083271 (+ 10895us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:01.083278 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:01.083667 (+ 389us) server_negotiation.cc:407] Connection header received
0811 18:48:01.084237 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:01.084248 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:01.084584 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:01.084766 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:48:01.085900 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.087736 (+ 1836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.090585 (+ 2849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.092117 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.092241 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.092480 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:01.093466 (+ 986us) server_negotiation.cc:299] Negotiation successful
0811 18:48:01.093660 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10725,"thread_start_us":10841,"threads_started":1}
I20260811 18:48:01.093997 8013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.072523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:45963 (local address 127.0.0.1:57690)
0811 18:48:01.084392 (+ 11869us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:01.084415 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:01.084733 (+ 318us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:01.085671 (+ 938us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:01.085675 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:01.085698 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:48:01.086152 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:01.086165 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.087606 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.087610 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:01.089869 (+ 2259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:01.089884 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.091909 (+ 2025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.091916 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:01.092156 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.092231 (+ 75us) client_negotiation.cc:769] Sending connection context
0811 18:48:01.093367 (+ 1136us) client_negotiation.cc:240] Negotiation successful
0811 18:48:01.093518 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11734,"mutex_wait_us":40,"thread_start_us":11995,"threads_started":1}
I20260811 18:48:01.094285 8019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.072109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:34613 (local address 127.0.0.1:39346)
0811 18:48:01.083447 (+ 11338us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:01.083524 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:01.083879 (+ 355us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:01.085198 (+ 1319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:01.085205 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:01.085238 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:48:01.085670 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:01.085683 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.087911 (+ 2228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.087916 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:01.090357 (+ 2441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:01.090375 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.092641 (+ 2266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.092648 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:01.092820 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.092854 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 18:48:01.092950 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 18:48:01.093091 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10013,"mutex_wait_us":22,"thread_start_us":11985,"threads_started":1}
I20260811 18:48:01.097719 7863 tablet_service.cc:1467] Processing CreateTablet for tablet b7ac5b2a49cc49ccbb9cd845d83c825a (DEFAULT_TABLE table=test-table [id=dc16ea5138474942a26785c1cb0efa99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:48:01.097766 7629 tablet_service.cc:1467] Processing CreateTablet for tablet b7ac5b2a49cc49ccbb9cd845d83c825a (DEFAULT_TABLE table=test-table [id=dc16ea5138474942a26785c1cb0efa99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:48:01.097766 7378 tablet_service.cc:1467] Processing CreateTablet for tablet b7ac5b2a49cc49ccbb9cd845d83c825a (DEFAULT_TABLE table=test-table [id=dc16ea5138474942a26785c1cb0efa99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:48:01.099066 7863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7ac5b2a49cc49ccbb9cd845d83c825a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:48:01.099149 7378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7ac5b2a49cc49ccbb9cd845d83c825a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:48:01.099162 7629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7ac5b2a49cc49ccbb9cd845d83c825a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:48:01.120914 8023 tablet_bootstrap.cc:492] T b7ac5b2a49cc49ccbb9cd845d83c825a P d27622cce74344aba7dcedcce7f2cc28: Bootstrap starting.
I20260811 18:48:01.124497 8021 tablet_bootstrap.cc:492] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c: Bootstrap starting.
I20260811 18:48:01.128181 8021 tablet_bootstrap.cc:654] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c: Neither blocks nor log segments found. Creating new log.
I20260811 18:48:01.128954 8026 tablet_bootstrap.cc:492] T b7ac5b2a49cc49ccbb9cd845d83c825a P 504e79e08a2f45bba278f82d3f886136: Bootstrap starting.
I20260811 18:48:01.129856 8021 log.cc:824] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c: Log is configured to *not* fsync() on all Append() calls
I20260811 18:48:01.131237 8023 tablet_bootstrap.cc:654] T b7ac5b2a49cc49ccbb9cd845d83c825a P d27622cce74344aba7dcedcce7f2cc28: Neither blocks nor log segments found. Creating new log.
I20260811 18:48:01.132679 8023 log.cc:824] T b7ac5b2a49cc49ccbb9cd845d83c825a P d27622cce74344aba7dcedcce7f2cc28: Log is configured to *not* fsync() on all Append() calls
I20260811 18:48:01.133019 8026 tablet_bootstrap.cc:654] T b7ac5b2a49cc49ccbb9cd845d83c825a P 504e79e08a2f45bba278f82d3f886136: Neither blocks nor log segments found. Creating new log.
I20260811 18:48:01.133590 8021 tablet_bootstrap.cc:492] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c: No bootstrap required, opened a new log
I20260811 18:48:01.133870 8021 ts_tablet_manager.cc:1397] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260811 18:48:01.134259 8026 log.cc:824] T b7ac5b2a49cc49ccbb9cd845d83c825a P 504e79e08a2f45bba278f82d3f886136: Log is configured to *not* fsync() on all Append() calls
I20260811 18:48:01.136066 8023 tablet_bootstrap.cc:492] T b7ac5b2a49cc49ccbb9cd845d83c825a P d27622cce74344aba7dcedcce7f2cc28: No bootstrap required, opened a new log
I20260811 18:48:01.136405 8023 ts_tablet_manager.cc:1397] T b7ac5b2a49cc49ccbb9cd845d83c825a P d27622cce74344aba7dcedcce7f2cc28: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.000s
I20260811 18:48:01.142707 8026 tablet_bootstrap.cc:492] T b7ac5b2a49cc49ccbb9cd845d83c825a P 504e79e08a2f45bba278f82d3f886136: No bootstrap required, opened a new log
I20260811 18:48:01.143041 8026 ts_tablet_manager.cc:1397] T b7ac5b2a49cc49ccbb9cd845d83c825a P 504e79e08a2f45bba278f82d3f886136: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.008s
I20260811 18:48:01.144995 8021 raft_consensus.cc:348] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } }
I20260811 18:48:01.145533 8021 raft_consensus.cc:374] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:48:01.145643 8021 raft_consensus.cc:729] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5efdbece203419ba8936c49cacd3c8c, State: Initialized, Role: FOLLOWER
I20260811 18:48:01.146413 8021 consensus_queue.cc:260] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } }
I20260811 18:48:01.147370 8023 raft_consensus.cc:348] T b7ac5b2a49cc49ccbb9cd845d83c825a P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } }
I20260811 18:48:01.147891 8023 raft_consensus.cc:374] T b7ac5b2a49cc49ccbb9cd845d83c825a P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:48:01.148005 8023 raft_consensus.cc:729] T b7ac5b2a49cc49ccbb9cd845d83c825a P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d27622cce74344aba7dcedcce7f2cc28, State: Initialized, Role: FOLLOWER
I20260811 18:48:01.148772 8021 ts_tablet_manager.cc:1428] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
I20260811 18:48:01.148763 8023 consensus_queue.cc:260] T b7ac5b2a49cc49ccbb9cd845d83c825a P d27622cce74344aba7dcedcce7f2cc28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } }
I20260811 18:48:01.149991 7758 heartbeater.cc:503] Master 127.25.25.62:40933 was elected leader, sending a full tablet report...
I20260811 18:48:01.153010 8023 ts_tablet_manager.cc:1428] T b7ac5b2a49cc49ccbb9cd845d83c825a P d27622cce74344aba7dcedcce7f2cc28: Time spent starting tablet: real 0.016s user 0.011s sys 0.003s
I20260811 18:48:01.156875 8026 raft_consensus.cc:348] T b7ac5b2a49cc49ccbb9cd845d83c825a P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } }
I20260811 18:48:01.157318 8026 raft_consensus.cc:374] T b7ac5b2a49cc49ccbb9cd845d83c825a P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:48:01.157435 8026 raft_consensus.cc:729] T b7ac5b2a49cc49ccbb9cd845d83c825a P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 504e79e08a2f45bba278f82d3f886136, State: Initialized, Role: FOLLOWER
I20260811 18:48:01.158082 8026 consensus_queue.cc:260] T b7ac5b2a49cc49ccbb9cd845d83c825a P 504e79e08a2f45bba278f82d3f886136 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } }
I20260811 18:48:01.159209 7988 heartbeater.cc:503] Master 127.25.25.62:40933 was elected leader, sending a full tablet report...
I20260811 18:48:01.159955 8026 ts_tablet_manager.cc:1428] T b7ac5b2a49cc49ccbb9cd845d83c825a P 504e79e08a2f45bba278f82d3f886136: Time spent starting tablet: real 0.017s user 0.009s sys 0.005s
I20260811 18:48:01.175808 8032 raft_consensus.cc:482] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:48:01.176188 8032 raft_consensus.cc:504] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } }
I20260811 18:48:01.178025 8032 leader_election.cc:288] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 504e79e08a2f45bba278f82d3f886136 (127.25.25.3:34613), d27622cce74344aba7dcedcce7f2cc28 (127.25.25.2:45963)
I20260811 18:48:01.185089 8014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.178356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:43071 (local address 127.25.25.3:34613)
0811 18:48:01.178568 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:01.178575 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:01.179347 (+ 772us) server_negotiation.cc:407] Connection header received
0811 18:48:01.179589 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:01.179595 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:01.179665 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:01.179734 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:48:01.180398 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.181147 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.183287 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.184113 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.184236 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.184363 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:01.184688 (+ 325us) server_negotiation.cc:299] Negotiation successful
0811 18:48:01.184830 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 18:48:01.185381 8017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.178629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:58739 (local address 127.25.25.2:45963)
0811 18:48:01.178837 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:01.178843 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:01.179459 (+ 616us) server_negotiation.cc:407] Connection header received
0811 18:48:01.179627 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:01.179631 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:01.179693 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:01.179773 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:48:01.180486 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.181195 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.183274 (+ 2079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.184114 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.184275 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.184387 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:01.184980 (+ 593us) server_negotiation.cc:299] Negotiation successful
0811 18:48:01.185130 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 18:48:01.185421 8041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.178334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:34613 (local address 127.25.25.1:43071)
0811 18:48:01.179223 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:01.179241 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:01.179405 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:01.179774 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:01.179778 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:01.179802 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:48:01.180240 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:01.180254 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.181278 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.181283 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:01.183120 (+ 1837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:01.183133 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.184364 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.184374 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:01.184518 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.184544 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 18:48:01.184633 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 18:48:01.184777 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":757,"mutex_wait_us":116,"thread_start_us":500,"threads_started":1}
I20260811 18:48:01.186152 8042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.178473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:45963 (local address 127.25.25.1:58739)
0811 18:48:01.179347 (+ 874us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:01.179362 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:01.179491 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:01.179811 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:01.179815 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:01.179838 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:48:01.180297 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:01.180308 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.181337 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.181341 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:01.183107 (+ 1766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:01.183121 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.184398 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.184404 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:01.184571 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.184602 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 18:48:01.185659 (+ 1057us) client_negotiation.cc:240] Negotiation successful
0811 18:48:01.185808 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":738,"mutex_wait_us":63,"thread_start_us":560,"threads_started":1}
I20260811 18:48:01.186525 7903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7ac5b2a49cc49ccbb9cd845d83c825a" candidate_uuid: "c5efdbece203419ba8936c49cacd3c8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504e79e08a2f45bba278f82d3f886136" is_pre_election: true
I20260811 18:48:01.187148 7903 raft_consensus.cc:2454] T b7ac5b2a49cc49ccbb9cd845d83c825a P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5efdbece203419ba8936c49cacd3c8c in term 0.
I20260811 18:48:01.187239 7678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7ac5b2a49cc49ccbb9cd845d83c825a" candidate_uuid: "c5efdbece203419ba8936c49cacd3c8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27622cce74344aba7dcedcce7f2cc28" is_pre_election: true
I20260811 18:48:01.187809 7678 raft_consensus.cc:2454] T b7ac5b2a49cc49ccbb9cd845d83c825a P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5efdbece203419ba8936c49cacd3c8c in term 0.
I20260811 18:48:01.188014 7293 leader_election.cc:302] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 504e79e08a2f45bba278f82d3f886136, c5efdbece203419ba8936c49cacd3c8c; no voters:
I20260811 18:48:01.188565 8032 raft_consensus.cc:2781] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:48:01.188735 8032 raft_consensus.cc:482] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:48:01.188843 8032 raft_consensus.cc:3037] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:48:01.191193 8032 raft_consensus.cc:504] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } }
I20260811 18:48:01.191923 8032 leader_election.cc:288] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c [CANDIDATE]: Term 1 election: Requested vote from peers 504e79e08a2f45bba278f82d3f886136 (127.25.25.3:34613), d27622cce74344aba7dcedcce7f2cc28 (127.25.25.2:45963)
I20260811 18:48:01.192551 7903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7ac5b2a49cc49ccbb9cd845d83c825a" candidate_uuid: "c5efdbece203419ba8936c49cacd3c8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504e79e08a2f45bba278f82d3f886136"
I20260811 18:48:01.192605 7678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7ac5b2a49cc49ccbb9cd845d83c825a" candidate_uuid: "c5efdbece203419ba8936c49cacd3c8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27622cce74344aba7dcedcce7f2cc28"
I20260811 18:48:01.192775 7903 raft_consensus.cc:3037] T b7ac5b2a49cc49ccbb9cd845d83c825a P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:48:01.192806 7678 raft_consensus.cc:3037] T b7ac5b2a49cc49ccbb9cd845d83c825a P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:48:01.195225 7678 raft_consensus.cc:2454] T b7ac5b2a49cc49ccbb9cd845d83c825a P d27622cce74344aba7dcedcce7f2cc28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5efdbece203419ba8936c49cacd3c8c in term 1.
I20260811 18:48:01.195222 7903 raft_consensus.cc:2454] T b7ac5b2a49cc49ccbb9cd845d83c825a P 504e79e08a2f45bba278f82d3f886136 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5efdbece203419ba8936c49cacd3c8c in term 1.
I20260811 18:48:01.195772 7292 leader_election.cc:302] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 504e79e08a2f45bba278f82d3f886136, c5efdbece203419ba8936c49cacd3c8c, d27622cce74344aba7dcedcce7f2cc28; no voters:
I20260811 18:48:01.196177 8032 raft_consensus.cc:2781] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:48:01.196719 8032 raft_consensus.cc:686] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c [term 1 LEADER]: Becoming Leader. State: Replica: c5efdbece203419ba8936c49cacd3c8c, State: Running, Role: LEADER
I20260811 18:48:01.197229 8032 consensus_queue.cc:237] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } }
I20260811 18:48:01.202153 7145 catalog_manager.cc:5495] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c reported cstate change: term changed from 0 to 1, leader changed from <none> to c5efdbece203419ba8936c49cacd3c8c (127.25.25.1). New cstate: current_term: 1 leader_uuid: "c5efdbece203419ba8936c49cacd3c8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } health_report { overall_health: HEALTHY } } }
W20260811 18:48:01.203181 7989 tablet.cc:2369] T b7ac5b2a49cc49ccbb9cd845d83c825a P 504e79e08a2f45bba278f82d3f886136: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:48:01.222415 8020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.216985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34022 (local address 127.25.25.1:41681)
0811 18:48:01.217200 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:01.217206 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:01.217227 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:48:01.217396 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:01.217400 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:01.217527 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:01.217677 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:48:01.218058 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.218778 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.220151 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.220587 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.220703 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.221195 (+ 492us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:48:01.221776 (+ 581us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:48:01.221915 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:01.222032 (+ 117us) server_negotiation.cc:299] Negotiation successful
0811 18:48:01.222127 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 18:48:01.231784 7903 raft_consensus.cc:1261] T b7ac5b2a49cc49ccbb9cd845d83c825a P 504e79e08a2f45bba278f82d3f886136 [term 1 FOLLOWER]: Refusing update from remote peer c5efdbece203419ba8936c49cacd3c8c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:48:01.231786 7678 raft_consensus.cc:1261] T b7ac5b2a49cc49ccbb9cd845d83c825a P d27622cce74344aba7dcedcce7f2cc28 [term 1 FOLLOWER]: Refusing update from remote peer c5efdbece203419ba8936c49cacd3c8c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:48:01.232852 8044 consensus_queue.cc:1035] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:48:01.233213 8032 consensus_queue.cc:1035] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:48:01.245460 8048 mvcc.cc:205] Tried to move back new op lower bound from 7317397836713439232 to 7317397836587843584. Current Snapshot: MvccSnapshot[applied={T|T < 7317397836713439232}]
I20260811 18:48:01.259405 7143 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46150:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:48:01.259683 7143 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46150:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:48:01.263775 7143 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bf841b3c6e4342d5bf1eaca79cd3616b: Sending DeleteTablet for 3 replicas of tablet b7ac5b2a49cc49ccbb9cd845d83c825a
I20260811 18:48:01.265300 7378 tablet_service.cc:1514] Processing DeleteTablet for tablet b7ac5b2a49cc49ccbb9cd845d83c825a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:48:01 UTC) from {username='oryx', principal='oryx/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:34020
I20260811 18:48:01.265589 7863 tablet_service.cc:1514] Processing DeleteTablet for tablet b7ac5b2a49cc49ccbb9cd845d83c825a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:48:01 UTC) from {username='oryx', principal='oryx/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:39346
I20260811 18:48:01.265583 7629 tablet_service.cc:1514] Processing DeleteTablet for tablet b7ac5b2a49cc49ccbb9cd845d83c825a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:48:01 UTC) from {username='oryx', principal='oryx/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:57690
I20260811 18:48:01.266487 8072 tablet_replica.cc:330] T b7ac5b2a49cc49ccbb9cd845d83c825a P 504e79e08a2f45bba278f82d3f886136: stopping tablet replica
I20260811 18:48:01.266891 8072 raft_consensus.cc:2229] T b7ac5b2a49cc49ccbb9cd845d83c825a P 504e79e08a2f45bba278f82d3f886136 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:48:01.267464 8072 raft_consensus.cc:2258] T b7ac5b2a49cc49ccbb9cd845d83c825a P 504e79e08a2f45bba278f82d3f886136 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:48:01.267951 7143 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46150:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:48:01.268675 7143 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:48:01.272054 8072 ts_tablet_manager.cc:1905] T b7ac5b2a49cc49ccbb9cd845d83c825a P 504e79e08a2f45bba278f82d3f886136: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:48:01.277587 7634 tablet_service.cc:1467] Processing CreateTablet for tablet 762ac96fa6f846a8b0d393f41d305cf1 (DEFAULT_TABLE table=test-table [id=1715da0c20f8480691d931e458786b4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:48:01.277588 7375 tablet_service.cc:1467] Processing CreateTablet for tablet 762ac96fa6f846a8b0d393f41d305cf1 (DEFAULT_TABLE table=test-table [id=1715da0c20f8480691d931e458786b4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:48:01.278287 7634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 762ac96fa6f846a8b0d393f41d305cf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:48:01.278340 7375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 762ac96fa6f846a8b0d393f41d305cf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:48:01.279336 8072 ts_tablet_manager.cc:1918] T b7ac5b2a49cc49ccbb9cd845d83c825a P 504e79e08a2f45bba278f82d3f886136: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:48:01.279510 8072 log.cc:1196] T b7ac5b2a49cc49ccbb9cd845d83c825a P 504e79e08a2f45bba278f82d3f886136: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-2/wal/wals/b7ac5b2a49cc49ccbb9cd845d83c825a
I20260811 18:48:01.280035 8072 ts_tablet_manager.cc:1939] T b7ac5b2a49cc49ccbb9cd845d83c825a P 504e79e08a2f45bba278f82d3f886136: Deleting consensus metadata
I20260811 18:48:01.281167 7863 tablet_service.cc:1467] Processing CreateTablet for tablet 762ac96fa6f846a8b0d393f41d305cf1 (DEFAULT_TABLE table=test-table [id=1715da0c20f8480691d931e458786b4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:48:01.281674 7863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 762ac96fa6f846a8b0d393f41d305cf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:48:01.282202 7119 catalog_manager.cc:4841] TS 504e79e08a2f45bba278f82d3f886136 (127.25.25.3:34613): tablet b7ac5b2a49cc49ccbb9cd845d83c825a (table test-table [id=dc16ea5138474942a26785c1cb0efa99]) successfully deleted
I20260811 18:48:01.284375 8073 tablet_replica.cc:330] T b7ac5b2a49cc49ccbb9cd845d83c825a P d27622cce74344aba7dcedcce7f2cc28: stopping tablet replica
I20260811 18:48:01.284922 8073 raft_consensus.cc:2229] T b7ac5b2a49cc49ccbb9cd845d83c825a P d27622cce74344aba7dcedcce7f2cc28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:48:01.285578 8073 raft_consensus.cc:2258] T b7ac5b2a49cc49ccbb9cd845d83c825a P d27622cce74344aba7dcedcce7f2cc28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:48:01.285625 8021 tablet_bootstrap.cc:492] T 762ac96fa6f846a8b0d393f41d305cf1 P c5efdbece203419ba8936c49cacd3c8c: Bootstrap starting.
I20260811 18:48:01.286586 8069 tablet_replica.cc:330] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c: stopping tablet replica
I20260811 18:48:01.287492 8021 tablet_bootstrap.cc:654] T 762ac96fa6f846a8b0d393f41d305cf1 P c5efdbece203419ba8936c49cacd3c8c: Neither blocks nor log segments found. Creating new log.
I20260811 18:48:01.288587 8069 raft_consensus.cc:2229] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:48:01.288791 8026 tablet_bootstrap.cc:492] T 762ac96fa6f846a8b0d393f41d305cf1 P 504e79e08a2f45bba278f82d3f886136: Bootstrap starting.
I20260811 18:48:01.289377 8069 raft_consensus.cc:2258] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:48:01.290442 8023 tablet_bootstrap.cc:492] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28: Bootstrap starting.
I20260811 18:48:01.290493 8026 tablet_bootstrap.cc:654] T 762ac96fa6f846a8b0d393f41d305cf1 P 504e79e08a2f45bba278f82d3f886136: Neither blocks nor log segments found. Creating new log.
I20260811 18:48:01.292366 8023 tablet_bootstrap.cc:654] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28: Neither blocks nor log segments found. Creating new log.
I20260811 18:48:01.296465 8023 tablet_bootstrap.cc:492] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28: No bootstrap required, opened a new log
I20260811 18:48:01.296674 8023 ts_tablet_manager.cc:1397] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 18:48:01.296705 8021 tablet_bootstrap.cc:492] T 762ac96fa6f846a8b0d393f41d305cf1 P c5efdbece203419ba8936c49cacd3c8c: No bootstrap required, opened a new log
I20260811 18:48:01.296852 8021 ts_tablet_manager.cc:1397] T 762ac96fa6f846a8b0d393f41d305cf1 P c5efdbece203419ba8936c49cacd3c8c: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.008s
I20260811 18:48:01.297314 8069 ts_tablet_manager.cc:1905] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:48:01.297574 8023 raft_consensus.cc:348] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:01.297650 8021 raft_consensus.cc:348] T 762ac96fa6f846a8b0d393f41d305cf1 P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:01.297827 8023 raft_consensus.cc:374] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:48:01.297854 8021 raft_consensus.cc:374] T 762ac96fa6f846a8b0d393f41d305cf1 P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:48:01.297925 8023 raft_consensus.cc:729] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d27622cce74344aba7dcedcce7f2cc28, State: Initialized, Role: FOLLOWER
I20260811 18:48:01.297972 8021 raft_consensus.cc:729] T 762ac96fa6f846a8b0d393f41d305cf1 P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5efdbece203419ba8936c49cacd3c8c, State: Initialized, Role: FOLLOWER
I20260811 18:48:01.298273 8021 consensus_queue.cc:260] T 762ac96fa6f846a8b0d393f41d305cf1 P c5efdbece203419ba8936c49cacd3c8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:01.298270 8023 consensus_queue.cc:260] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:01.298784 8073 ts_tablet_manager.cc:1905] T b7ac5b2a49cc49ccbb9cd845d83c825a P d27622cce74344aba7dcedcce7f2cc28: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:48:01.300405 8021 ts_tablet_manager.cc:1428] T 762ac96fa6f846a8b0d393f41d305cf1 P c5efdbece203419ba8936c49cacd3c8c: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260811 18:48:01.301412 8026 tablet_bootstrap.cc:492] T 762ac96fa6f846a8b0d393f41d305cf1 P 504e79e08a2f45bba278f82d3f886136: No bootstrap required, opened a new log
I20260811 18:48:01.301585 8026 ts_tablet_manager.cc:1397] T 762ac96fa6f846a8b0d393f41d305cf1 P 504e79e08a2f45bba278f82d3f886136: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.004s
I20260811 18:48:01.302444 8026 raft_consensus.cc:348] T 762ac96fa6f846a8b0d393f41d305cf1 P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:01.302747 8026 raft_consensus.cc:374] T 762ac96fa6f846a8b0d393f41d305cf1 P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:48:01.302855 8026 raft_consensus.cc:729] T 762ac96fa6f846a8b0d393f41d305cf1 P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 504e79e08a2f45bba278f82d3f886136, State: Initialized, Role: FOLLOWER
I20260811 18:48:01.303231 8026 consensus_queue.cc:260] T 762ac96fa6f846a8b0d393f41d305cf1 P 504e79e08a2f45bba278f82d3f886136 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:01.306769 8026 ts_tablet_manager.cc:1428] T 762ac96fa6f846a8b0d393f41d305cf1 P 504e79e08a2f45bba278f82d3f886136: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260811 18:48:01.306785 8023 ts_tablet_manager.cc:1428] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260811 18:48:01.307883 8073 ts_tablet_manager.cc:1918] T b7ac5b2a49cc49ccbb9cd845d83c825a P d27622cce74344aba7dcedcce7f2cc28: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:48:01.308197 8073 log.cc:1196] T b7ac5b2a49cc49ccbb9cd845d83c825a P d27622cce74344aba7dcedcce7f2cc28: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-1/wal/wals/b7ac5b2a49cc49ccbb9cd845d83c825a
I20260811 18:48:01.308909 8073 ts_tablet_manager.cc:1939] T b7ac5b2a49cc49ccbb9cd845d83c825a P d27622cce74344aba7dcedcce7f2cc28: Deleting consensus metadata
I20260811 18:48:01.311108 7118 catalog_manager.cc:4841] TS d27622cce74344aba7dcedcce7f2cc28 (127.25.25.2:45963): tablet b7ac5b2a49cc49ccbb9cd845d83c825a (table test-table [id=dc16ea5138474942a26785c1cb0efa99]) successfully deleted
I20260811 18:48:01.313104 8069 ts_tablet_manager.cc:1918] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:48:01.313287 8069 log.cc:1196] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-0/wal/wals/b7ac5b2a49cc49ccbb9cd845d83c825a
I20260811 18:48:01.313748 8069 ts_tablet_manager.cc:1939] T b7ac5b2a49cc49ccbb9cd845d83c825a P c5efdbece203419ba8936c49cacd3c8c: Deleting consensus metadata
I20260811 18:48:01.315506 7115 catalog_manager.cc:4841] TS c5efdbece203419ba8936c49cacd3c8c (127.25.25.1:41681): tablet b7ac5b2a49cc49ccbb9cd845d83c825a (table test-table [id=dc16ea5138474942a26785c1cb0efa99]) successfully deleted
W20260811 18:48:01.377835 7761 tablet.cc:2369] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:48:01.545845 7509 tablet.cc:2369] T 762ac96fa6f846a8b0d393f41d305cf1 P c5efdbece203419ba8936c49cacd3c8c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:48:01.619943 8038 raft_consensus.cc:482] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:48:01.620287 8038 raft_consensus.cc:504] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:01.622136 8038 leader_election.cc:288] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5efdbece203419ba8936c49cacd3c8c (127.25.25.1:41681), 504e79e08a2f45bba278f82d3f886136 (127.25.25.3:34613)
I20260811 18:48:01.631834 8014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.622696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:40365 (local address 127.25.25.3:34613)
0811 18:48:01.623105 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:01.623112 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:01.624611 (+ 1499us) server_negotiation.cc:407] Connection header received
0811 18:48:01.624863 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:01.624869 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:01.624956 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:01.625061 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:48:01.625850 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.626930 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.629297 (+ 2367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.630546 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.630693 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.630828 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:01.631434 (+ 606us) server_negotiation.cc:299] Negotiation successful
0811 18:48:01.631597 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251}
I20260811 18:48:01.632479 8080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.622437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:41681 (local address 127.25.25.2:42327)
0811 18:48:01.624145 (+ 1708us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:01.624170 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:01.624447 (+ 277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:01.624913 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:01.624918 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:01.624944 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:48:01.625418 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:01.625430 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.627074 (+ 1644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.627079 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:01.629553 (+ 2474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:01.629572 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.631518 (+ 1946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.631527 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:01.631712 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.631749 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 18:48:01.631864 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 18:48:01.632015 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1531,"mutex_wait_us":75,"spinlock_wait_cycles":38784,"thread_start_us":1719,"threads_started":1}
I20260811 18:48:01.633011 8079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.622495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:34613 (local address 127.25.25.2:40365)
0811 18:48:01.624509 (+ 2014us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:01.624526 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:01.624702 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:01.625101 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:01.625110 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:01.625173 (+ 63us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:48:01.625662 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:01.625678 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.627097 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.627101 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:01.629132 (+ 2031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:01.629153 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.631004 (+ 1851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.631012 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:01.631214 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.631256 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 18:48:01.632320 (+ 1064us) client_negotiation.cc:240] Negotiation successful
0811 18:48:01.632483 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1870,"mutex_wait_us":58,"spinlock_wait_cycles":6784,"thread_start_us":1285,"threads_started":1}
I20260811 18:48:01.633072 8020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.623276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:42327 (local address 127.25.25.1:41681)
0811 18:48:01.623501 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:01.623509 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:01.624297 (+ 788us) server_negotiation.cc:407] Connection header received
0811 18:48:01.624655 (+ 358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:01.624665 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:01.624759 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:01.624874 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:48:01.625627 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.626888 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.629738 (+ 2850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.631205 (+ 1467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.631401 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.631518 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:01.631915 (+ 397us) server_negotiation.cc:299] Negotiation successful
0811 18:48:01.632714 (+ 799us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 18:48:01.633808 7903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "762ac96fa6f846a8b0d393f41d305cf1" candidate_uuid: "d27622cce74344aba7dcedcce7f2cc28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504e79e08a2f45bba278f82d3f886136" is_pre_election: true
I20260811 18:48:01.634109 7903 raft_consensus.cc:2454] T 762ac96fa6f846a8b0d393f41d305cf1 P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d27622cce74344aba7dcedcce7f2cc28 in term 0.
I20260811 18:48:01.634138 7415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "762ac96fa6f846a8b0d393f41d305cf1" candidate_uuid: "d27622cce74344aba7dcedcce7f2cc28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5efdbece203419ba8936c49cacd3c8c" is_pre_election: true
I20260811 18:48:01.634649 7415 raft_consensus.cc:2454] T 762ac96fa6f846a8b0d393f41d305cf1 P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d27622cce74344aba7dcedcce7f2cc28 in term 0.
I20260811 18:48:01.634708 7552 leader_election.cc:302] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 504e79e08a2f45bba278f82d3f886136, d27622cce74344aba7dcedcce7f2cc28; no voters:
I20260811 18:48:01.635215 8038 raft_consensus.cc:2781] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:48:01.635362 8038 raft_consensus.cc:482] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:48:01.635488 8038 raft_consensus.cc:3037] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:48:01.639005 8038 raft_consensus.cc:504] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:01.639932 8038 leader_election.cc:288] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28 [CANDIDATE]: Term 1 election: Requested vote from peers c5efdbece203419ba8936c49cacd3c8c (127.25.25.1:41681), 504e79e08a2f45bba278f82d3f886136 (127.25.25.3:34613)
I20260811 18:48:01.640581 7415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "762ac96fa6f846a8b0d393f41d305cf1" candidate_uuid: "d27622cce74344aba7dcedcce7f2cc28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5efdbece203419ba8936c49cacd3c8c"
I20260811 18:48:01.640587 7903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "762ac96fa6f846a8b0d393f41d305cf1" candidate_uuid: "d27622cce74344aba7dcedcce7f2cc28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504e79e08a2f45bba278f82d3f886136"
I20260811 18:48:01.640805 7415 raft_consensus.cc:3037] T 762ac96fa6f846a8b0d393f41d305cf1 P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:48:01.640846 7903 raft_consensus.cc:3037] T 762ac96fa6f846a8b0d393f41d305cf1 P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:48:01.643378 7415 raft_consensus.cc:2454] T 762ac96fa6f846a8b0d393f41d305cf1 P c5efdbece203419ba8936c49cacd3c8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d27622cce74344aba7dcedcce7f2cc28 in term 1.
I20260811 18:48:01.643846 7903 raft_consensus.cc:2454] T 762ac96fa6f846a8b0d393f41d305cf1 P 504e79e08a2f45bba278f82d3f886136 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d27622cce74344aba7dcedcce7f2cc28 in term 1.
I20260811 18:48:01.643872 7549 leader_election.cc:302] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5efdbece203419ba8936c49cacd3c8c, d27622cce74344aba7dcedcce7f2cc28; no voters:
I20260811 18:48:01.644255 8038 raft_consensus.cc:2781] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:48:01.644784 8038 raft_consensus.cc:686] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28 [term 1 LEADER]: Becoming Leader. State: Replica: d27622cce74344aba7dcedcce7f2cc28, State: Running, Role: LEADER
I20260811 18:48:01.645190 8038 consensus_queue.cc:237] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:01.649108 7145 catalog_manager.cc:5495] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28 reported cstate change: term changed from 0 to 1, leader changed from <none> to d27622cce74344aba7dcedcce7f2cc28 (127.25.25.2). New cstate: current_term: 1 leader_uuid: "d27622cce74344aba7dcedcce7f2cc28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } health_report { overall_health: UNKNOWN } } }
Aug 11 18:48:01 dist-test-slave-lgr5 krb5kdc[7065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474079, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.62@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM
I20260811 18:48:01.704809 8093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.690647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40933 (local address 127.0.0.1:46152)
0811 18:48:01.691354 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:01.691378 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:01.691545 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:01.691999 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:01.692020 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:01.692718 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:01.692946 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:01.692957 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.694038 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.694042 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:01.695047 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:01.695062 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.695768 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.695774 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:01.695956 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.696707 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:01.696733 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:01.699142 (+ 2409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:48:01.702188 (+ 3046us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:48:01.702203 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:48:01.702211 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:48:01.702654 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:48:01.703022 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:48:01.703027 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:48:01.703031 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:48:01.703183 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:48:01.703703 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:48:01.703711 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:48:01.703899 (+ 188us) client_negotiation.cc:769] Sending connection context
0811 18:48:01.704055 (+ 156us) client_negotiation.cc:240] Negotiation successful
0811 18:48:01.704394 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":356,"threads_started":1}
I20260811 18:48:01.705175 8095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.690720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46152 (local address 127.25.25.62:40933)
0811 18:48:01.691719 (+ 999us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:01.691722 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:01.691739 (+ 17us) server_negotiation.cc:407] Connection header received
0811 18:48:01.691783 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:01.691786 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:01.691841 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:01.691930 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:01.693102 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.693897 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.695202 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.695599 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.695708 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.699374 (+ 3666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:01.699379 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:01.699382 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:01.699414 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:01.702060 (+ 2646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:01.702768 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:01.702774 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:01.702776 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:01.702898 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:01.703282 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:01.703287 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:01.703291 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:01.703573 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:01.703727 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:01.704184 (+ 457us) server_negotiation.cc:299] Negotiation successful
0811 18:48:01.704546 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":144,"server-negotiator.queue_time_us":879,"thread_start_us":671,"threads_started":1}
I20260811 18:48:01.710574 7145 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:46152:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 18:48:01.711681 7145 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:48:01.718761 7375 tablet_service.cc:1467] Processing CreateTablet for tablet 5a9ab4ee25ac4598bbcb7a4180ad88e9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d3f2cf2bcbe64b77924ece56829ece42]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:48:01.718830 7634 tablet_service.cc:1467] Processing CreateTablet for tablet 5a9ab4ee25ac4598bbcb7a4180ad88e9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d3f2cf2bcbe64b77924ece56829ece42]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:48:01.718879 7863 tablet_service.cc:1467] Processing CreateTablet for tablet 5a9ab4ee25ac4598bbcb7a4180ad88e9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d3f2cf2bcbe64b77924ece56829ece42]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:48:01.719381 7375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a9ab4ee25ac4598bbcb7a4180ad88e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:48:01.719390 7634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a9ab4ee25ac4598bbcb7a4180ad88e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:48:01.719408 7863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a9ab4ee25ac4598bbcb7a4180ad88e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:48:01.725445 8021 tablet_bootstrap.cc:492] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P c5efdbece203419ba8936c49cacd3c8c: Bootstrap starting.
I20260811 18:48:01.726532 8026 tablet_bootstrap.cc:492] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136: Bootstrap starting.
I20260811 18:48:01.727061 8021 tablet_bootstrap.cc:654] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P c5efdbece203419ba8936c49cacd3c8c: Neither blocks nor log segments found. Creating new log.
I20260811 18:48:01.728312 8026 tablet_bootstrap.cc:654] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136: Neither blocks nor log segments found. Creating new log.
I20260811 18:48:01.729355 8023 tablet_bootstrap.cc:492] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P d27622cce74344aba7dcedcce7f2cc28: Bootstrap starting.
I20260811 18:48:01.729375 8021 tablet_bootstrap.cc:492] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P c5efdbece203419ba8936c49cacd3c8c: No bootstrap required, opened a new log
I20260811 18:48:01.729570 8021 ts_tablet_manager.cc:1397] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P c5efdbece203419ba8936c49cacd3c8c: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260811 18:48:01.730386 8021 raft_consensus.cc:348] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:01.730688 8021 raft_consensus.cc:374] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:48:01.730775 8021 raft_consensus.cc:729] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5efdbece203419ba8936c49cacd3c8c, State: Initialized, Role: FOLLOWER
I20260811 18:48:01.731079 8023 tablet_bootstrap.cc:654] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P d27622cce74344aba7dcedcce7f2cc28: Neither blocks nor log segments found. Creating new log.
I20260811 18:48:01.731030 8021 consensus_queue.cc:260] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P c5efdbece203419ba8936c49cacd3c8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:01.731657 8021 ts_tablet_manager.cc:1428] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P c5efdbece203419ba8936c49cacd3c8c: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 18:48:01.731511 8044 tablet_replica.cc:439] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P c5efdbece203419ba8936c49cacd3c8c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } } }
I20260811 18:48:01.731828 8044 tablet_replica.cc:442] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P c5efdbece203419ba8936c49cacd3c8c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:48:01.733299 8026 tablet_bootstrap.cc:492] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136: No bootstrap required, opened a new log
I20260811 18:48:01.733422 8023 tablet_bootstrap.cc:492] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P d27622cce74344aba7dcedcce7f2cc28: No bootstrap required, opened a new log
I20260811 18:48:01.733500 8026 ts_tablet_manager.cc:1397] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.003s
I20260811 18:48:01.733595 8023 ts_tablet_manager.cc:1397] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P d27622cce74344aba7dcedcce7f2cc28: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260811 18:48:01.734251 8026 raft_consensus.cc:348] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:01.734319 8023 raft_consensus.cc:348] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:01.734478 8026 raft_consensus.cc:374] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:48:01.734565 8026 raft_consensus.cc:729] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 504e79e08a2f45bba278f82d3f886136, State: Initialized, Role: FOLLOWER
I20260811 18:48:01.734568 8023 raft_consensus.cc:374] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:48:01.734642 8023 raft_consensus.cc:729] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d27622cce74344aba7dcedcce7f2cc28, State: Initialized, Role: FOLLOWER
I20260811 18:48:01.734809 8026 consensus_queue.cc:260] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:01.734866 8023 consensus_queue.cc:260] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P d27622cce74344aba7dcedcce7f2cc28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:01.735365 8026 ts_tablet_manager.cc:1428] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 18:48:01.735424 8023 ts_tablet_manager.cc:1428] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P d27622cce74344aba7dcedcce7f2cc28: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:48:01.735288 8038 tablet_replica.cc:439] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P d27622cce74344aba7dcedcce7f2cc28: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } } }
I20260811 18:48:01.735276 8039 tablet_replica.cc:439] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } } }
I20260811 18:48:01.735592 8038 tablet_replica.cc:442] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P d27622cce74344aba7dcedcce7f2cc28: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:48:01.735622 8039 tablet_replica.cc:442] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:48:01.808777 8039 raft_consensus.cc:482] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:48:01.809008 8039 raft_consensus.cc:504] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:01.810598 8039 leader_election.cc:288] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5efdbece203419ba8936c49cacd3c8c (127.25.25.1:41681), d27622cce74344aba7dcedcce7f2cc28 (127.25.25.2:45963)
I20260811 18:48:01.818621 8020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.810954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:57593 (local address 127.25.25.1:41681)
0811 18:48:01.811166 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:01.811173 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:01.811628 (+ 455us) server_negotiation.cc:407] Connection header received
0811 18:48:01.812260 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:01.812266 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:01.812333 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:01.812432 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:48:01.812934 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.813970 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.816337 (+ 2367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.817559 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.817707 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.817822 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:01.818167 (+ 345us) server_negotiation.cc:299] Negotiation successful
0811 18:48:01.818328 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 18:48:01.818653 8105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.811105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:46201 (local address 127.25.25.2:45963)
0811 18:48:01.812049 (+ 944us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:01.812055 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:01.812386 (+ 331us) server_negotiation.cc:407] Connection header received
0811 18:48:01.812524 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:01.812529 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:01.812603 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:01.812681 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:48:01.813207 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.814233 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.816512 (+ 2279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.817706 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.817827 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.817929 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:01.818191 (+ 262us) server_negotiation.cc:299] Negotiation successful
0811 18:48:01.818335 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":828,"thread_start_us":732,"threads_started":1}
I20260811 18:48:01.818683 8104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.810826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:41681 (local address 127.25.25.3:57593)
0811 18:48:01.811503 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:01.811530 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:01.812049 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:01.812475 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:01.812481 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:01.812505 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:48:01.812746 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:01.812758 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.814106 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.814110 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:01.816151 (+ 2041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:01.816174 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.817752 (+ 1578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.817757 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:01.817975 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.818014 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 18:48:01.818112 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 18:48:01.818265 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":1258,"threads_started":1}
I20260811 18:48:01.818730 8103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.810871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:45963 (local address 127.25.25.3:46201)
0811 18:48:01.812283 (+ 1412us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:01.812299 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:01.812416 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:01.812736 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:01.812740 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:01.812762 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:48:01.813062 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:01.813071 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.814350 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.814354 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:01.816367 (+ 2013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:01.816377 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.817894 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.817900 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:01.818054 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.818081 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 18:48:01.818154 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 18:48:01.818268 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1299,"thread_start_us":408,"threads_started":1}
I20260811 18:48:01.819439 7415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a9ab4ee25ac4598bbcb7a4180ad88e9" candidate_uuid: "504e79e08a2f45bba278f82d3f886136" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5efdbece203419ba8936c49cacd3c8c" is_pre_election: true
I20260811 18:48:01.819702 7415 raft_consensus.cc:2454] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 504e79e08a2f45bba278f82d3f886136 in term 0.
I20260811 18:48:01.819710 7678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a9ab4ee25ac4598bbcb7a4180ad88e9" candidate_uuid: "504e79e08a2f45bba278f82d3f886136" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27622cce74344aba7dcedcce7f2cc28" is_pre_election: true
I20260811 18:48:01.819977 7678 raft_consensus.cc:2454] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 504e79e08a2f45bba278f82d3f886136 in term 0.
I20260811 18:48:01.820266 7791 leader_election.cc:302] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 504e79e08a2f45bba278f82d3f886136, c5efdbece203419ba8936c49cacd3c8c; no voters:
I20260811 18:48:01.820748 8039 raft_consensus.cc:2781] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:48:01.820892 8039 raft_consensus.cc:482] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:48:01.821002 8039 raft_consensus.cc:3037] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:48:01.823508 8039 raft_consensus.cc:504] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:01.824314 8039 leader_election.cc:288] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136 [CANDIDATE]: Term 1 election: Requested vote from peers c5efdbece203419ba8936c49cacd3c8c (127.25.25.1:41681), d27622cce74344aba7dcedcce7f2cc28 (127.25.25.2:45963)
I20260811 18:48:01.824797 7415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a9ab4ee25ac4598bbcb7a4180ad88e9" candidate_uuid: "504e79e08a2f45bba278f82d3f886136" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5efdbece203419ba8936c49cacd3c8c"
I20260811 18:48:01.825047 7415 raft_consensus.cc:3037] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:48:01.825006 7678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a9ab4ee25ac4598bbcb7a4180ad88e9" candidate_uuid: "504e79e08a2f45bba278f82d3f886136" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27622cce74344aba7dcedcce7f2cc28"
I20260811 18:48:01.825244 7678 raft_consensus.cc:3037] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:48:01.827247 7415 raft_consensus.cc:2454] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P c5efdbece203419ba8936c49cacd3c8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 504e79e08a2f45bba278f82d3f886136 in term 1.
I20260811 18:48:01.827479 7678 raft_consensus.cc:2454] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P d27622cce74344aba7dcedcce7f2cc28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 504e79e08a2f45bba278f82d3f886136 in term 1.
I20260811 18:48:01.827836 7791 leader_election.cc:302] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 504e79e08a2f45bba278f82d3f886136, c5efdbece203419ba8936c49cacd3c8c; no voters:
I20260811 18:48:01.828260 8039 raft_consensus.cc:2781] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:48:01.828725 8039 raft_consensus.cc:686] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136 [term 1 LEADER]: Becoming Leader. State: Replica: 504e79e08a2f45bba278f82d3f886136, State: Running, Role: LEADER
I20260811 18:48:01.829336 8039 consensus_queue.cc:237] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:01.831480 8106 tablet_replica.cc:439] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136: TxnStatusTablet state changed. Reason: New leader 504e79e08a2f45bba278f82d3f886136. Latest consensus state: current_term: 1 leader_uuid: "504e79e08a2f45bba278f82d3f886136" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } } }
I20260811 18:48:01.831884 8106 tablet_replica.cc:442] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:48:01.832770 8110 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 18:48:01.832989 8110 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 18:48:01.833413 7143 catalog_manager.cc:5495] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136 reported cstate change: term changed from 0 to 1, leader changed from <none> to 504e79e08a2f45bba278f82d3f886136 (127.25.25.3). New cstate: current_term: 1 leader_uuid: "504e79e08a2f45bba278f82d3f886136" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } health_report { overall_health: HEALTHY } } }
I20260811 18:48:01.863128 8014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.857161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39356 (local address 127.25.25.3:34613)
0811 18:48:01.857338 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:01.857344 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:01.857575 (+ 231us) server_negotiation.cc:407] Connection header received
0811 18:48:01.857872 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:01.857876 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:01.857971 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:01.858102 (+ 131us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:48:01.858500 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.859286 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.860714 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.861211 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.861324 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.861811 (+ 487us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:48:01.862451 (+ 640us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:48:01.862619 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:01.862767 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 18:48:01.862849 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 18:48:01.863281 8093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.857222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:34613 (local address 127.0.0.1:39356)
0811 18:48:01.857478 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:01.857495 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:01.857662 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:01.858160 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:01.858164 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:01.858178 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:48:01.858356 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:01.858365 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.859438 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.859444 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:01.860565 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:01.860581 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.861374 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.861380 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:01.861549 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.861615 (+ 66us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:48:01.862615 (+ 1000us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:48:01.862646 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 18:48:01.862742 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 18:48:01.862926 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 18:48:01.868448 7678 raft_consensus.cc:1261] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P d27622cce74344aba7dcedcce7f2cc28 [term 1 FOLLOWER]: Refusing update from remote peer 504e79e08a2f45bba278f82d3f886136: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:48:01.868813 7415 raft_consensus.cc:1261] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P c5efdbece203419ba8936c49cacd3c8c [term 1 FOLLOWER]: Refusing update from remote peer 504e79e08a2f45bba278f82d3f886136: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:48:01.869324 8039 consensus_queue.cc:1035] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:48:01.869589 8106 consensus_queue.cc:1035] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:48:01.873967 8038 tablet_replica.cc:439] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P d27622cce74344aba7dcedcce7f2cc28: TxnStatusTablet state changed. Reason: New leader 504e79e08a2f45bba278f82d3f886136. Latest consensus state: current_term: 1 leader_uuid: "504e79e08a2f45bba278f82d3f886136" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } } }
I20260811 18:48:01.874326 8038 tablet_replica.cc:442] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P d27622cce74344aba7dcedcce7f2cc28: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:48:01.876166 8044 tablet_replica.cc:439] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P c5efdbece203419ba8936c49cacd3c8c: TxnStatusTablet state changed. Reason: New leader 504e79e08a2f45bba278f82d3f886136. Latest consensus state: current_term: 1 leader_uuid: "504e79e08a2f45bba278f82d3f886136" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } } }
I20260811 18:48:01.876485 8044 tablet_replica.cc:442] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P c5efdbece203419ba8936c49cacd3c8c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:48:01.878974 8120 mvcc.cc:205] Tried to move back new op lower bound from 7317397839325192192 to 7317397839177236480. Current Snapshot: MvccSnapshot[applied={T|T < 7317397839325192192}]
I20260811 18:48:01.880800 8044 tablet_replica.cc:439] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P c5efdbece203419ba8936c49cacd3c8c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "504e79e08a2f45bba278f82d3f886136" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } } }
I20260811 18:48:01.881084 8044 tablet_replica.cc:442] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P c5efdbece203419ba8936c49cacd3c8c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:48:01.884671 8117 mvcc.cc:205] Tried to move back new op lower bound from 7317397839325192192 to 7317397839177236480. Current Snapshot: MvccSnapshot[applied={T|T < 7317397839325192192}]
I20260811 18:48:01.888151 8106 tablet_replica.cc:439] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "504e79e08a2f45bba278f82d3f886136" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } } }
I20260811 18:48:01.888448 8106 tablet_replica.cc:442] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:48:01.888763 8038 tablet_replica.cc:439] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P d27622cce74344aba7dcedcce7f2cc28: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "504e79e08a2f45bba278f82d3f886136" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } } }
I20260811 18:48:01.889056 8038 tablet_replica.cc:442] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P d27622cce74344aba7dcedcce7f2cc28: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:48:01.889752 8106 tablet_replica.cc:439] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "504e79e08a2f45bba278f82d3f886136" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } } }
I20260811 18:48:01.890003 8106 tablet_replica.cc:442] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:48:01.899811 8105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.893190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57696 (local address 127.25.25.2:45963)
0811 18:48:01.893539 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:01.893545 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:01.893895 (+ 350us) server_negotiation.cc:407] Connection header received
0811 18:48:01.894103 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:01.894107 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:01.894196 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:01.894322 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:48:01.894824 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.895587 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.897607 (+ 2020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.898021 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.898121 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.898638 (+ 517us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:48:01.899221 (+ 583us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:48:01.899333 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:01.899473 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 18:48:01.899554 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192}
I20260811 18:48:01.917502 8014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.911105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:37167 (local address 127.25.25.3:34613)
0811 18:48:01.911316 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:01.911324 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:01.911808 (+ 484us) server_negotiation.cc:407] Connection header received
0811 18:48:01.912037 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:01.912041 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:01.912149 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:01.912224 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:48:01.912801 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.913555 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.915646 (+ 2091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.916161 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.916259 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.916831 (+ 572us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:48:01.916959 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:48:01.917027 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:01.917155 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 18:48:01.917230 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 18:48:01.917711 8137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.911039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:34613 (local address 127.25.25.2:37167)
0811 18:48:01.911704 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:01.911724 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:01.911910 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:01.912256 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:01.912262 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:01.912276 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:48:01.912640 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:01.912653 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.913679 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.913685 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:01.915477 (+ 1792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:01.915495 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.916344 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.916351 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:01.916532 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.916616 (+ 84us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:48:01.917046 (+ 430us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:48:01.917058 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 18:48:01.917141 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 18:48:01.917304 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":331,"threads_started":1}
I20260811 18:48:01.929368 7415 raft_consensus.cc:1261] T 762ac96fa6f846a8b0d393f41d305cf1 P c5efdbece203419ba8936c49cacd3c8c [term 1 FOLLOWER]: Refusing update from remote peer d27622cce74344aba7dcedcce7f2cc28: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:48:01.929366 7903 raft_consensus.cc:1261] T 762ac96fa6f846a8b0d393f41d305cf1 P 504e79e08a2f45bba278f82d3f886136 [term 1 FOLLOWER]: Refusing update from remote peer d27622cce74344aba7dcedcce7f2cc28: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:48:01.930148 8081 consensus_queue.cc:1035] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:48:01.930887 8038 consensus_queue.cc:1035] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:48:01.995326 8105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.976579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:52597 (local address 127.25.25.2:45963)
0811 18:48:01.978854 (+ 2275us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:01.978859 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:01.988956 (+ 10097us) server_negotiation.cc:407] Connection header received
0811 18:48:01.989201 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:01.989207 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:01.989325 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:01.989419 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:48:01.990370 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.991470 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.993348 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.993886 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.994034 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.994541 (+ 507us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:48:01.994661 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:48:01.994736 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:01.994885 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 18:48:01.994973 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2125}
I20260811 18:48:01.995580 8149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:01.974839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:45963 (local address 127.25.25.3:52597)
0811 18:48:01.988804 (+ 13965us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:01.988829 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:01.989034 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:01.989618 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:01.989623 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:01.989636 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:48:01.990136 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:01.990152 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.991651 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.991657 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:01.993168 (+ 1511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:01.993186 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:01.994126 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:01.994132 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:01.994270 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:01.994337 (+ 67us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:48:01.994761 (+ 424us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:48:01.994772 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 18:48:01.994847 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 18:48:01.995163 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13708,"thread_start_us":13478,"threads_started":1}
I20260811 18:48:02.046298 7142 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46150:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:48:02.046588 7142 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46150:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:48:02.050678 7142 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bf841b3c6e4342d5bf1eaca79cd3616b: Sending DeleteTablet for 3 replicas of tablet 762ac96fa6f846a8b0d393f41d305cf1
I20260811 18:48:02.051782 7375 tablet_service.cc:1514] Processing DeleteTablet for tablet 762ac96fa6f846a8b0d393f41d305cf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:48:02 UTC) from {username='oryx', principal='oryx/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:34020
I20260811 18:48:02.052229 7863 tablet_service.cc:1514] Processing DeleteTablet for tablet 762ac96fa6f846a8b0d393f41d305cf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:48:02 UTC) from {username='oryx', principal='oryx/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:39346
I20260811 18:48:02.053257 8155 tablet_replica.cc:330] T 762ac96fa6f846a8b0d393f41d305cf1 P c5efdbece203419ba8936c49cacd3c8c: stopping tablet replica
I20260811 18:48:02.053355 7634 tablet_service.cc:1514] Processing DeleteTablet for tablet 762ac96fa6f846a8b0d393f41d305cf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:48:02 UTC) from {username='oryx', principal='oryx/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:57690
I20260811 18:48:02.053550 8155 raft_consensus.cc:2229] T 762ac96fa6f846a8b0d393f41d305cf1 P c5efdbece203419ba8936c49cacd3c8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:48:02.053830 8155 raft_consensus.cc:2258] T 762ac96fa6f846a8b0d393f41d305cf1 P c5efdbece203419ba8936c49cacd3c8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:48:02.055305 8155 ts_tablet_manager.cc:1905] T 762ac96fa6f846a8b0d393f41d305cf1 P c5efdbece203419ba8936c49cacd3c8c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:48:02.063966 8155 ts_tablet_manager.cc:1918] T 762ac96fa6f846a8b0d393f41d305cf1 P c5efdbece203419ba8936c49cacd3c8c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:48:02.064231 8155 log.cc:1196] T 762ac96fa6f846a8b0d393f41d305cf1 P c5efdbece203419ba8936c49cacd3c8c: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-0/wal/wals/762ac96fa6f846a8b0d393f41d305cf1
I20260811 18:48:02.064394 8158 tablet_replica.cc:330] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28: stopping tablet replica
I20260811 18:48:02.064836 8155 ts_tablet_manager.cc:1939] T 762ac96fa6f846a8b0d393f41d305cf1 P c5efdbece203419ba8936c49cacd3c8c: Deleting consensus metadata
I20260811 18:48:02.066167 7115 catalog_manager.cc:4841] TS c5efdbece203419ba8936c49cacd3c8c (127.25.25.1:41681): tablet 762ac96fa6f846a8b0d393f41d305cf1 (table test-table [id=1715da0c20f8480691d931e458786b4f]) successfully deleted
I20260811 18:48:02.068370 8158 raft_consensus.cc:2229] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:48:02.069298 8158 raft_consensus.cc:2258] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:48:02.070802 8158 ts_tablet_manager.cc:1905] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:48:02.071456 8156 tablet_replica.cc:330] T 762ac96fa6f846a8b0d393f41d305cf1 P 504e79e08a2f45bba278f82d3f886136: stopping tablet replica
I20260811 18:48:02.071849 8156 raft_consensus.cc:2229] T 762ac96fa6f846a8b0d393f41d305cf1 P 504e79e08a2f45bba278f82d3f886136 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:48:02.072283 8156 raft_consensus.cc:2258] T 762ac96fa6f846a8b0d393f41d305cf1 P 504e79e08a2f45bba278f82d3f886136 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:48:02.075167 8156 ts_tablet_manager.cc:1905] T 762ac96fa6f846a8b0d393f41d305cf1 P 504e79e08a2f45bba278f82d3f886136: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:48:02.090587 8158 ts_tablet_manager.cc:1918] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:48:02.092428 8156 ts_tablet_manager.cc:1918] T 762ac96fa6f846a8b0d393f41d305cf1 P 504e79e08a2f45bba278f82d3f886136: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:48:02.092736 8158 log.cc:1196] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-1/wal/wals/762ac96fa6f846a8b0d393f41d305cf1
I20260811 18:48:02.093338 8158 ts_tablet_manager.cc:1939] T 762ac96fa6f846a8b0d393f41d305cf1 P d27622cce74344aba7dcedcce7f2cc28: Deleting consensus metadata
I20260811 18:48:02.094766 7118 catalog_manager.cc:4841] TS d27622cce74344aba7dcedcce7f2cc28 (127.25.25.2:45963): tablet 762ac96fa6f846a8b0d393f41d305cf1 (table test-table [id=1715da0c20f8480691d931e458786b4f]) successfully deleted
I20260811 18:48:02.095194 8156 log.cc:1196] T 762ac96fa6f846a8b0d393f41d305cf1 P 504e79e08a2f45bba278f82d3f886136: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-2/wal/wals/762ac96fa6f846a8b0d393f41d305cf1
I20260811 18:48:02.095821 8156 ts_tablet_manager.cc:1939] T 762ac96fa6f846a8b0d393f41d305cf1 P 504e79e08a2f45bba278f82d3f886136: Deleting consensus metadata
I20260811 18:48:02.097347 7119 catalog_manager.cc:4841] TS 504e79e08a2f45bba278f82d3f886136 (127.25.25.3:34613): tablet 762ac96fa6f846a8b0d393f41d305cf1 (table test-table [id=1715da0c20f8480691d931e458786b4f]) successfully deleted
Aug 11 18:48:02 dist-test-slave-lgr5 krb5kdc[7065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474082, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 18:48:02 dist-test-slave-lgr5 krb5kdc[7065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:02 dist-test-slave-lgr5 krb5kdc[7065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 18:48:02.149926 8095 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:02.135649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46156 (local address 127.25.25.62:40933)
0811 18:48:02.135845 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:02.135852 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:02.136450 (+ 598us) server_negotiation.cc:407] Connection header received
0811 18:48:02.136652 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:02.136658 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:02.136748 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:02.136868 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:02.138809 (+ 1941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:02.140024 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:02.141991 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:02.142684 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:02.142841 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:02.149646 (+ 6805us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46156: BlockingRecv error: recv got EOF from 127.0.0.1:46156 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 11 18:48:02 dist-test-slave-lgr5 krb5kdc[7065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474082, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM
I20260811 18:48:02.180671 8095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:02.154619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46168 (local address 127.25.25.62:40933)
0811 18:48:02.154815 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:02.154821 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:02.160908 (+ 6087us) server_negotiation.cc:407] Connection header received
0811 18:48:02.161117 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:02.161123 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:02.161223 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:02.161339 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:02.163097 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:02.164383 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:02.166428 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:02.167119 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:02.167270 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:02.172894 (+ 5624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:02.172904 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:02.172909 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:02.172972 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:02.176948 (+ 3976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:02.178074 (+ 1126us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:02.178082 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:02.178086 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:02.178301 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:02.178851 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:02.178856 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:02.178860 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:02.179267 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:02.179583 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:02.179949 (+ 366us) server_negotiation.cc:299] Negotiation successful
0811 18:48:02.180278 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 18:48:02.185101 7142 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46168:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:48:02.185913 7142 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:48:02.194537 7375 tablet_service.cc:1467] Processing CreateTablet for tablet a7a54f3437ea4dd1a0b318a9f32b7c2d (DEFAULT_TABLE table=test-table [id=42ea82dd5d844ce99826952c96ac9a4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:48:02.195138 7375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7a54f3437ea4dd1a0b318a9f32b7c2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:48:02.200634 7634 tablet_service.cc:1467] Processing CreateTablet for tablet a7a54f3437ea4dd1a0b318a9f32b7c2d (DEFAULT_TABLE table=test-table [id=42ea82dd5d844ce99826952c96ac9a4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:48:02.201237 7634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7a54f3437ea4dd1a0b318a9f32b7c2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:48:02.204639 7863 tablet_service.cc:1467] Processing CreateTablet for tablet a7a54f3437ea4dd1a0b318a9f32b7c2d (DEFAULT_TABLE table=test-table [id=42ea82dd5d844ce99826952c96ac9a4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:48:02.205247 7863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7a54f3437ea4dd1a0b318a9f32b7c2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:48:02.206465 8021 tablet_bootstrap.cc:492] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c: Bootstrap starting.
I20260811 18:48:02.208401 8021 tablet_bootstrap.cc:654] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c: Neither blocks nor log segments found. Creating new log.
I20260811 18:48:02.218621 8023 tablet_bootstrap.cc:492] T a7a54f3437ea4dd1a0b318a9f32b7c2d P d27622cce74344aba7dcedcce7f2cc28: Bootstrap starting.
I20260811 18:48:02.220590 8023 tablet_bootstrap.cc:654] T a7a54f3437ea4dd1a0b318a9f32b7c2d P d27622cce74344aba7dcedcce7f2cc28: Neither blocks nor log segments found. Creating new log.
I20260811 18:48:02.225243 8026 tablet_bootstrap.cc:492] T a7a54f3437ea4dd1a0b318a9f32b7c2d P 504e79e08a2f45bba278f82d3f886136: Bootstrap starting.
I20260811 18:48:02.227463 8026 tablet_bootstrap.cc:654] T a7a54f3437ea4dd1a0b318a9f32b7c2d P 504e79e08a2f45bba278f82d3f886136: Neither blocks nor log segments found. Creating new log.
I20260811 18:48:02.245289 8026 tablet_bootstrap.cc:492] T a7a54f3437ea4dd1a0b318a9f32b7c2d P 504e79e08a2f45bba278f82d3f886136: No bootstrap required, opened a new log
I20260811 18:48:02.245517 8026 ts_tablet_manager.cc:1397] T a7a54f3437ea4dd1a0b318a9f32b7c2d P 504e79e08a2f45bba278f82d3f886136: Time spent bootstrapping tablet: real 0.020s user 0.010s sys 0.000s
I20260811 18:48:02.246654 8026 raft_consensus.cc:348] T a7a54f3437ea4dd1a0b318a9f32b7c2d P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:02.246973 8026 raft_consensus.cc:374] T a7a54f3437ea4dd1a0b318a9f32b7c2d P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:48:02.247097 8026 raft_consensus.cc:729] T a7a54f3437ea4dd1a0b318a9f32b7c2d P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 504e79e08a2f45bba278f82d3f886136, State: Initialized, Role: FOLLOWER
I20260811 18:48:02.249701 8026 consensus_queue.cc:260] T a7a54f3437ea4dd1a0b318a9f32b7c2d P 504e79e08a2f45bba278f82d3f886136 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:02.250435 8026 ts_tablet_manager.cc:1428] T a7a54f3437ea4dd1a0b318a9f32b7c2d P 504e79e08a2f45bba278f82d3f886136: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260811 18:48:02.252070 8023 tablet_bootstrap.cc:492] T a7a54f3437ea4dd1a0b318a9f32b7c2d P d27622cce74344aba7dcedcce7f2cc28: No bootstrap required, opened a new log
I20260811 18:48:02.252377 8023 ts_tablet_manager.cc:1397] T a7a54f3437ea4dd1a0b318a9f32b7c2d P d27622cce74344aba7dcedcce7f2cc28: Time spent bootstrapping tablet: real 0.034s user 0.012s sys 0.001s
I20260811 18:48:02.253392 8023 raft_consensus.cc:348] T a7a54f3437ea4dd1a0b318a9f32b7c2d P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:02.253803 8023 raft_consensus.cc:374] T a7a54f3437ea4dd1a0b318a9f32b7c2d P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:48:02.253965 8023 raft_consensus.cc:729] T a7a54f3437ea4dd1a0b318a9f32b7c2d P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d27622cce74344aba7dcedcce7f2cc28, State: Initialized, Role: FOLLOWER
I20260811 18:48:02.254340 8023 consensus_queue.cc:260] T a7a54f3437ea4dd1a0b318a9f32b7c2d P d27622cce74344aba7dcedcce7f2cc28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:02.255208 8023 ts_tablet_manager.cc:1428] T a7a54f3437ea4dd1a0b318a9f32b7c2d P d27622cce74344aba7dcedcce7f2cc28: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 18:48:02.257192 8021 tablet_bootstrap.cc:492] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c: No bootstrap required, opened a new log
I20260811 18:48:02.257539 8021 ts_tablet_manager.cc:1397] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c: Time spent bootstrapping tablet: real 0.051s user 0.020s sys 0.023s
I20260811 18:48:02.258450 8021 raft_consensus.cc:348] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:02.258777 8021 raft_consensus.cc:374] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:48:02.258925 8021 raft_consensus.cc:729] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5efdbece203419ba8936c49cacd3c8c, State: Initialized, Role: FOLLOWER
I20260811 18:48:02.259246 8021 consensus_queue.cc:260] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:02.260057 8021 ts_tablet_manager.cc:1428] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 18:48:02.380888 8044 raft_consensus.cc:482] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:48:02.381160 8044 raft_consensus.cc:504] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:02.381938 8044 leader_election.cc:288] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d27622cce74344aba7dcedcce7f2cc28 (127.25.25.2:45963), 504e79e08a2f45bba278f82d3f886136 (127.25.25.3:34613)
I20260811 18:48:02.382678 7678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7a54f3437ea4dd1a0b318a9f32b7c2d" candidate_uuid: "c5efdbece203419ba8936c49cacd3c8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27622cce74344aba7dcedcce7f2cc28" is_pre_election: true
I20260811 18:48:02.383021 7678 raft_consensus.cc:2454] T a7a54f3437ea4dd1a0b318a9f32b7c2d P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5efdbece203419ba8936c49cacd3c8c in term 0.
I20260811 18:48:02.383018 7903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7a54f3437ea4dd1a0b318a9f32b7c2d" candidate_uuid: "c5efdbece203419ba8936c49cacd3c8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504e79e08a2f45bba278f82d3f886136" is_pre_election: true
I20260811 18:48:02.383277 7903 raft_consensus.cc:2454] T a7a54f3437ea4dd1a0b318a9f32b7c2d P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5efdbece203419ba8936c49cacd3c8c in term 0.
I20260811 18:48:02.383837 7292 leader_election.cc:302] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5efdbece203419ba8936c49cacd3c8c, d27622cce74344aba7dcedcce7f2cc28; no voters:
I20260811 18:48:02.384214 8044 raft_consensus.cc:2781] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:48:02.384337 8044 raft_consensus.cc:482] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:48:02.384442 8044 raft_consensus.cc:3037] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:48:02.387550 8044 raft_consensus.cc:504] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:02.388383 8044 leader_election.cc:288] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c [CANDIDATE]: Term 1 election: Requested vote from peers d27622cce74344aba7dcedcce7f2cc28 (127.25.25.2:45963), 504e79e08a2f45bba278f82d3f886136 (127.25.25.3:34613)
I20260811 18:48:02.389078 7678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7a54f3437ea4dd1a0b318a9f32b7c2d" candidate_uuid: "c5efdbece203419ba8936c49cacd3c8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27622cce74344aba7dcedcce7f2cc28"
I20260811 18:48:02.389333 7678 raft_consensus.cc:3037] T a7a54f3437ea4dd1a0b318a9f32b7c2d P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:48:02.389413 7903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7a54f3437ea4dd1a0b318a9f32b7c2d" candidate_uuid: "c5efdbece203419ba8936c49cacd3c8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504e79e08a2f45bba278f82d3f886136"
I20260811 18:48:02.389636 7903 raft_consensus.cc:3037] T a7a54f3437ea4dd1a0b318a9f32b7c2d P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:48:02.392642 7903 raft_consensus.cc:2454] T a7a54f3437ea4dd1a0b318a9f32b7c2d P 504e79e08a2f45bba278f82d3f886136 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5efdbece203419ba8936c49cacd3c8c in term 1.
I20260811 18:48:02.392673 7678 raft_consensus.cc:2454] T a7a54f3437ea4dd1a0b318a9f32b7c2d P d27622cce74344aba7dcedcce7f2cc28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5efdbece203419ba8936c49cacd3c8c in term 1.
I20260811 18:48:02.393221 7292 leader_election.cc:302] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5efdbece203419ba8936c49cacd3c8c, d27622cce74344aba7dcedcce7f2cc28; no voters:
I20260811 18:48:02.393615 8044 raft_consensus.cc:2781] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:48:02.394088 8044 raft_consensus.cc:686] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c [term 1 LEADER]: Becoming Leader. State: Replica: c5efdbece203419ba8936c49cacd3c8c, State: Running, Role: LEADER
I20260811 18:48:02.394454 8044 consensus_queue.cc:237] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:02.397680 7145 catalog_manager.cc:5495] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c reported cstate change: term changed from 0 to 1, leader changed from <none> to c5efdbece203419ba8936c49cacd3c8c (127.25.25.1). New cstate: current_term: 1 leader_uuid: "c5efdbece203419ba8936c49cacd3c8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } health_report { overall_health: UNKNOWN } } }
I20260811 18:48:02.412765 8191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:02.407608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34030 (local address 127.25.25.1:41681)
0811 18:48:02.408202 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:02.408207 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:02.408226 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:48:02.408288 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:02.408291 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:02.408355 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:02.408453 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:48:02.408874 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:02.409632 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:02.410948 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:02.411395 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:02.411517 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:02.411945 (+ 428us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:48:02.412054 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:48:02.412174 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:02.412342 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 18:48:02.412442 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":318,"threads_started":1}
I20260811 18:48:02.415791 7903 raft_consensus.cc:1261] T a7a54f3437ea4dd1a0b318a9f32b7c2d P 504e79e08a2f45bba278f82d3f886136 [term 1 FOLLOWER]: Refusing update from remote peer c5efdbece203419ba8936c49cacd3c8c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:48:02.415972 7678 raft_consensus.cc:1261] T a7a54f3437ea4dd1a0b318a9f32b7c2d P d27622cce74344aba7dcedcce7f2cc28 [term 1 FOLLOWER]: Refusing update from remote peer c5efdbece203419ba8936c49cacd3c8c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:48:02.416484 8184 consensus_queue.cc:1035] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:48:02.416951 8044 consensus_queue.cc:1035] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:48:02.432564 7145 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46168:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:48:02.432890 7145 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46168:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:48:02.436697 7145 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bf841b3c6e4342d5bf1eaca79cd3616b: Sending DeleteTablet for 3 replicas of tablet a7a54f3437ea4dd1a0b318a9f32b7c2d
I20260811 18:48:02.437644 7375 tablet_service.cc:1514] Processing DeleteTablet for tablet a7a54f3437ea4dd1a0b318a9f32b7c2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:48:02 UTC) from {username='oryx', principal='oryx/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:34020
I20260811 18:48:02.438009 7863 tablet_service.cc:1514] Processing DeleteTablet for tablet a7a54f3437ea4dd1a0b318a9f32b7c2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:48:02 UTC) from {username='oryx', principal='oryx/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:39346
I20260811 18:48:02.438074 8155 tablet_replica.cc:330] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c: stopping tablet replica
I20260811 18:48:02.438066 7634 tablet_service.cc:1514] Processing DeleteTablet for tablet a7a54f3437ea4dd1a0b318a9f32b7c2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:48:02 UTC) from {username='oryx', principal='oryx/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:57690
I20260811 18:48:02.438292 8155 raft_consensus.cc:2229] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:48:02.438421 8158 tablet_replica.cc:330] T a7a54f3437ea4dd1a0b318a9f32b7c2d P d27622cce74344aba7dcedcce7f2cc28: stopping tablet replica
I20260811 18:48:02.438598 8155 raft_consensus.cc:2258] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:48:02.438618 8158 raft_consensus.cc:2229] T a7a54f3437ea4dd1a0b318a9f32b7c2d P d27622cce74344aba7dcedcce7f2cc28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:48:02.438867 8158 raft_consensus.cc:2258] T a7a54f3437ea4dd1a0b318a9f32b7c2d P d27622cce74344aba7dcedcce7f2cc28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:48:02.438879 8156 tablet_replica.cc:330] T a7a54f3437ea4dd1a0b318a9f32b7c2d P 504e79e08a2f45bba278f82d3f886136: stopping tablet replica
I20260811 18:48:02.439095 8156 raft_consensus.cc:2229] T a7a54f3437ea4dd1a0b318a9f32b7c2d P 504e79e08a2f45bba278f82d3f886136 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:48:02.439340 8156 raft_consensus.cc:2258] T a7a54f3437ea4dd1a0b318a9f32b7c2d P 504e79e08a2f45bba278f82d3f886136 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:48:02.439935 8158 ts_tablet_manager.cc:1905] T a7a54f3437ea4dd1a0b318a9f32b7c2d P d27622cce74344aba7dcedcce7f2cc28: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:48:02.440685 8156 ts_tablet_manager.cc:1905] T a7a54f3437ea4dd1a0b318a9f32b7c2d P 504e79e08a2f45bba278f82d3f886136: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:48:02.444893 8155 ts_tablet_manager.cc:1905] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:48:02.446624 8156 ts_tablet_manager.cc:1918] T a7a54f3437ea4dd1a0b318a9f32b7c2d P 504e79e08a2f45bba278f82d3f886136: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:48:02.446791 8156 log.cc:1196] T a7a54f3437ea4dd1a0b318a9f32b7c2d P 504e79e08a2f45bba278f82d3f886136: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-2/wal/wals/a7a54f3437ea4dd1a0b318a9f32b7c2d
I20260811 18:48:02.447229 8156 ts_tablet_manager.cc:1939] T a7a54f3437ea4dd1a0b318a9f32b7c2d P 504e79e08a2f45bba278f82d3f886136: Deleting consensus metadata
I20260811 18:48:02.447499 8158 ts_tablet_manager.cc:1918] T a7a54f3437ea4dd1a0b318a9f32b7c2d P d27622cce74344aba7dcedcce7f2cc28: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:48:02.448061 8158 log.cc:1196] T a7a54f3437ea4dd1a0b318a9f32b7c2d P d27622cce74344aba7dcedcce7f2cc28: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-1/wal/wals/a7a54f3437ea4dd1a0b318a9f32b7c2d
I20260811 18:48:02.448675 8158 ts_tablet_manager.cc:1939] T a7a54f3437ea4dd1a0b318a9f32b7c2d P d27622cce74344aba7dcedcce7f2cc28: Deleting consensus metadata
I20260811 18:48:02.449030 7145 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46168:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 18:48:02.450042 7118 catalog_manager.cc:4841] TS d27622cce74344aba7dcedcce7f2cc28 (127.25.25.2:45963): tablet a7a54f3437ea4dd1a0b318a9f32b7c2d (table test-table [id=42ea82dd5d844ce99826952c96ac9a4a]) successfully deleted
W20260811 18:48:02.450345 7145 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:48:02.452756 7119 catalog_manager.cc:4841] TS 504e79e08a2f45bba278f82d3f886136 (127.25.25.3:34613): tablet a7a54f3437ea4dd1a0b318a9f32b7c2d (table test-table [id=42ea82dd5d844ce99826952c96ac9a4a]) successfully deleted
I20260811 18:48:02.452935 8155 ts_tablet_manager.cc:1918] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:48:02.453107 8155 log.cc:1196] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-0/wal/wals/a7a54f3437ea4dd1a0b318a9f32b7c2d
I20260811 18:48:02.453665 8155 ts_tablet_manager.cc:1939] T a7a54f3437ea4dd1a0b318a9f32b7c2d P c5efdbece203419ba8936c49cacd3c8c: Deleting consensus metadata
I20260811 18:48:02.455006 7115 catalog_manager.cc:4841] TS c5efdbece203419ba8936c49cacd3c8c (127.25.25.1:41681): tablet a7a54f3437ea4dd1a0b318a9f32b7c2d (table test-table [id=42ea82dd5d844ce99826952c96ac9a4a]) successfully deleted
I20260811 18:48:02.459285 7375 tablet_service.cc:1467] Processing CreateTablet for tablet bdbf5ca230574e83899e86e414887480 (DEFAULT_TABLE table=test-table [id=868103ffcdbe42d09b2090a4e565c520]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:48:02.459609 7634 tablet_service.cc:1467] Processing CreateTablet for tablet bdbf5ca230574e83899e86e414887480 (DEFAULT_TABLE table=test-table [id=868103ffcdbe42d09b2090a4e565c520]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:48:02.459828 7375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdbf5ca230574e83899e86e414887480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:48:02.459798 7863 tablet_service.cc:1467] Processing CreateTablet for tablet bdbf5ca230574e83899e86e414887480 (DEFAULT_TABLE table=test-table [id=868103ffcdbe42d09b2090a4e565c520]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:48:02.460178 7634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdbf5ca230574e83899e86e414887480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:48:02.460345 7863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdbf5ca230574e83899e86e414887480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:48:02.466888 8021 tablet_bootstrap.cc:492] T bdbf5ca230574e83899e86e414887480 P c5efdbece203419ba8936c49cacd3c8c: Bootstrap starting.
I20260811 18:48:02.468031 8026 tablet_bootstrap.cc:492] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136: Bootstrap starting.
I20260811 18:48:02.468755 8021 tablet_bootstrap.cc:654] T bdbf5ca230574e83899e86e414887480 P c5efdbece203419ba8936c49cacd3c8c: Neither blocks nor log segments found. Creating new log.
I20260811 18:48:02.469619 8026 tablet_bootstrap.cc:654] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136: Neither blocks nor log segments found. Creating new log.
I20260811 18:48:02.469944 8023 tablet_bootstrap.cc:492] T bdbf5ca230574e83899e86e414887480 P d27622cce74344aba7dcedcce7f2cc28: Bootstrap starting.
I20260811 18:48:02.471860 8023 tablet_bootstrap.cc:654] T bdbf5ca230574e83899e86e414887480 P d27622cce74344aba7dcedcce7f2cc28: Neither blocks nor log segments found. Creating new log.
I20260811 18:48:02.472326 8026 tablet_bootstrap.cc:492] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136: No bootstrap required, opened a new log
I20260811 18:48:02.472479 8026 ts_tablet_manager.cc:1397] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260811 18:48:02.473249 8026 raft_consensus.cc:348] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:02.473518 8026 raft_consensus.cc:374] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:48:02.473613 8026 raft_consensus.cc:729] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 504e79e08a2f45bba278f82d3f886136, State: Initialized, Role: FOLLOWER
I20260811 18:48:02.473888 8026 consensus_queue.cc:260] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:02.474259 8021 tablet_bootstrap.cc:492] T bdbf5ca230574e83899e86e414887480 P c5efdbece203419ba8936c49cacd3c8c: No bootstrap required, opened a new log
I20260811 18:48:02.474462 8021 ts_tablet_manager.cc:1397] T bdbf5ca230574e83899e86e414887480 P c5efdbece203419ba8936c49cacd3c8c: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.002s
I20260811 18:48:02.474803 8026 ts_tablet_manager.cc:1428] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:48:02.475342 8021 raft_consensus.cc:348] T bdbf5ca230574e83899e86e414887480 P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:02.475626 8021 raft_consensus.cc:374] T bdbf5ca230574e83899e86e414887480 P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:48:02.475704 8021 raft_consensus.cc:729] T bdbf5ca230574e83899e86e414887480 P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5efdbece203419ba8936c49cacd3c8c, State: Initialized, Role: FOLLOWER
I20260811 18:48:02.476006 8021 consensus_queue.cc:260] T bdbf5ca230574e83899e86e414887480 P c5efdbece203419ba8936c49cacd3c8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:02.477823 8021 ts_tablet_manager.cc:1428] T bdbf5ca230574e83899e86e414887480 P c5efdbece203419ba8936c49cacd3c8c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:48:02.479794 8023 tablet_bootstrap.cc:492] T bdbf5ca230574e83899e86e414887480 P d27622cce74344aba7dcedcce7f2cc28: No bootstrap required, opened a new log
I20260811 18:48:02.480001 8023 ts_tablet_manager.cc:1397] T bdbf5ca230574e83899e86e414887480 P d27622cce74344aba7dcedcce7f2cc28: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20260811 18:48:02.481006 8023 raft_consensus.cc:348] T bdbf5ca230574e83899e86e414887480 P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:02.481323 8023 raft_consensus.cc:374] T bdbf5ca230574e83899e86e414887480 P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:48:02.481423 8023 raft_consensus.cc:729] T bdbf5ca230574e83899e86e414887480 P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d27622cce74344aba7dcedcce7f2cc28, State: Initialized, Role: FOLLOWER
I20260811 18:48:02.481771 8023 consensus_queue.cc:260] T bdbf5ca230574e83899e86e414887480 P d27622cce74344aba7dcedcce7f2cc28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:02.482412 8023 ts_tablet_manager.cc:1428] T bdbf5ca230574e83899e86e414887480 P d27622cce74344aba7dcedcce7f2cc28: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:48:02.584970 8106 raft_consensus.cc:482] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:48:02.585201 8106 raft_consensus.cc:504] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:02.585942 8106 leader_election.cc:288] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5efdbece203419ba8936c49cacd3c8c (127.25.25.1:41681), d27622cce74344aba7dcedcce7f2cc28 (127.25.25.2:45963)
I20260811 18:48:02.586593 7678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdbf5ca230574e83899e86e414887480" candidate_uuid: "504e79e08a2f45bba278f82d3f886136" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27622cce74344aba7dcedcce7f2cc28" is_pre_election: true
I20260811 18:48:02.586617 7415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdbf5ca230574e83899e86e414887480" candidate_uuid: "504e79e08a2f45bba278f82d3f886136" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5efdbece203419ba8936c49cacd3c8c" is_pre_election: true
I20260811 18:48:02.586851 7415 raft_consensus.cc:2454] T bdbf5ca230574e83899e86e414887480 P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 504e79e08a2f45bba278f82d3f886136 in term 0.
I20260811 18:48:02.586860 7678 raft_consensus.cc:2454] T bdbf5ca230574e83899e86e414887480 P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 504e79e08a2f45bba278f82d3f886136 in term 0.
I20260811 18:48:02.587332 7791 leader_election.cc:302] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 504e79e08a2f45bba278f82d3f886136, c5efdbece203419ba8936c49cacd3c8c; no voters:
I20260811 18:48:02.587631 8106 raft_consensus.cc:2781] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:48:02.587744 8106 raft_consensus.cc:482] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:48:02.587848 8106 raft_consensus.cc:3037] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:48:02.590003 8106 raft_consensus.cc:504] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:02.590631 8106 leader_election.cc:288] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136 [CANDIDATE]: Term 1 election: Requested vote from peers c5efdbece203419ba8936c49cacd3c8c (127.25.25.1:41681), d27622cce74344aba7dcedcce7f2cc28 (127.25.25.2:45963)
I20260811 18:48:02.591198 7415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdbf5ca230574e83899e86e414887480" candidate_uuid: "504e79e08a2f45bba278f82d3f886136" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5efdbece203419ba8936c49cacd3c8c"
I20260811 18:48:02.591297 7678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdbf5ca230574e83899e86e414887480" candidate_uuid: "504e79e08a2f45bba278f82d3f886136" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27622cce74344aba7dcedcce7f2cc28"
I20260811 18:48:02.591456 7415 raft_consensus.cc:3037] T bdbf5ca230574e83899e86e414887480 P c5efdbece203419ba8936c49cacd3c8c [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:48:02.591533 7678 raft_consensus.cc:3037] T bdbf5ca230574e83899e86e414887480 P d27622cce74344aba7dcedcce7f2cc28 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:48:02.594581 7415 raft_consensus.cc:2454] T bdbf5ca230574e83899e86e414887480 P c5efdbece203419ba8936c49cacd3c8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 504e79e08a2f45bba278f82d3f886136 in term 1.
I20260811 18:48:02.594626 7678 raft_consensus.cc:2454] T bdbf5ca230574e83899e86e414887480 P d27622cce74344aba7dcedcce7f2cc28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 504e79e08a2f45bba278f82d3f886136 in term 1.
I20260811 18:48:02.595206 7791 leader_election.cc:302] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 504e79e08a2f45bba278f82d3f886136, c5efdbece203419ba8936c49cacd3c8c, d27622cce74344aba7dcedcce7f2cc28; no voters:
I20260811 18:48:02.595587 8106 raft_consensus.cc:2781] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:48:02.596004 8106 raft_consensus.cc:686] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136 [term 1 LEADER]: Becoming Leader. State: Replica: 504e79e08a2f45bba278f82d3f886136, State: Running, Role: LEADER
I20260811 18:48:02.596309 8106 consensus_queue.cc:237] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } }
I20260811 18:48:02.599319 7142 catalog_manager.cc:5495] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136 reported cstate change: term changed from 0 to 1, leader changed from <none> to 504e79e08a2f45bba278f82d3f886136 (127.25.25.3). New cstate: current_term: 1 leader_uuid: "504e79e08a2f45bba278f82d3f886136" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "504e79e08a2f45bba278f82d3f886136" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 34613 } health_report { overall_health: HEALTHY } } }
I20260811 18:48:02.625454 8202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:02.620408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39364 (local address 127.25.25.3:34613)
0811 18:48:02.620945 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:02.620949 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:02.620965 (+ 16us) server_negotiation.cc:407] Connection header received
0811 18:48:02.621022 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:02.621025 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:02.621098 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:02.621181 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:48:02.621627 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:02.622348 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:02.623739 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:02.624245 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:02.624343 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:02.624760 (+ 417us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:48:02.624870 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:48:02.624948 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:02.625039 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 18:48:02.625111 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":276,"threads_started":1}
I20260811 18:48:02.640733 8202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:02.635387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:41613 (local address 127.25.25.3:34613)
0811 18:48:02.635618 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:02.635623 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:02.636166 (+ 543us) server_negotiation.cc:407] Connection header received
0811 18:48:02.636315 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:02.636318 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:02.636391 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:02.636475 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:48:02.636943 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:02.637675 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:02.639068 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:02.639510 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:02.639611 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:02.640043 (+ 432us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:48:02.640202 (+ 159us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:48:02.640285 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:02.640416 (+ 131us) server_negotiation.cc:299] Negotiation successful
0811 18:48:02.640488 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":90}
I20260811 18:48:02.640807 8207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:02.635387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:34613 (local address 127.25.25.3:41613)
0811 18:48:02.636034 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:02.636051 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:02.636210 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:02.636537 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:02.636540 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:02.636551 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:48:02.636813 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:02.636822 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:02.637847 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:02.637851 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:02.638908 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:02.638921 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:02.639673 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:02.639678 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:02.639808 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:02.639865 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:48:02.640287 (+ 422us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:48:02.640297 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 18:48:02.640363 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 18:48:02.640478 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"mutex_wait_us":20,"thread_start_us":354,"threads_started":1}
I20260811 18:48:02.649224 7678 raft_consensus.cc:1261] T bdbf5ca230574e83899e86e414887480 P d27622cce74344aba7dcedcce7f2cc28 [term 1 FOLLOWER]: Refusing update from remote peer 504e79e08a2f45bba278f82d3f886136: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:48:02.649245 7415 raft_consensus.cc:1261] T bdbf5ca230574e83899e86e414887480 P c5efdbece203419ba8936c49cacd3c8c [term 1 FOLLOWER]: Refusing update from remote peer 504e79e08a2f45bba278f82d3f886136: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:48:02.649783 8201 consensus_queue.cc:1035] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d27622cce74344aba7dcedcce7f2cc28" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:48:02.650125 8199 consensus_queue.cc:1035] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5efdbece203419ba8936c49cacd3c8c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 41681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:48:02.698526 7143 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46168:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:48:02.698776 7143 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46168:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:48:02.702040 7143 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bf841b3c6e4342d5bf1eaca79cd3616b: Sending DeleteTablet for 3 replicas of tablet bdbf5ca230574e83899e86e414887480
I20260811 18:48:02.702975 7375 tablet_service.cc:1514] Processing DeleteTablet for tablet bdbf5ca230574e83899e86e414887480 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:48:02 UTC) from {username='oryx', principal='oryx/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:34020
I20260811 18:48:02.703002 7863 tablet_service.cc:1514] Processing DeleteTablet for tablet bdbf5ca230574e83899e86e414887480 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:48:02 UTC) from {username='oryx', principal='oryx/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:39346
I20260811 18:48:02.703038 7634 tablet_service.cc:1514] Processing DeleteTablet for tablet bdbf5ca230574e83899e86e414887480 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:48:02 UTC) from {username='oryx', principal='oryx/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:57690
I20260811 18:48:02.703323 8155 tablet_replica.cc:330] T bdbf5ca230574e83899e86e414887480 P c5efdbece203419ba8936c49cacd3c8c: stopping tablet replica
I20260811 18:48:02.703434 8156 tablet_replica.cc:330] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136: stopping tablet replica
I20260811 18:48:02.703516 8155 raft_consensus.cc:2229] T bdbf5ca230574e83899e86e414887480 P c5efdbece203419ba8936c49cacd3c8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:48:02.703663 8156 raft_consensus.cc:2229] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:48:02.703745 8155 raft_consensus.cc:2258] T bdbf5ca230574e83899e86e414887480 P c5efdbece203419ba8936c49cacd3c8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:48:02.704275 8158 tablet_replica.cc:330] T bdbf5ca230574e83899e86e414887480 P d27622cce74344aba7dcedcce7f2cc28: stopping tablet replica
I20260811 18:48:02.704463 8158 raft_consensus.cc:2229] T bdbf5ca230574e83899e86e414887480 P d27622cce74344aba7dcedcce7f2cc28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:48:02.704686 8158 raft_consensus.cc:2258] T bdbf5ca230574e83899e86e414887480 P d27622cce74344aba7dcedcce7f2cc28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:48:02.704975 8156 raft_consensus.cc:2258] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:48:02.705242 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 7261
I20260811 18:48:02.705657 8155 ts_tablet_manager.cc:1905] T bdbf5ca230574e83899e86e414887480 P c5efdbece203419ba8936c49cacd3c8c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:48:02.705855 8158 ts_tablet_manager.cc:1905] T bdbf5ca230574e83899e86e414887480 P d27622cce74344aba7dcedcce7f2cc28: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:48:02.706049 8156 ts_tablet_manager.cc:1905] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:48:02.712802 8158 ts_tablet_manager.cc:1918] T bdbf5ca230574e83899e86e414887480 P d27622cce74344aba7dcedcce7f2cc28: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:48:02.712988 8158 log.cc:1196] T bdbf5ca230574e83899e86e414887480 P d27622cce74344aba7dcedcce7f2cc28: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-1/wal/wals/bdbf5ca230574e83899e86e414887480
I20260811 18:48:02.713330 8156 ts_tablet_manager.cc:1918] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:48:02.713490 8156 log.cc:1196] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-2/wal/wals/bdbf5ca230574e83899e86e414887480
I20260811 18:48:02.713713 8158 ts_tablet_manager.cc:1939] T bdbf5ca230574e83899e86e414887480 P d27622cce74344aba7dcedcce7f2cc28: Deleting consensus metadata
I20260811 18:48:02.713884 8156 ts_tablet_manager.cc:1939] T bdbf5ca230574e83899e86e414887480 P 504e79e08a2f45bba278f82d3f886136: Deleting consensus metadata
I20260811 18:48:02.714412 8155 ts_tablet_manager.cc:1918] T bdbf5ca230574e83899e86e414887480 P c5efdbece203419ba8936c49cacd3c8c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:48:02.714603 8155 log.cc:1196] T bdbf5ca230574e83899e86e414887480 P c5efdbece203419ba8936c49cacd3c8c: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474012733352-25700-0/minicluster-data/ts-0/wal/wals/bdbf5ca230574e83899e86e414887480
I20260811 18:48:02.714990 7118 catalog_manager.cc:4841] TS d27622cce74344aba7dcedcce7f2cc28 (127.25.25.2:45963): tablet bdbf5ca230574e83899e86e414887480 (table test-table [id=868103ffcdbe42d09b2090a4e565c520]) successfully deleted
I20260811 18:48:02.715161 8155 ts_tablet_manager.cc:1939] T bdbf5ca230574e83899e86e414887480 P c5efdbece203419ba8936c49cacd3c8c: Deleting consensus metadata
I20260811 18:48:02.714990 7119 catalog_manager.cc:4841] TS 504e79e08a2f45bba278f82d3f886136 (127.25.25.3:34613): tablet bdbf5ca230574e83899e86e414887480 (table test-table [id=868103ffcdbe42d09b2090a4e565c520]) successfully deleted
I20260811 18:48:02.716296 7115 catalog_manager.cc:4841] TS c5efdbece203419ba8936c49cacd3c8c (127.25.25.1:41681): tablet bdbf5ca230574e83899e86e414887480 (table test-table [id=868103ffcdbe42d09b2090a4e565c520]) successfully deleted
Aug 11 18:48:02 dist-test-slave-lgr5 krb5kdc[7065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474082, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.25.1@KRBTEST.COM
I20260811 18:48:02.733748 8191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:02.713241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34032 (local address 127.25.25.1:41681)
0811 18:48:02.713483 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:02.713490 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:02.716194 (+ 2704us) server_negotiation.cc:407] Connection header received
0811 18:48:02.716497 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:02.716502 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:02.716601 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:02.716676 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:02.718534 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:02.719277 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:02.721286 (+ 2009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:02.721730 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:02.721834 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:02.727228 (+ 5394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:02.727248 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:02.727266 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:02.727316 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:02.730508 (+ 3192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:02.731346 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:02.731356 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:02.731358 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:02.731525 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:02.731948 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:02.731953 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:02.731955 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:02.732489 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:02.732806 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:02.733196 (+ 390us) server_negotiation.cc:299] Negotiation successful
0811 18:48:02.733444 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 18:48:02.734488 7502 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:48:02.924734 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 7261
I20260811 18:48:02.963474 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 7513
Aug 11 18:48:02 dist-test-slave-lgr5 krb5kdc[7065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474082, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.25.2@KRBTEST.COM
I20260811 18:48:02.988492 8218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:02.964336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57706 (local address 127.25.25.2:45963)
0811 18:48:02.968550 (+ 4214us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:02.968557 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:02.968585 (+ 28us) server_negotiation.cc:407] Connection header received
0811 18:48:02.968669 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:02.968675 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:02.968763 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:02.968907 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:02.970791 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:02.971941 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:02.974097 (+ 2156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:02.974830 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:02.975006 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:02.980898 (+ 5892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:02.980933 (+ 35us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:02.980957 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:02.981013 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:02.985057 (+ 4044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:02.985976 (+ 919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:02.985989 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:02.985993 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:02.986194 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:02.986555 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:02.986560 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:02.986564 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:02.987083 (+ 519us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:02.987401 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:02.987656 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 18:48:02.987933 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4058,"thread_start_us":3911,"threads_started":1}
I20260811 18:48:02.989305 7749 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:48:03.120460 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 7513
I20260811 18:48:03.144964 8222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:03.143958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:41681 (local address 127.25.25.3:38267)
0811 18:48:03.144548 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:03.144701 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:41681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":285,"threads_started":1}
W20260811 18:48:03.145395 7791 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.25.1:41681: connect: Connection refused (error 111)
I20260811 18:48:03.147743 8222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:03.147305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:41681 (local address 127.25.25.3:47171)
0811 18:48:03.147486 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:03.147583 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:41681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 18:48:03.148222 7791 consensus_peers.cc:487] T 5a9ab4ee25ac4598bbcb7a4180ad88e9 P 504e79e08a2f45bba278f82d3f886136 -> Peer c5efdbece203419ba8936c49cacd3c8c (127.25.25.1:41681): Couldn't send request to peer c5efdbece203419ba8936c49cacd3c8c. Status: Network error: Client connection negotiation failed: client connection to 127.25.25.1:41681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 18:48:03.157193 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 7764
Aug 11 18:48:03 dist-test-slave-lgr5 krb5kdc[7065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474082, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.25.3@KRBTEST.COM
I20260811 18:48:03.174818 8224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:03.158183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39372 (local address 127.25.25.3:34613)
0811 18:48:03.158698 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:03.158703 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:03.158726 (+ 23us) server_negotiation.cc:407] Connection header received
0811 18:48:03.158795 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:03.158798 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:03.158873 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:03.159002 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:03.160456 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:03.161298 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:03.162722 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:03.163181 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:03.163303 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:03.168167 (+ 4864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:03.168186 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:03.168204 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:03.168259 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:03.171417 (+ 3158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:03.172475 (+ 1058us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:03.172487 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:03.172490 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:03.172674 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:03.173086 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:03.173089 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:03.173091 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:03.173495 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:03.173821 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:03.174200 (+ 379us) server_negotiation.cc:299] Negotiation successful
0811 18:48:03.174411 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":269,"threads_started":1}
I20260811 18:48:03.175853 7981 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:48:03.336344 8222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:03.175652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:45963 (local address 127.25.25.3:34003)
0811 18:48:03.175870 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:03.176015 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.2:45963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 18:48:03.336548 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 7764
I20260811 18:48:03.375614 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 7089
I20260811 18:48:03.376935 7206 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:48:03.495808 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 7089
2026-08-11T18:48:03Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (6436 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:48:03 dist-test-slave-lgr5 krb5kdc[8240](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:48:03 dist-test-slave-lgr5 krb5kdc[8240](info): set up 2 sockets
Aug 11 18:48:03 dist-test-slave-lgr5 krb5kdc[8240](info): commencing operation
krb5kdc: starting...
W20260811 18:48:04.794478 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.242s user 0.006s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:48:04 dist-test-slave-lgr5 krb5kdc[8240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474084, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:48:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:48:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:48:05.094525 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:45555
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:33911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:45555
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:48:05.458947 8263 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:48:05.459327 8263 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:48:05.459457 8263 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:48:05.467195 8263 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:48:05.467334 8263 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:48:05.467419 8263 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:48:05.467505 8263 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:48:05.467579 8263 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:48:05.478255 8263 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:33911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:45555
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:45555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:48:05.479725 8263 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:48:05.481204 8263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:48:05.493909 8273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:05.493961 8277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:05.493861 8274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:48:05.494549 8263 server_base.cc:1034] running on GCE node
I20260811 18:48:05.495476 8263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:48:05.497095 8263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:48:05.498330 8263 hybrid_clock.cc:648] HybridClock initialized: now 1786474085498253 us; error 64 us; skew 500 ppm
I20260811 18:48:05.498684 8263 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T18:48:05Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (2072 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:48:05 dist-test-slave-lgr5 krb5kdc[8286](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:48:05 dist-test-slave-lgr5 krb5kdc[8286](info): set up 2 sockets
Aug 11 18:48:05 dist-test-slave-lgr5 krb5kdc[8286](info): commencing operation
krb5kdc: starting...
W20260811 18:48:06.850018 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.225s user 0.001s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:48:07 dist-test-slave-lgr5 krb5kdc[8286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474087, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:48:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:48:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:48:07.145145 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:38653
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:42261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:38653
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:48:07.504417 8302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:48:07.504746 8302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:48:07.504887 8302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:48:07.512852 8302 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:48:07.512980 8302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:48:07.513055 8302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:48:07.513134 8302 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:48:07.513199 8302 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:48:07.523721 8302 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:42261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:38653
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:38653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:48:07.525184 8302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:48:07.526592 8302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:48:07.538951 8316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:07.539016 8318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:07.539052 8314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:48:07.539731 8302 server_base.cc:1034] running on GCE node
I20260811 18:48:07.540807 8302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:48:07.542371 8302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:48:07.543615 8302 hybrid_clock.cc:648] HybridClock initialized: now 1786474087543564 us; error 45 us; skew 500 ppm
I20260811 18:48:07.544039 8302 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:48:07 dist-test-slave-lgr5 krb5kdc[8286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474087, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:48:07.547729 8302 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:48:07.549503 8302 webserver.cc:460] Webserver started at http://127.25.25.62:45167/ using document root <none> and password file <none>
I20260811 18:48:07.550276 8302 fs_manager.cc:359] Metadata directory not provided
I20260811 18:48:07.550406 8302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:48:07.550722 8302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:48:07.554482 8302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "77cdb457aa3242928a3dd17fde946490"
format_stamp: "Formatted at 2026-08-11 18:48:07 on dist-test-slave-lgr5"
server_key: "9c64ce0e29df4614cb2f482b88d093dc"
server_key_iv: "a5cbedea699a477332ce648b2e202623"
server_key_version: "encryptionkey@0"
I20260811 18:48:07.555393 8302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "77cdb457aa3242928a3dd17fde946490"
format_stamp: "Formatted at 2026-08-11 18:48:07 on dist-test-slave-lgr5"
server_key: "9c64ce0e29df4614cb2f482b88d093dc"
server_key_iv: "a5cbedea699a477332ce648b2e202623"
server_key_version: "encryptionkey@0"
I20260811 18:48:07.561920 8302 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260811 18:48:07.566183 8329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:07.567783 8302 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 18:48:07.567974 8302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "77cdb457aa3242928a3dd17fde946490"
format_stamp: "Formatted at 2026-08-11 18:48:07 on dist-test-slave-lgr5"
server_key: "9c64ce0e29df4614cb2f482b88d093dc"
server_key_iv: "a5cbedea699a477332ce648b2e202623"
server_key_version: "encryptionkey@0"
I20260811 18:48:07.568255 8302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:48:07.601492 8302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:48:07.606545 8302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:48:07.606812 8302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:48:07.625495 8302 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:38653
I20260811 18:48:07.625540 8430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:38653 every 8 connection(s)
I20260811 18:48:07.627100 8302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:48:07.631577 8432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:48:07.635483 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 8302
I20260811 18:48:07.635694 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:48:07.636409 25700 external_mini_cluster.cc:1428] Setting key b64ee42403f56c3ee1056201a2fab9f6
I20260811 18:48:07.644218 8432 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490: Bootstrap starting.
I20260811 18:48:07.648356 8432 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490: Neither blocks nor log segments found. Creating new log.
I20260811 18:48:07.649689 8432 log.cc:824] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490: Log is configured to *not* fsync() on all Append() calls
Aug 11 18:48:07 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474087, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:48:07.653704 8432 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490: No bootstrap required, opened a new log
I20260811 18:48:07.663494 8432 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77cdb457aa3242928a3dd17fde946490" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38653 } }
I20260811 18:48:07.663770 8440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:07.638980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48748 (local address 127.25.25.62:38653)
0811 18:48:07.639863 (+ 883us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:07.639877 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:07.639924 (+ 47us) server_negotiation.cc:407] Connection header received
0811 18:48:07.642355 (+ 2431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:07.642387 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:07.642879 (+ 492us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:07.643276 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:07.645352 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:07.646800 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:07.648730 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:07.649594 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:07.649758 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:07.654913 (+ 5155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:07.654923 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:07.654940 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:07.654992 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:07.658367 (+ 3375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:07.659481 (+ 1114us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:07.659490 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:07.659499 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:07.659725 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:07.660322 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:07.660327 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:07.660330 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:07.661119 (+ 789us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:07.661456 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:07.662010 (+ 554us) server_negotiation.cc:299] Negotiation successful
0811 18:48:07.662557 (+ 547us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":633,"thread_start_us":383,"threads_started":1}
I20260811 18:48:07.663920 8432 raft_consensus.cc:374] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:48:07.664021 8432 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77cdb457aa3242928a3dd17fde946490, State: Initialized, Role: FOLLOWER
I20260811 18:48:07.664755 8432 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77cdb457aa3242928a3dd17fde946490" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38653 } }
I20260811 18:48:07.665002 8432 raft_consensus.cc:388] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:48:07.665143 8432 raft_consensus.cc:482] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:48:07.665311 8432 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:48:07.667932 8432 raft_consensus.cc:504] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77cdb457aa3242928a3dd17fde946490" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38653 } }
I20260811 18:48:07.668519 8432 leader_election.cc:302] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77cdb457aa3242928a3dd17fde946490; no voters:
I20260811 18:48:07.669167 8432 leader_election.cc:288] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:48:07.669312 8443 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:48:07.670372 8443 raft_consensus.cc:686] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [term 1 LEADER]: Becoming Leader. State: Replica: 77cdb457aa3242928a3dd17fde946490, State: Running, Role: LEADER
I20260811 18:48:07.671031 8443 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77cdb457aa3242928a3dd17fde946490" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38653 } }
I20260811 18:48:07.671595 8432 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:48:07.673990 8444 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77cdb457aa3242928a3dd17fde946490" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77cdb457aa3242928a3dd17fde946490" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38653 } } }
I20260811 18:48:07.674247 8445 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77cdb457aa3242928a3dd17fde946490. Latest consensus state: current_term: 1 leader_uuid: "77cdb457aa3242928a3dd17fde946490" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77cdb457aa3242928a3dd17fde946490" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38653 } } }
I20260811 18:48:07.674460 8444 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [sys.catalog]: This master's current role is: LEADER
I20260811 18:48:07.674508 8445 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [sys.catalog]: This master's current role is: LEADER
I20260811 18:48:07.675370 8456 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:48:07.681922 8456 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:48:07.692304 8456 catalog_manager.cc:1347] Generated new cluster ID: d5231bfd30ab47c58c8abb76d5e91087
I20260811 18:48:07.692436 8456 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:48:07.720651 8456 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:48:07.722077 8456 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:48:07.735646 8456 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490: Generated new TSK 0
I20260811 18:48:07.736651 8456 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.25.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
I20260811 18:48:07.816998 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:0
--local_ip_for_outbound_sockets=127.25.25.1
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38653
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:42261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:48:08.177299 8484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:48:08.177650 8484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:48:08.177798 8484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:48:08.185439 8484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:48:08.185603 8484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:48:08.185762 8484 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:48:08.196061 8484 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:42261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38653
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:48:08.197554 8484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:48:08.199014 8484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:48:08.213914 8496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:08.214025 8494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:08.213999 8493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:48:08.215616 8484 server_base.cc:1034] running on GCE node
I20260811 18:48:08.216336 8484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:48:08.217422 8484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:48:08.218670 8484 hybrid_clock.cc:648] HybridClock initialized: now 1786474088218606 us; error 55 us; skew 500 ppm
I20260811 18:48:08.219034 8484 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:48:08 dist-test-slave-lgr5 krb5kdc[8286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474088, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:48:08.222708 8484 init.cc:377] Logged in from keytab as kudu/127.25.25.1@KRBTEST.COM (short username kudu)
I20260811 18:48:08.224658 8484 webserver.cc:460] Webserver started at http://127.25.25.1:42263/ using document root <none> and password file <none>
I20260811 18:48:08.225466 8484 fs_manager.cc:359] Metadata directory not provided
I20260811 18:48:08.225603 8484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:48:08.225929 8484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:48:08.229241 8484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/data/instance:
uuid: "5b2736f7916f43c9ae764d6644696d0b"
format_stamp: "Formatted at 2026-08-11 18:48:08 on dist-test-slave-lgr5"
server_key: "10fa6c13a3e14f28d4ecef372dc95007"
server_key_iv: "fc388e1d8b116f0a91f040f0ffbbf319"
server_key_version: "encryptionkey@0"
I20260811 18:48:08.230167 8484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance:
uuid: "5b2736f7916f43c9ae764d6644696d0b"
format_stamp: "Formatted at 2026-08-11 18:48:08 on dist-test-slave-lgr5"
server_key: "10fa6c13a3e14f28d4ecef372dc95007"
server_key_iv: "fc388e1d8b116f0a91f040f0ffbbf319"
server_key_version: "encryptionkey@0"
I20260811 18:48:08.236356 8484 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260811 18:48:08.240514 8509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:08.242069 8484 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:48:08.242260 8484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "5b2736f7916f43c9ae764d6644696d0b"
format_stamp: "Formatted at 2026-08-11 18:48:08 on dist-test-slave-lgr5"
server_key: "10fa6c13a3e14f28d4ecef372dc95007"
server_key_iv: "fc388e1d8b116f0a91f040f0ffbbf319"
server_key_version: "encryptionkey@0"
I20260811 18:48:08.242527 8484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:48:08.262322 8484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:48:08.267184 8484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:48:08.267508 8484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:48:08.268651 8484 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:48:08.270323 8484 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:48:08.270429 8484 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:08.270573 8484 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:48:08.270632 8484 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:08.304520 8484 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:38121
I20260811 18:48:08.304551 8712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:38121 every 8 connection(s)
I20260811 18:48:08.305968 8484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:48:08.308636 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 8484
I20260811 18:48:08.308827 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance
I20260811 18:48:08.309468 25700 external_mini_cluster.cc:1428] Setting key 3ad0463989cb6502fec6c51d07e37a2d
Aug 11 18:48:08 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474088, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:48:08.328986 8719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:08.308609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:40921 (local address 127.25.25.62:38653)
0811 18:48:08.311704 (+ 3095us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:08.311710 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:08.311731 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:48:08.313003 (+ 1272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:08.313008 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:08.313086 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:08.313170 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:08.315240 (+ 2070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:08.316001 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:08.318215 (+ 2214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:08.318651 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:08.318759 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:08.322884 (+ 4125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:08.322891 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:08.322895 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:08.322939 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:08.325620 (+ 2681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:08.326544 (+ 924us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:08.326548 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:08.326550 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:08.326671 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:08.327165 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:08.327168 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:08.327170 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:08.327429 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:08.327563 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:08.328522 (+ 959us) server_negotiation.cc:299] Negotiation successful
0811 18:48:08.328724 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2972,"thread_start_us":2841,"threads_started":1}
I20260811 18:48:08.330525 8720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:08.309280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.1:40921)
0811 18:48:08.310225 (+ 945us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:08.310287 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:08.312679 (+ 2392us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:08.313476 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:08.313488 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:08.314242 (+ 754us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:08.315056 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:08.315084 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:08.316264 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:08.316269 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:08.318046 (+ 1777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:08.318062 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:08.318891 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:08.318898 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:08.319172 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:08.319921 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:08.319959 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:08.322611 (+ 2652us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:48:08.325784 (+ 3173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:48:08.325795 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:48:08.325815 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:48:08.326424 (+ 609us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:48:08.326792 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:48:08.326798 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:48:08.326801 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:48:08.327071 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:48:08.327575 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:48:08.327583 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:48:08.328037 (+ 454us) client_negotiation.cc:769] Sending connection context
0811 18:48:08.328430 (+ 393us) client_negotiation.cc:240] Negotiation successful
0811 18:48:08.329040 (+ 610us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":343,"threads_started":1}
I20260811 18:48:08.332202 8716 heartbeater.cc:347] Connected to a master server at 127.25.25.62:38653
I20260811 18:48:08.332541 8716 heartbeater.cc:464] Registering TS with master...
I20260811 18:48:08.333511 8716 heartbeater.cc:511] Master 127.25.25.62:38653 requested a full tablet report, sending...
I20260811 18:48:08.336350 8364 ts_manager.cc:194] Registered new tserver with Master: 5b2736f7916f43c9ae764d6644696d0b (127.25.25.1:38121)
I20260811 18:48:08.338579 8364 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.1@KRBTEST.COM'} at 127.25.25.1:40921
WARNING: no policy specified for kudu/127.25.25.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
I20260811 18:48:08.377027 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:0
--local_ip_for_outbound_sockets=127.25.25.2
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38653
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:42261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:48:08.754359 8723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:48:08.754699 8723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:48:08.754844 8723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:48:08.762543 8723 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:48:08.762705 8723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:48:08.762866 8723 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:48:08.773435 8723 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:42261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38653
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:48:08.774837 8723 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:48:08.776374 8723 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:48:08.791051 8732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:08.791003 8740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:08.790966 8743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:48:08.791913 8723 server_base.cc:1034] running on GCE node
I20260811 18:48:08.792622 8723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:48:08.793740 8723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:48:08.794966 8723 hybrid_clock.cc:648] HybridClock initialized: now 1786474088794907 us; error 52 us; skew 500 ppm
I20260811 18:48:08.795311 8723 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:48:08 dist-test-slave-lgr5 krb5kdc[8286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474088, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:48:08.798722 8723 init.cc:377] Logged in from keytab as kudu/127.25.25.2@KRBTEST.COM (short username kudu)
I20260811 18:48:08.800599 8723 webserver.cc:460] Webserver started at http://127.25.25.2:37529/ using document root <none> and password file <none>
I20260811 18:48:08.801385 8723 fs_manager.cc:359] Metadata directory not provided
I20260811 18:48:08.801553 8723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:48:08.801899 8723 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:48:08.805265 8723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/data/instance:
uuid: "4a302afc5f1d4ad8a60bb38583eab18f"
format_stamp: "Formatted at 2026-08-11 18:48:08 on dist-test-slave-lgr5"
server_key: "66431e356a1165885b71206c6e3f7e5c"
server_key_iv: "f8ee611a20ec3068762579e3cb4a87d0"
server_key_version: "encryptionkey@0"
I20260811 18:48:08.806169 8723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance:
uuid: "4a302afc5f1d4ad8a60bb38583eab18f"
format_stamp: "Formatted at 2026-08-11 18:48:08 on dist-test-slave-lgr5"
server_key: "66431e356a1165885b71206c6e3f7e5c"
server_key_iv: "f8ee611a20ec3068762579e3cb4a87d0"
server_key_version: "encryptionkey@0"
I20260811 18:48:08.812270 8723 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 18:48:08.816268 8761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:08.817819 8723 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:48:08.818020 8723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "4a302afc5f1d4ad8a60bb38583eab18f"
format_stamp: "Formatted at 2026-08-11 18:48:08 on dist-test-slave-lgr5"
server_key: "66431e356a1165885b71206c6e3f7e5c"
server_key_iv: "f8ee611a20ec3068762579e3cb4a87d0"
server_key_version: "encryptionkey@0"
I20260811 18:48:08.818234 8723 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:48:08.839399 8723 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:48:08.843876 8723 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:48:08.844249 8723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:48:08.845392 8723 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:48:08.847000 8723 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:48:08.847091 8723 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:08.847236 8723 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:48:08.847311 8723 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:08.880658 8723 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:34157
I20260811 18:48:08.880714 8965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:34157 every 8 connection(s)
I20260811 18:48:08.882119 8723 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:48:08.888588 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 8723
I20260811 18:48:08.888821 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance
I20260811 18:48:08.889398 25700 external_mini_cluster.cc:1428] Setting key 4c69341f403b4fa2715b0a4644155476
Aug 11 18:48:08 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474088, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:48:08.905534 8971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:08.885130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:40625 (local address 127.25.25.62:38653)
0811 18:48:08.885725 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:08.885732 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:08.886864 (+ 1132us) server_negotiation.cc:407] Connection header received
0811 18:48:08.889155 (+ 2291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:08.889161 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:08.889262 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:08.889369 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:08.891460 (+ 2091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:08.892255 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:08.893990 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:08.894435 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:08.894558 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:08.898672 (+ 4114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:08.898679 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:08.898682 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:08.898725 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:08.901705 (+ 2980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:08.902671 (+ 966us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:08.902678 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:08.902680 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:08.902846 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:08.903388 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:08.903394 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:08.903396 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:08.903719 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:08.903902 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:08.904799 (+ 897us) server_negotiation.cc:299] Negotiation successful
0811 18:48:08.905073 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":313,"threads_started":1}
I20260811 18:48:08.906633 8972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:08.885789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.2:40625)
0811 18:48:08.886667 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:08.886719 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:08.888773 (+ 2054us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:08.889709 (+ 936us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:08.889723 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:08.890402 (+ 679us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:08.891249 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:08.891279 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:08.892415 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:08.892420 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:08.893830 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:08.893845 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:08.894697 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:08.894706 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:08.894954 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:08.895658 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:08.895691 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:08.898325 (+ 2634us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:48:08.901924 (+ 3599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:48:08.901938 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:48:08.901955 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:48:08.902508 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:48:08.902985 (+ 477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:48:08.902991 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:48:08.902996 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:48:08.903245 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:48:08.903882 (+ 637us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:48:08.903892 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:48:08.904365 (+ 473us) client_negotiation.cc:769] Sending connection context
0811 18:48:08.904673 (+ 308us) client_negotiation.cc:240] Negotiation successful
0811 18:48:08.905316 (+ 643us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":315,"threads_started":1}
I20260811 18:48:08.908341 8967 heartbeater.cc:347] Connected to a master server at 127.25.25.62:38653
I20260811 18:48:08.908737 8967 heartbeater.cc:464] Registering TS with master...
I20260811 18:48:08.909785 8967 heartbeater.cc:511] Master 127.25.25.62:38653 requested a full tablet report, sending...
I20260811 18:48:08.911607 8364 ts_manager.cc:194] Registered new tserver with Master: 4a302afc5f1d4ad8a60bb38583eab18f (127.25.25.2:34157)
I20260811 18:48:08.912540 8364 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.2@KRBTEST.COM'} at 127.25.25.2:40625
WARNING: no policy specified for kudu/127.25.25.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
I20260811 18:48:08.955927 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:0
--local_ip_for_outbound_sockets=127.25.25.3
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38653
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:42261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:48:09.315738 8982 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:48:09.316043 8982 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:48:09.316203 8982 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:48:09.323881 8982 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:48:09.324015 8982 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:48:09.324190 8982 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:48:09.334507 8982 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:42261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38653
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:48:09.335990 8982 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:48:09.337512 8982 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 18:48:09.342526 8716 heartbeater.cc:503] Master 127.25.25.62:38653 was elected leader, sending a full tablet report...
W20260811 18:48:09.352952 8990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:48:09.353088 8982 server_base.cc:1034] running on GCE node
W20260811 18:48:09.353020 8989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:09.352991 8994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:48:09.354158 8982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:48:09.355252 8982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:48:09.356506 8982 hybrid_clock.cc:648] HybridClock initialized: now 1786474089356444 us; error 43 us; skew 500 ppm
I20260811 18:48:09.356870 8982 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:48:09 dist-test-slave-lgr5 krb5kdc[8286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474089, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:48:09.360286 8982 init.cc:377] Logged in from keytab as kudu/127.25.25.3@KRBTEST.COM (short username kudu)
I20260811 18:48:09.361987 8982 webserver.cc:460] Webserver started at http://127.25.25.3:36237/ using document root <none> and password file <none>
I20260811 18:48:09.362726 8982 fs_manager.cc:359] Metadata directory not provided
I20260811 18:48:09.362851 8982 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:48:09.363168 8982 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:48:09.366369 8982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/data/instance:
uuid: "40fbb12c4d57482cb58301965022485e"
format_stamp: "Formatted at 2026-08-11 18:48:09 on dist-test-slave-lgr5"
server_key: "6b49fbdc60c1d8e2a60e461084db7075"
server_key_iv: "7cd06e27b912252a03bfe6bdb3325a08"
server_key_version: "encryptionkey@0"
I20260811 18:48:09.367198 8982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance:
uuid: "40fbb12c4d57482cb58301965022485e"
format_stamp: "Formatted at 2026-08-11 18:48:09 on dist-test-slave-lgr5"
server_key: "6b49fbdc60c1d8e2a60e461084db7075"
server_key_iv: "7cd06e27b912252a03bfe6bdb3325a08"
server_key_version: "encryptionkey@0"
I20260811 18:48:09.373119 8982 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 18:48:09.377703 9002 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:09.379494 8982 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.004s
I20260811 18:48:09.379722 8982 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "40fbb12c4d57482cb58301965022485e"
format_stamp: "Formatted at 2026-08-11 18:48:09 on dist-test-slave-lgr5"
server_key: "6b49fbdc60c1d8e2a60e461084db7075"
server_key_iv: "7cd06e27b912252a03bfe6bdb3325a08"
server_key_version: "encryptionkey@0"
I20260811 18:48:09.379987 8982 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:48:09.432886 8982 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:48:09.437999 8982 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:48:09.438360 8982 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:48:09.439581 8982 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:48:09.441287 8982 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:48:09.441381 8982 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:09.441524 8982 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:48:09.441586 8982 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:09.477787 8982 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:44827
I20260811 18:48:09.477836 9201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:44827 every 8 connection(s)
I20260811 18:48:09.479291 8982 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:48:09.486577 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 8982
I20260811 18:48:09.486753 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance
I20260811 18:48:09.487202 25700 external_mini_cluster.cc:1428] Setting key 4163d1f64aebf2c88c246c3aaef15a5f
Aug 11 18:48:09 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474089, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:48:09.502456 9206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:09.482218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:59985 (local address 127.25.25.62:38653)
0811 18:48:09.482757 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:09.482764 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:09.483785 (+ 1021us) server_negotiation.cc:407] Connection header received
0811 18:48:09.485862 (+ 2077us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:09.485868 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:09.485968 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:09.486072 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:09.487886 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:09.488942 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:09.491177 (+ 2235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:09.491667 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:09.491785 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:09.495763 (+ 3978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:09.495769 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:09.495772 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:09.495814 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:09.498633 (+ 2819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:09.499655 (+ 1022us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:09.499660 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:09.499663 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:09.499841 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:09.500447 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:09.500452 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:09.500454 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:09.500814 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:09.500992 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:09.501813 (+ 821us) server_negotiation.cc:299] Negotiation successful
0811 18:48:09.502071 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":241,"threads_started":1}
I20260811 18:48:09.503741 9207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:09.482796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.3:59985)
0811 18:48:09.483606 (+ 810us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:09.483651 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:09.485535 (+ 1884us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:09.486342 (+ 807us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:09.486351 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:09.486995 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:09.487651 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:09.487671 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:09.489147 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:09.489154 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:09.490993 (+ 1839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:09.491009 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:09.491936 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:09.491943 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:09.492256 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:09.493026 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:09.493054 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:09.495490 (+ 2436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:48:09.498868 (+ 3378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:48:09.498878 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:48:09.498896 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:48:09.499448 (+ 552us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:48:09.499979 (+ 531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:48:09.499983 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:48:09.499986 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:48:09.500299 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:48:09.500969 (+ 670us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:48:09.500976 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:48:09.501379 (+ 403us) client_negotiation.cc:769] Sending connection context
0811 18:48:09.501653 (+ 274us) client_negotiation.cc:240] Negotiation successful
0811 18:48:09.502287 (+ 634us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":312,"threads_started":1}
I20260811 18:48:09.505401 9203 heartbeater.cc:347] Connected to a master server at 127.25.25.62:38653
I20260811 18:48:09.505779 9203 heartbeater.cc:464] Registering TS with master...
I20260811 18:48:09.506655 9203 heartbeater.cc:511] Master 127.25.25.62:38653 requested a full tablet report, sending...
I20260811 18:48:09.508587 8364 ts_manager.cc:194] Registered new tserver with Master: 40fbb12c4d57482cb58301965022485e (127.25.25.3:44827)
I20260811 18:48:09.509424 8364 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.3@KRBTEST.COM'} at 127.25.25.3:59985
I20260811 18:48:09.516942 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.25.25.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.25.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.25.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.1.keytab.
Entry for principal oryx/127.25.25.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.1.keytab.
WARNING: no policy specified for oryx/127.25.25.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.25.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.25.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.2.keytab.
Entry for principal oryx/127.25.25.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.2.keytab.
WARNING: no policy specified for oryx/127.25.25.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.25.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.25.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.3.keytab.
Entry for principal oryx/127.25.25.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.3.keytab.
I20260811 18:48:09.699383 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 8484
Aug 11 18:48:09 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474087, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.1@KRBTEST.COM
I20260811 18:48:09.718147 9219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:09.700740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36642 (local address 127.25.25.1:38121)
0811 18:48:09.701382 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:09.701390 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:09.701418 (+ 28us) server_negotiation.cc:407] Connection header received
0811 18:48:09.701516 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:09.701523 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:09.701745 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:09.701884 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:09.703357 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:09.704619 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:09.706149 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:09.706828 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:09.706953 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:09.711732 (+ 4779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:09.711756 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:09.711774 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:09.711825 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:09.715097 (+ 3272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:09.715940 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:09.715948 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:09.715951 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:09.716154 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:09.716568 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:09.716572 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:09.716575 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:09.716998 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:09.717248 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:09.717483 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 18:48:09.717713 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":491,"thread_start_us":331,"threads_started":1}
I20260811 18:48:09.719578 8708 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:48:09.806177 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 8484
I20260811 18:48:09.836715 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 8723
Aug 11 18:48:09 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474087, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.2@KRBTEST.COM
I20260811 18:48:09.858912 9229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:09.838030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49736 (local address 127.25.25.2:34157)
0811 18:48:09.838621 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:09.838628 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:09.838655 (+ 27us) server_negotiation.cc:407] Connection header received
0811 18:48:09.838723 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:09.838731 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:09.838946 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:09.839095 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:09.840687 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:09.842071 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:09.843895 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:09.844791 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:09.844941 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:09.851247 (+ 6306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:09.851270 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:09.851289 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:09.851346 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:09.854942 (+ 3596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:09.856147 (+ 1205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:09.856160 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:09.856162 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:09.856361 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:09.856949 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:09.856954 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:09.856957 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:09.857420 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:09.857702 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:09.858215 (+ 513us) server_negotiation.cc:299] Negotiation successful
0811 18:48:09.858499 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":277,"threads_started":1}
I20260811 18:48:09.860417 8960 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:48:09.945034 8967 heartbeater.cc:503] Master 127.25.25.62:38653 was elected leader, sending a full tablet report...
I20260811 18:48:09.947422 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 8723
I20260811 18:48:09.980039 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 8982
Aug 11 18:48:09 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474087, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.3@KRBTEST.COM
I20260811 18:48:09.998286 9231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:09.981287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59212 (local address 127.25.25.3:44827)
0811 18:48:09.981885 (+ 598us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:09.981899 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:09.981937 (+ 38us) server_negotiation.cc:407] Connection header received
0811 18:48:09.982004 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:09.982011 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:09.982228 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:09.982401 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:09.983864 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:09.984980 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:09.986414 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:09.987006 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:09.987135 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:09.991851 (+ 4716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:09.991872 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:09.991889 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:09.991964 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:09.995166 (+ 3202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:09.996123 (+ 957us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:09.996133 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:09.996137 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:09.996299 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:09.996739 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:09.996742 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:09.996744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:09.997165 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:09.997416 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:09.997741 (+ 325us) server_negotiation.cc:299] Negotiation successful
0811 18:48:09.997992 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":251,"threads_started":1}
I20260811 18:48:09.999716 9192 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:48:10.084121 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 8982
I20260811 18:48:10.113893 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 8302
I20260811 18:48:10.115244 8424 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:48:10.222373 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 8302
I20260811 18:48:10.247538 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:38653
--webserver_interface=127.25.25.62
--webserver_port=45167
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:42261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:38653
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:48:10.609724 9235 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:48:10.610057 9235 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:48:10.610194 9235 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:48:10.617853 9235 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:48:10.618001 9235 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:48:10.618079 9235 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:48:10.618160 9235 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:48:10.618227 9235 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:48:10.628883 9235 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:42261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:38653
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:38653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=45167
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:48:10.630410 9235 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:48:10.631852 9235 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:48:10.644662 9251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:10.644770 9247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:10.644747 9249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:48:10.645215 9235 server_base.cc:1034] running on GCE node
I20260811 18:48:10.646214 9235 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:48:10.647881 9235 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:48:10.649121 9235 hybrid_clock.cc:648] HybridClock initialized: now 1786474090649052 us; error 64 us; skew 500 ppm
I20260811 18:48:10.649557 9235 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:48:10 dist-test-slave-lgr5 krb5kdc[8286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474090, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:48:10.655879 9235 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:48:10.657688 9235 webserver.cc:460] Webserver started at http://127.25.25.62:45167/ using document root <none> and password file <none>
I20260811 18:48:10.658450 9235 fs_manager.cc:359] Metadata directory not provided
I20260811 18:48:10.658602 9235 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:48:10.664650 9235 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 18:48:10.667802 9266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:10.669443 9235 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:48:10.669657 9235 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "77cdb457aa3242928a3dd17fde946490"
format_stamp: "Formatted at 2026-08-11 18:48:07 on dist-test-slave-lgr5"
server_key: "9c64ce0e29df4614cb2f482b88d093dc"
server_key_iv: "a5cbedea699a477332ce648b2e202623"
server_key_version: "encryptionkey@0"
I20260811 18:48:10.670787 9235 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:48:10.690647 9235 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:48:10.695277 9235 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:48:10.695600 9235 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:48:10.715615 9235 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:38653
I20260811 18:48:10.715627 9352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:38653 every 8 connection(s)
I20260811 18:48:10.717427 9235 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:48:10.725869 9353 sys_catalog.cc:263] Verifying existing consensus state
I20260811 18:48:10.727818 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 9235
I20260811 18:48:10.728935 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:38121
--local_ip_for_outbound_sockets=127.25.25.1
--tserver_master_addrs=127.25.25.62:38653
--webserver_port=42263
--webserver_interface=127.25.25.1
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:42261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.25.25.1
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.1.keytab with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:48:10.731181 9353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490: Bootstrap starting.
I20260811 18:48:10.754491 9353 log.cc:824] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490: Log is configured to *not* fsync() on all Append() calls
I20260811 18:48:10.765740 9353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:48:10.766423 9353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490: Bootstrap complete.
I20260811 18:48:10.777283 9353 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77cdb457aa3242928a3dd17fde946490" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38653 } }
I20260811 18:48:10.778282 9353 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77cdb457aa3242928a3dd17fde946490, State: Initialized, Role: FOLLOWER
I20260811 18:48:10.779074 9353 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77cdb457aa3242928a3dd17fde946490" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38653 } }
I20260811 18:48:10.779349 9353 raft_consensus.cc:388] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:48:10.779486 9353 raft_consensus.cc:482] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:48:10.779661 9353 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [term 1 FOLLOWER]: Advancing to term 2
I20260811 18:48:10.784416 9353 raft_consensus.cc:504] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77cdb457aa3242928a3dd17fde946490" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38653 } }
I20260811 18:48:10.785063 9353 leader_election.cc:302] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77cdb457aa3242928a3dd17fde946490; no voters:
I20260811 18:48:10.785781 9353 leader_election.cc:288] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 18:48:10.785938 9360 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 18:48:10.788057 9360 raft_consensus.cc:686] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [term 2 LEADER]: Becoming Leader. State: Replica: 77cdb457aa3242928a3dd17fde946490, State: Running, Role: LEADER
I20260811 18:48:10.788407 9353 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:48:10.788931 9360 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77cdb457aa3242928a3dd17fde946490" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38653 } }
I20260811 18:48:10.792657 9362 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "77cdb457aa3242928a3dd17fde946490" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77cdb457aa3242928a3dd17fde946490" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38653 } } }
I20260811 18:48:10.793123 9362 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [sys.catalog]: This master's current role is: LEADER
I20260811 18:48:10.793792 9363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77cdb457aa3242928a3dd17fde946490. Latest consensus state: current_term: 2 leader_uuid: "77cdb457aa3242928a3dd17fde946490" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77cdb457aa3242928a3dd17fde946490" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38653 } } }
I20260811 18:48:10.794186 9363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490 [sys.catalog]: This master's current role is: LEADER
I20260811 18:48:10.804950 9377 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:48:10.811583 9377 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:48:10.813534 9377 catalog_manager.cc:1259] Loaded cluster ID: d5231bfd30ab47c58c8abb76d5e91087
I20260811 18:48:10.813773 9377 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:48:10.818300 9377 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:48:10.820585 9377 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 77cdb457aa3242928a3dd17fde946490: Loaded TSK: 0
I20260811 18:48:10.822705 9377 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 18:48:11.108956 9358 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:48:11.109272 9358 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:48:11.109401 9358 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:48:11.117076 9358 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:48:11.117204 9358 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:48:11.117350 9358 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:48:11.127946 9358 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:42261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.1.keytab
--principal=oryx/127.25.25.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:38121
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=42263
--tserver_master_addrs=127.25.25.62:38653
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:48:11.129532 9358 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:48:11.130951 9358 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:48:11.145646 9403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:11.145643 9406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:11.146297 9402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:48:11.147086 9358 server_base.cc:1034] running on GCE node
I20260811 18:48:11.147859 9358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:48:11.149144 9358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:48:11.150386 9358 hybrid_clock.cc:648] HybridClock initialized: now 1786474091150311 us; error 60 us; skew 500 ppm
I20260811 18:48:11.150763 9358 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:48:11 dist-test-slave-lgr5 krb5kdc[8286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474091, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:48:11.154745 9358 init.cc:377] Logged in from keytab as oryx/127.25.25.1@KRBTEST.COM (short username oryx)
I20260811 18:48:11.156613 9358 webserver.cc:460] Webserver started at http://127.25.25.1:42263/ using document root <none> and password file <none>
I20260811 18:48:11.157585 9358 fs_manager.cc:359] Metadata directory not provided
I20260811 18:48:11.157740 9358 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:48:11.165316 9358 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 18:48:11.168874 9418 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:11.170688 9358 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 18:48:11.170886 9358 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "5b2736f7916f43c9ae764d6644696d0b"
format_stamp: "Formatted at 2026-08-11 18:48:08 on dist-test-slave-lgr5"
server_key: "10fa6c13a3e14f28d4ecef372dc95007"
server_key_iv: "fc388e1d8b116f0a91f040f0ffbbf319"
server_key_version: "encryptionkey@0"
I20260811 18:48:11.172344 9358 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:48:11.187328 9358 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:48:11.192487 9358 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:48:11.192764 9358 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:48:11.193857 9358 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:48:11.195433 9358 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:48:11.195530 9358 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:11.195621 9358 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:48:11.195675 9358 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:11.226760 9358 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:38121
I20260811 18:48:11.226824 9597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:38121 every 8 connection(s)
I20260811 18:48:11.228359 9358 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:48:11.231211 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 9358
I20260811 18:48:11.232028 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:34157
--local_ip_for_outbound_sockets=127.25.25.2
--tserver_master_addrs=127.25.25.62:38653
--webserver_port=37529
--webserver_interface=127.25.25.2
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:42261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.25.25.2
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.2.keytab with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:48:11 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:11 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:11.250310 9606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:11.231658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.1:42051)
0811 18:48:11.232601 (+ 943us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:11.232660 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:11.234434 (+ 1774us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:11.238017 (+ 3583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:11.238029 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:11.238674 (+ 645us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:11.239249 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:11.239269 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:11.241311 (+ 2042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:11.241316 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:11.242631 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:11.242647 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:11.243805 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:11.243814 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:11.244156 (+ 342us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:11.244864 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:11.244887 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:11.248856 (+ 3969us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":376,"threads_started":1}
W20260811 18:48:11.250334 9607 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:11.231724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:42051 (local address 127.25.25.62:38653)
0811 18:48:11.236628 (+ 4904us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:11.236640 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:11.236683 (+ 43us) server_negotiation.cc:407] Connection header received
0811 18:48:11.237017 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:11.237031 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:11.237389 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:11.237788 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:11.239477 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:11.241090 (+ 1613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:11.242806 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:11.243535 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:11.243747 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:11.249305 (+ 5558us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.1:42051: BlockingRecv error: recv got EOF from 127.25.25.1:42051 (error 108)
Metrics: {"server-negotiator.queue_time_us":4660,"thread_start_us":4432,"threads_started":1}
W20260811 18:48:11.251430 9600 heartbeater.cc:644] Failed to heartbeat to 127.25.25.62:38653 (0 consecutive failures): Not authorized: Failed to ping master at 127.25.25.62:38653: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Aug 11 18:48:11 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:11 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:11.260463 9606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:11.252219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.1:37253)
0811 18:48:11.252400 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:11.252419 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:11.252552 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:11.252851 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:11.252856 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:11.253230 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:11.253385 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:11.253395 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:11.254493 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:11.254497 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:11.255416 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:11.255438 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:11.256166 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:11.256172 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:11.256347 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:11.256917 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:11.256938 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:11.260149 (+ 3211us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 18:48:11.261060 9607 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:11.252382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:37253 (local address 127.25.25.62:38653)
0811 18:48:11.252565 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:11.252570 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:11.252591 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:48:11.252655 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:11.252661 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:11.252723 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:11.252803 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:11.253557 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:11.254331 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:11.255572 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:11.255990 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:11.256137 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:11.260429 (+ 4292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.1:37253: BlockingRecv error: recv got EOF from 127.25.25.1:37253 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 11 18:48:11 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:11 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:11.271027 9606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:11.261329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.1:41395)
0811 18:48:11.261555 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:11.261576 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:11.261690 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:11.262129 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:11.262133 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:11.262499 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:11.262681 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:11.262691 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:11.264287 (+ 1596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:11.264292 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:11.265300 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:11.265317 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:11.266324 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:11.266329 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:11.266501 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:11.267144 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:11.267163 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:11.270770 (+ 3607us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":85}
W20260811 18:48:11.271391 9607 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:11.261549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:41395 (local address 127.25.25.62:38653)
0811 18:48:11.261745 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:11.261751 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:11.261773 (+ 22us) server_negotiation.cc:407] Connection header received
0811 18:48:11.261839 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:11.261845 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:11.261941 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:11.262051 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:11.262831 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:11.264026 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:11.265464 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:11.266165 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:11.266298 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:11.271108 (+ 4810us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.1:41395: BlockingRecv error: recv got EOF from 127.25.25.1:41395 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260811 18:48:11.271427 9600 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 18:48:11.603041 9610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:48:11.603349 9610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:48:11.603447 9610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:48:11.611104 9610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:48:11.611243 9610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:48:11.611362 9610 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:48:11.621750 9610 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:42261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.2.keytab
--principal=oryx/127.25.25.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:34157
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=37529
--tserver_master_addrs=127.25.25.62:38653
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:48:11.623229 9610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:48:11.624661 9610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:48:11.638598 9620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:11.638530 9621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:11.638561 9623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:48:11.639705 9610 server_base.cc:1034] running on GCE node
I20260811 18:48:11.640436 9610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:48:11.641476 9610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:48:11.642743 9610 hybrid_clock.cc:648] HybridClock initialized: now 1786474091642700 us; error 39 us; skew 500 ppm
I20260811 18:48:11.643127 9610 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:48:11 dist-test-slave-lgr5 krb5kdc[8286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474091, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:48:11.646508 9610 init.cc:377] Logged in from keytab as oryx/127.25.25.2@KRBTEST.COM (short username oryx)
I20260811 18:48:11.648169 9610 webserver.cc:460] Webserver started at http://127.25.25.2:37529/ using document root <none> and password file <none>
I20260811 18:48:11.648887 9610 fs_manager.cc:359] Metadata directory not provided
I20260811 18:48:11.649014 9610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:48:11.654896 9610 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 18:48:11.657927 9637 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:11.659427 9610 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 18:48:11.659611 9610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "4a302afc5f1d4ad8a60bb38583eab18f"
format_stamp: "Formatted at 2026-08-11 18:48:08 on dist-test-slave-lgr5"
server_key: "66431e356a1165885b71206c6e3f7e5c"
server_key_iv: "f8ee611a20ec3068762579e3cb4a87d0"
server_key_version: "encryptionkey@0"
I20260811 18:48:11.660760 9610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:48:11.691919 9610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:48:11.697131 9610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:48:11.697461 9610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:48:11.698698 9610 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:48:11.700539 9610 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:48:11.700649 9610 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:11.700781 9610 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:48:11.700856 9610 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:11.737948 9610 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:34157
I20260811 18:48:11.738059 9831 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:34157 every 8 connection(s)
I20260811 18:48:11.739652 9610 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:48:11.744872 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 9610
I20260811 18:48:11.745553 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:44827
--local_ip_for_outbound_sockets=127.25.25.3
--tserver_master_addrs=127.25.25.62:38653
--webserver_port=36237
--webserver_interface=127.25.25.3
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:42261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.25.25.3
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.3.keytab with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:48:11 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:11 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 18:48:11.757741 9607 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:11.742815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:34111 (local address 127.25.25.62:38653)
0811 18:48:11.743020 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:11.743024 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:11.744465 (+ 1441us) server_negotiation.cc:407] Connection header received
0811 18:48:11.746595 (+ 2130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:11.746601 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:11.746691 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:11.746780 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:11.748536 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:11.749269 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:11.750949 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:11.751392 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:11.751518 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:11.757427 (+ 5909us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.2:34111: BlockingRecv error: recv got EOF from 127.25.25.2:34111 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 18:48:11.758594 9834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:11.743364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.2:34111)
0811 18:48:11.744283 (+ 919us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:11.744329 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:11.746262 (+ 1933us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:11.747058 (+ 796us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:11.747067 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:11.747648 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:11.748323 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:11.748345 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:11.749447 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:11.749452 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:11.750761 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:11.750790 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:11.751649 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:11.751657 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:11.751919 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:11.752674 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:11.752702 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:11.757076 (+ 4374us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":371,"threads_started":1}
W20260811 18:48:11.759420 9832 heartbeater.cc:644] Failed to heartbeat to 127.25.25.62:38653 (0 consecutive failures): Not authorized: Failed to ping master at 127.25.25.62:38653: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Aug 11 18:48:11 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:11 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:11.768741 9834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:11.760159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.2:53083)
0811 18:48:11.760368 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:11.760389 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:11.760506 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:11.760858 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:11.760861 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:11.761279 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:11.761452 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:11.761461 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:11.762847 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:11.762852 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:11.763803 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:11.763818 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:11.764757 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:11.764762 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:11.764901 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:11.765591 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:11.765610 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:11.768524 (+ 2914us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 18:48:11.769101 9607 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:11.760276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:53083 (local address 127.25.25.62:38653)
0811 18:48:11.760489 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:11.760495 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:11.760518 (+ 23us) server_negotiation.cc:407] Connection header received
0811 18:48:11.760628 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:11.760633 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:11.760708 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:11.760810 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:11.761629 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:11.762669 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:11.763994 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:11.764590 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:11.764755 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:11.768836 (+ 4081us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.2:53083: BlockingRecv error: recv got EOF from 127.25.25.2:53083 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 11 18:48:11 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:11 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:11.777958 9834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:11.769593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.2:53417)
0811 18:48:11.769750 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:11.769768 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:11.769855 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:11.770176 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:11.770179 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:11.770460 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:11.770619 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:11.770627 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:11.771997 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:11.772002 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:11.772998 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:11.773012 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:11.773925 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:11.773931 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:11.774089 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:11.774697 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:11.774713 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:11.777734 (+ 3021us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 18:48:11.778241 9607 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:11.769705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:53417 (local address 127.25.25.62:38653)
0811 18:48:11.769877 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:11.769882 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:11.769902 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:48:11.769966 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:11.769971 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:11.770049 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:11.770159 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:11.770760 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:11.771836 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:11.773144 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:11.773792 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:11.773927 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:11.778005 (+ 4078us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.2:53417: BlockingRecv error: recv got EOF from 127.25.25.2:53417 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260811 18:48:11.778352 9832 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 18:48:12.281960 9836 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:48:12.282588 9836 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:48:12.282915 9836 flags.cc:425] Enabled unsafe flag: --never_fsync=true
Aug 11 18:48:12 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:12 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:12.289796 9846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:12.272719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.1:36117)
0811 18:48:12.273605 (+ 886us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:12.273632 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:12.273855 (+ 223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:12.274426 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:12.274441 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:12.275417 (+ 976us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:12.275820 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:12.275840 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:12.277925 (+ 2085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:12.277933 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:12.279929 (+ 1996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:12.279969 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:12.281529 (+ 1560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:12.281548 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:12.281921 (+ 373us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:12.283020 (+ 1099us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:12.283083 (+ 63us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:12.289126 (+ 6043us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":697,"thread_start_us":471,"threads_started":1}
W20260811 18:48:12.289973 9607 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:12.272852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:36117 (local address 127.25.25.62:38653)
0811 18:48:12.273193 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:12.273220 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:12.273766 (+ 546us) server_negotiation.cc:407] Connection header received
0811 18:48:12.274104 (+ 338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:12.274109 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:12.274208 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:12.274357 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:12.276065 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:12.277652 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:12.280305 (+ 2653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:12.281151 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:12.281385 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:12.289578 (+ 8193us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.1:36117: BlockingRecv error: recv got EOF from 127.25.25.1:36117 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260811 18:48:12.297544 9836 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:48:12.297757 9836 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:48:12.298064 9836 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:48:12.316357 9836 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:42261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/krb5kdc/oryx_127.25.25.3.keytab
--principal=oryx/127.25.25.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:44827
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=36237
--tserver_master_addrs=127.25.25.62:38653
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:48:12.318702 9836 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:48:12.321177 9836 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:48:12.345448 9853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:12.345338 9852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:12.345340 9857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:48:12.346607 9836 server_base.cc:1034] running on GCE node
I20260811 18:48:12.347849 9836 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:48:12.349774 9836 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:48:12.351169 9836 hybrid_clock.cc:648] HybridClock initialized: now 1786474092351073 us; error 68 us; skew 500 ppm
I20260811 18:48:12.351804 9836 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:48:12 dist-test-slave-lgr5 krb5kdc[8286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474092, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:48:12.357764 9836 init.cc:377] Logged in from keytab as oryx/127.25.25.3@KRBTEST.COM (short username oryx)
I20260811 18:48:12.360757 9836 webserver.cc:460] Webserver started at http://127.25.25.3:36237/ using document root <none> and password file <none>
I20260811 18:48:12.362159 9836 fs_manager.cc:359] Metadata directory not provided
I20260811 18:48:12.362390 9836 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:48:12.373615 9836 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.007s sys 0.000s
I20260811 18:48:12.379171 9869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:12.381991 9836 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.000s
I20260811 18:48:12.382311 9836 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "40fbb12c4d57482cb58301965022485e"
format_stamp: "Formatted at 2026-08-11 18:48:09 on dist-test-slave-lgr5"
server_key: "6b49fbdc60c1d8e2a60e461084db7075"
server_key_iv: "7cd06e27b912252a03bfe6bdb3325a08"
server_key_version: "encryptionkey@0"
I20260811 18:48:12.384346 9836 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:48:12.413549 9836 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:48:12.420667 9836 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:48:12.421110 9836 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:48:12.423020 9836 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:48:12.425833 9836 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:48:12.426003 9836 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:12.426210 9836 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:48:12.426348 9836 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:12.482090 9836 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:44827
I20260811 18:48:12.482229 10056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:44827 every 8 connection(s)
I20260811 18:48:12.484647 9836 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:48:12.492481 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 9836
Aug 11 18:48:12 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:12 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 18:48:12.516413 9607 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:12.489802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:55569 (local address 127.25.25.62:38653)
0811 18:48:12.490065 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:12.490102 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:12.492529 (+ 2427us) server_negotiation.cc:407] Connection header received
0811 18:48:12.496661 (+ 4132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:12.496671 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:12.496832 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:12.496994 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:12.500408 (+ 3414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:12.501829 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:12.504544 (+ 2715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:12.505345 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:12.505611 (+ 266us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:12.515973 (+ 10362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.3:55569: BlockingRecv error: recv got EOF from 127.25.25.3:55569 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 18:48:12.518940 10064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:12.490697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.3:55569)
0811 18:48:12.492240 (+ 1543us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:12.492322 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:12.496065 (+ 3743us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:12.497489 (+ 1424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:12.497499 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:12.498744 (+ 1245us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:12.500053 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:12.500139 (+ 86us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:12.502176 (+ 2037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:12.502190 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:12.504287 (+ 2097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:12.504320 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:12.505916 (+ 1596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:12.505935 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:12.506366 (+ 431us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:12.507464 (+ 1098us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:12.507527 (+ 63us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:12.515698 (+ 8171us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":907,"thread_start_us":596,"threads_started":1}
W20260811 18:48:12.520553 10057 heartbeater.cc:644] Failed to heartbeat to 127.25.25.62:38653 (0 consecutive failures): Not authorized: Failed to ping master at 127.25.25.62:38653: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
I20260811 18:48:12.526623 10066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:12.494332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43402 (local address 127.25.25.62:38653)
0811 18:48:12.495814 (+ 1482us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:12.495831 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:12.495863 (+ 32us) server_negotiation.cc:407] Connection header received
0811 18:48:12.495948 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:12.495952 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:12.496061 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:12.496315 (+ 254us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:12.499491 (+ 3176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:12.500947 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:12.503469 (+ 2522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:12.504215 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:12.504571 (+ 356us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:12.510470 (+ 5899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:12.510499 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:12.510547 (+ 48us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:12.510638 (+ 91us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:12.518402 (+ 7764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:12.520477 (+ 2075us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:12.520493 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:12.520514 (+ 21us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:12.521001 (+ 487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:12.521999 (+ 998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:12.522019 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:12.522025 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:12.523570 (+ 1545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:12.524322 (+ 752us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:12.525257 (+ 935us) server_negotiation.cc:299] Negotiation successful
0811 18:48:12.525959 (+ 702us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1246,"thread_start_us":1038,"threads_started":1}
Aug 11 18:48:12 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:12 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:12.539073 10064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:12.521784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.3:42685)
0811 18:48:12.522319 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:12.522358 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:12.522602 (+ 244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:12.523246 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:12.523255 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:12.524319 (+ 1064us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:12.524763 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:12.524801 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:12.526772 (+ 1971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:12.526781 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:12.529468 (+ 2687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:12.529498 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:12.531318 (+ 1820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:12.531334 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:12.531777 (+ 443us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:12.533076 (+ 1299us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:12.533131 (+ 55us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:12.538678 (+ 5547us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227}
W20260811 18:48:12.540326 9607 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:12.522076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:42685 (local address 127.25.25.62:38653)
0811 18:48:12.522458 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:12.522464 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:12.522491 (+ 27us) server_negotiation.cc:407] Connection header received
0811 18:48:12.522874 (+ 383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:12.522879 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:12.522985 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:12.523105 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:12.525069 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:12.526496 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:12.529728 (+ 3232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:12.530992 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:12.531214 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:12.539158 (+ 7944us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.3:42685: BlockingRecv error: recv got EOF from 127.25.25.3:42685 (error 108)
Metrics: {"server-negotiator.queue_time_us":210}
Aug 11 18:48:12 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:12 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:12.554930 10064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:12.540352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.3:53501)
0811 18:48:12.540720 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:12.540747 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:12.540881 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:12.541467 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:12.541482 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:12.541899 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:12.542156 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:12.542180 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:12.544238 (+ 2058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:12.544244 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:12.546590 (+ 2346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:12.546644 (+ 54us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:12.548215 (+ 1571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:12.548222 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:12.548676 (+ 454us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:12.549631 (+ 955us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:12.549682 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:12.554545 (+ 4863us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":157}
W20260811 18:48:12.555459 9607 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:12.540519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:53501 (local address 127.25.25.62:38653)
0811 18:48:12.540986 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:12.540991 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:12.541029 (+ 38us) server_negotiation.cc:407] Connection header received
0811 18:48:12.541112 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:12.541123 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:12.541218 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:12.541344 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:12.542485 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:12.543905 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:12.546854 (+ 2949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:12.547899 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:12.548199 (+ 300us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:12.554982 (+ 6783us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.3:53501: BlockingRecv error: recv got EOF from 127.25.25.3:53501 (error 108)
Metrics: {"mutex_wait_us":147,"server-negotiator.queue_time_us":235}
W20260811 18:48:12.555482 10057 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 18:48:12 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:12 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:12.795130 10068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:12.779406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.2:34505)
0811 18:48:12.780227 (+ 821us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:12.780253 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:12.780443 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:12.780979 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:12.780983 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:12.781772 (+ 789us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:12.782127 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:12.782147 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:12.783839 (+ 1692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:12.783845 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:12.786378 (+ 2533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:12.786414 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:12.788198 (+ 1784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:12.788205 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:12.788522 (+ 317us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:12.789533 (+ 1011us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:12.789568 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:12.794663 (+ 5095us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":400,"threads_started":1}
W20260811 18:48:12.795557 9607 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:12.779519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:34505 (local address 127.25.25.62:38653)
0811 18:48:12.779933 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:12.779954 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:12.780359 (+ 405us) server_negotiation.cc:407] Connection header received
0811 18:48:12.780629 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:12.780636 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:12.780758 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:12.780925 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:12.782416 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:12.783530 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:12.786716 (+ 3186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:12.787846 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:12.788045 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:12.795142 (+ 7097us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.2:34505: BlockingRecv error: recv got EOF from 127.25.25.2:34505 (error 108)
Metrics: {"server-negotiator.queue_time_us":126}
Aug 11 18:48:13 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:13 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:13.300688 10075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:13.291099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.1:60811)
0811 18:48:13.291666 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:13.291683 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:13.291832 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:13.292234 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:13.292244 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:13.292697 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:13.292861 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:13.292872 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:13.293964 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:13.293968 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:13.295110 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:13.295129 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:13.295988 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:13.295995 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:13.296230 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:13.297055 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:13.297076 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:13.300297 (+ 3221us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":294,"threads_started":1}
W20260811 18:48:13.300900 9607 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:13.291174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:60811 (local address 127.25.25.62:38653)
0811 18:48:13.291446 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:13.291453 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:13.291776 (+ 323us) server_negotiation.cc:407] Connection header received
0811 18:48:13.291975 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:13.291979 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:13.292066 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:13.292176 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:13.293024 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:13.293797 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:13.295314 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:13.295794 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:13.295930 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:13.300610 (+ 4680us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.1:60811: BlockingRecv error: recv got EOF from 127.25.25.1:60811 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 11 18:48:13 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:13 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:13.566409 10076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:13.556351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.3:45047)
0811 18:48:13.556937 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:13.556954 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:13.557085 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:13.557546 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:13.557550 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:13.558060 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:13.558275 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:13.558286 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:13.559959 (+ 1673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:13.559964 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:13.561289 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:13.561310 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:13.562229 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:13.562235 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:13.562385 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:13.563066 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:13.563085 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:13.566156 (+ 3071us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":280,"threads_started":1}
W20260811 18:48:13.566720 9607 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:13.556487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:45047 (local address 127.25.25.62:38653)
0811 18:48:13.556688 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:13.556692 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:13.557049 (+ 357us) server_negotiation.cc:407] Connection header received
0811 18:48:13.557249 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:13.557254 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:13.557329 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:13.557434 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:13.558552 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:13.559754 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:13.561477 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:13.561944 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:13.562097 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:13.566422 (+ 4325us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.3:45047: BlockingRecv error: recv got EOF from 127.25.25.3:45047 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 11 18:48:13 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:13 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:13.805330 10079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:13.796436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.2:38345)
0811 18:48:13.797046 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:13.797063 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:13.797219 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:13.797631 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:13.797636 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:13.798163 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:13.798332 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:13.798342 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:13.799579 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:13.799583 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:13.800626 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:13.800642 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:13.801373 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:13.801378 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:13.801542 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:13.802148 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:13.802168 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:13.804995 (+ 2827us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":308,"threads_started":1}
W20260811 18:48:13.805506 9607 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:13.796632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:38345 (local address 127.25.25.62:38653)
0811 18:48:13.796856 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:13.796862 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:13.797160 (+ 298us) server_negotiation.cc:407] Connection header received
0811 18:48:13.797357 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:13.797361 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:13.797457 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:13.797549 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:13.798502 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:13.799441 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:13.800768 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:13.801215 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:13.801328 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:13.805249 (+ 3921us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.2:38345: BlockingRecv error: recv got EOF from 127.25.25.2:38345 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 11 18:48:14 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:14 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:14.316434 10080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:14.302157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.1:54989)
0811 18:48:14.302725 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:14.302748 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:14.302900 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:14.303277 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:14.303280 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:14.303659 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:14.303855 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:14.303864 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:14.305102 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:14.305107 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:14.306458 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:14.306478 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:14.307398 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:14.307405 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:14.307615 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:14.312579 (+ 4964us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:14.312607 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:14.316132 (+ 3525us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":324,"threads_started":1}
W20260811 18:48:14.316730 9607 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:14.302462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:54989 (local address 127.25.25.62:38653)
0811 18:48:14.302672 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:14.302676 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:14.302831 (+ 155us) server_negotiation.cc:407] Connection header received
0811 18:48:14.303062 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:14.303067 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:14.303140 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:14.303241 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:14.304063 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:14.304904 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:14.306618 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:14.307181 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:14.307324 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:14.316446 (+ 9122us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.1:54989: BlockingRecv error: recv got EOF from 127.25.25.1:54989 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 11 18:48:14 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:14 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:14.578354 10081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:14.567417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.3:32885)
0811 18:48:14.567987 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:14.568007 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:14.568169 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:14.568529 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:14.568535 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:14.569121 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:14.569330 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:14.569344 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:14.570683 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:14.570690 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:14.572252 (+ 1562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:14.572272 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:14.573261 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:14.573268 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:14.573445 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:14.574150 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:14.574176 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:14.577966 (+ 3790us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":299,"threads_started":1}
W20260811 18:48:14.578399 9607 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:14.567428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:32885 (local address 127.25.25.62:38653)
0811 18:48:14.567612 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:14.567618 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:14.568101 (+ 483us) server_negotiation.cc:407] Connection header received
0811 18:48:14.568288 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:14.568292 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:14.568374 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:14.568480 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:14.569465 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:14.570523 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:14.572464 (+ 1941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:14.573081 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:14.573205 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:14.578164 (+ 4959us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.3:32885: BlockingRecv error: recv got EOF from 127.25.25.3:32885 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 11 18:48:14 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:14 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:14.816768 10082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:14.806576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.2:51465)
0811 18:48:14.807462 (+ 886us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:14.807484 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:14.807639 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:14.807989 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:14.807993 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:14.808576 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:14.808808 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:14.808821 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:14.810287 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:14.810294 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:14.811366 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:14.811385 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:14.812218 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:14.812225 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:14.812440 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:14.813157 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:14.813178 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:14.816329 (+ 3151us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":750,"thread_start_us":608,"threads_started":1}
W20260811 18:48:14.816867 9607 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:14.806759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:51465 (local address 127.25.25.62:38653)
0811 18:48:14.807003 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:14.807012 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:14.807591 (+ 579us) server_negotiation.cc:407] Connection header received
0811 18:48:14.807751 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:14.807755 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:14.807825 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:14.807920 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:14.809014 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:14.810103 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:14.811543 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:14.812019 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:14.812195 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:14.816629 (+ 4434us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.2:51465: BlockingRecv error: recv got EOF from 127.25.25.2:51465 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 11 18:48:15 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:15 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:15.327889 10085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:15.317684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.1:38479)
0811 18:48:15.318721 (+ 1037us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:15.318744 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:15.318886 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:15.319496 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:15.319500 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:15.319891 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:15.320133 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:15.320147 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:15.321308 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:15.321312 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:15.322335 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:15.322350 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:15.323216 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:15.323221 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:15.323427 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:15.324161 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:15.324188 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:15.327619 (+ 3431us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":868,"thread_start_us":735,"threads_started":1}
W20260811 18:48:15.328240 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:15.317853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:38479 (local address 127.25.25.62:38653)
0811 18:48:15.319076 (+ 1223us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:15.319082 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:15.319105 (+ 23us) server_negotiation.cc:407] Connection header received
0811 18:48:15.319168 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:15.319174 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:15.319329 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:15.319433 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:15.320309 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:15.321153 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:15.322540 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:15.323009 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:15.323127 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:15.327954 (+ 4827us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.1:38479: BlockingRecv error: recv got EOF from 127.25.25.1:38479 (error 108)
Metrics: {"server-negotiator.queue_time_us":1102,"thread_start_us":944,"threads_started":1}
Aug 11 18:48:15 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:15 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:15.589105 10090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:15.579714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.3:52389)
0811 18:48:15.580345 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:15.580362 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:15.580538 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:15.580894 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:15.580900 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:15.581306 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:15.581490 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:15.581500 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:15.582625 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:15.582630 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:15.583576 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:15.583591 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:15.584389 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:15.584396 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:15.584589 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:15.585323 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:15.585345 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:15.588685 (+ 3340us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":366,"threads_started":1}
W20260811 18:48:15.589250 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:15.579983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:52389 (local address 127.25.25.62:38653)
0811 18:48:15.580267 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:15.580273 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:15.580472 (+ 199us) server_negotiation.cc:407] Connection header received
0811 18:48:15.580672 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:15.580676 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:15.580744 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:15.580831 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:15.581663 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:15.582445 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:15.583739 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:15.584220 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:15.584365 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:15.588912 (+ 4547us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.3:52389: BlockingRecv error: recv got EOF from 127.25.25.3:52389 (error 108)
Metrics: {"server-negotiator.queue_time_us":129}
Aug 11 18:48:15 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:15 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:15.831609 10094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:15.818224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.2:53697)
0811 18:48:15.818859 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:15.818880 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:15.819025 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:15.819540 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:15.819544 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:15.820009 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:15.820231 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:15.820242 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:15.821554 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:15.821559 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:15.822625 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:15.822643 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:15.823473 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:15.823478 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:15.823639 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:15.827746 (+ 4107us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:15.827773 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:15.831257 (+ 3484us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":365,"threads_started":1}
W20260811 18:48:15.831844 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:15.818363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:53697 (local address 127.25.25.62:38653)
0811 18:48:15.818692 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:15.818699 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:15.819007 (+ 308us) server_negotiation.cc:407] Connection header received
0811 18:48:15.819144 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:15.819150 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:15.819342 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:15.819481 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:15.820404 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:15.821382 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:15.822790 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:15.823279 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:15.823383 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:15.831566 (+ 8183us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.2:53697: BlockingRecv error: recv got EOF from 127.25.25.2:53697 (error 108)
Metrics: {"server-negotiator.queue_time_us":168}
Aug 11 18:48:16 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:16 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:16.338347 10095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:16.329160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.1:58651)
0811 18:48:16.329936 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:16.329954 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:16.330089 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:16.330474 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:16.330479 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:16.330999 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:16.331176 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:16.331185 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:16.332260 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:16.332264 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:16.333216 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:16.333231 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:16.333967 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:16.333972 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:16.334145 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:16.334779 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:16.334799 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:16.338067 (+ 3268us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":651,"thread_start_us":481,"threads_started":1}
W20260811 18:48:16.338549 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:16.329266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:58651 (local address 127.25.25.62:38653)
0811 18:48:16.329453 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:16.329459 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:16.330041 (+ 582us) server_negotiation.cc:407] Connection header received
0811 18:48:16.330213 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:16.330217 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:16.330305 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:16.330417 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:16.331321 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:16.332072 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:16.333367 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:16.333798 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:16.333912 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:16.338335 (+ 4423us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.1:58651: BlockingRecv error: recv got EOF from 127.25.25.1:58651 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 11 18:48:16 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:16 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:16.600508 10096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:16.590365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.3:42821)
0811 18:48:16.590960 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:16.590979 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:16.591122 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:16.591519 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:16.591523 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:16.592004 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:16.592293 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:16.592311 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:16.593835 (+ 1524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:16.593840 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:16.594862 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:16.594880 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:16.595863 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:16.595869 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:16.596039 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:16.596710 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:16.596732 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:16.600183 (+ 3451us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":307,"threads_started":1}
W20260811 18:48:16.600735 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:16.590380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:42821 (local address 127.25.25.62:38653)
0811 18:48:16.590560 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:16.590565 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:16.591095 (+ 530us) server_negotiation.cc:407] Connection header received
0811 18:48:16.591228 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:16.591232 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:16.591344 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:16.591434 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:16.592584 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:16.593630 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:16.595171 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:16.595658 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:16.595797 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:16.600502 (+ 4705us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.3:42821: BlockingRecv error: recv got EOF from 127.25.25.3:42821 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 11 18:48:16 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:16 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:16.842108 10097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:16.832904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.2:54283)
0811 18:48:16.833558 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:16.833575 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:16.833723 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:16.834131 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:16.834136 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:16.834578 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:16.834752 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:16.834762 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:16.835820 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:16.835825 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:16.836833 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:16.836848 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:16.837679 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:16.837686 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:16.837859 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:16.838569 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:16.838589 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:16.841822 (+ 3233us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":312,"threads_started":1}
W20260811 18:48:16.842317 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:16.833186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:54283 (local address 127.25.25.62:38653)
0811 18:48:16.833416 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:16.833422 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:16.833671 (+ 249us) server_negotiation.cc:407] Connection header received
0811 18:48:16.833859 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:16.833863 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:16.833946 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:16.834055 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:16.834912 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:16.835658 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:16.836994 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:16.837496 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:16.837619 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:16.842093 (+ 4474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.2:54283: BlockingRecv error: recv got EOF from 127.25.25.2:54283 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 11 18:48:17 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:17 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:17.348693 10099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:17.339689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.1:53011)
0811 18:48:17.340279 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:17.340297 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:17.340455 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:17.340780 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:17.340784 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:17.341187 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:17.341345 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:17.341355 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:17.342510 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:17.342517 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:17.343697 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:17.343714 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:17.344510 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:17.344516 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:17.344686 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:17.345272 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:17.345291 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:17.348361 (+ 3070us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":389,"threads_started":1}
W20260811 18:48:17.348948 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:17.339815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:53011 (local address 127.25.25.62:38653)
0811 18:48:17.340204 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:17.340210 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:17.340379 (+ 169us) server_negotiation.cc:407] Connection header received
0811 18:48:17.340599 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:17.340605 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:17.340676 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:17.340765 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:17.341479 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:17.342279 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:17.343863 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:17.344337 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:17.344466 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:17.348703 (+ 4237us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.1:53011: BlockingRecv error: recv got EOF from 127.25.25.1:53011 (error 108)
Metrics: {"server-negotiator.queue_time_us":193}
Aug 11 18:48:17 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:17 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:17.610208 10100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:17.601695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.3:42251)
0811 18:48:17.602248 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:17.602266 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:17.602408 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:17.602771 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:17.602775 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:17.603215 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:17.603393 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:17.603404 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:17.604441 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:17.604446 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:17.605484 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:17.605499 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:17.606191 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:17.606195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:17.606312 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:17.606931 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:17.606950 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:17.609956 (+ 3006us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":269,"threads_started":1}
W20260811 18:48:17.610379 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:17.601809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:42251 (local address 127.25.25.62:38653)
0811 18:48:17.602097 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:17.602104 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:17.602383 (+ 279us) server_negotiation.cc:407] Connection header received
0811 18:48:17.602531 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:17.602535 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:17.602604 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:17.602683 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:17.603534 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:17.604312 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:17.605629 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:17.606071 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:17.606192 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:17.610159 (+ 3967us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.3:42251: BlockingRecv error: recv got EOF from 127.25.25.3:42251 (error 108)
Metrics: {"server-negotiator.queue_time_us":106}
Aug 11 18:48:17 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:17 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:17.853605 10102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:17.843268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.2:51905)
0811 18:48:17.843917 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:17.843939 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:17.844136 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:17.844868 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:17.844873 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:17.845424 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:17.845634 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:17.845650 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:17.846923 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:17.846928 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:17.847892 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:17.847908 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:17.848741 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:17.848748 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:17.848942 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:17.849727 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:17.849746 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:17.853270 (+ 3524us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":396,"threads_started":1}
W20260811 18:48:17.853932 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:17.843426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:51905 (local address 127.25.25.62:38653)
0811 18:48:17.843690 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:17.843698 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:17.844049 (+ 351us) server_negotiation.cc:407] Connection header received
0811 18:48:17.844338 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:17.844345 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:17.844479 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:17.844602 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:17.845801 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:17.846746 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:17.848064 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:17.848558 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:17.848679 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:17.853544 (+ 4865us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.2:51905: BlockingRecv error: recv got EOF from 127.25.25.2:51905 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
Aug 11 18:48:18 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:18 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:18.358546 10103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:18.349873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.1:46095)
0811 18:48:18.350521 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:18.350538 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:18.350694 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:18.351035 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:18.351040 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:18.351490 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:18.351666 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:18.351676 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:18.352780 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:18.352784 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:18.353733 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:18.353747 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:18.354508 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:18.354514 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:18.354674 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:18.355291 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:18.355311 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:18.358194 (+ 2883us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":298,"threads_started":1}
W20260811 18:48:18.358712 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:18.349946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:46095 (local address 127.25.25.62:38653)
0811 18:48:18.350121 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:18.350128 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:18.350642 (+ 514us) server_negotiation.cc:407] Connection header received
0811 18:48:18.350819 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:18.350824 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:18.350894 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:18.350976 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:18.351817 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:18.352631 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:18.353882 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:18.354341 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:18.354461 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:18.358475 (+ 4014us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.1:46095: BlockingRecv error: recv got EOF from 127.25.25.1:46095 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 11 18:48:18 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:18 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:18.621073 10104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:18.611406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.3:35571)
0811 18:48:18.612064 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:18.612107 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:18.612251 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:18.612715 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:18.612719 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:18.613158 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:18.613344 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:18.613355 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:18.614657 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:18.614662 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:18.615933 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:18.615954 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:18.616908 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:18.616913 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:18.617097 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:18.617852 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:18.617872 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:18.620807 (+ 2935us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":347,"threads_started":1}
W20260811 18:48:18.621305 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:18.611620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:35571 (local address 127.25.25.62:38653)
0811 18:48:18.611798 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:18.611804 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:18.612243 (+ 439us) server_negotiation.cc:407] Connection header received
0811 18:48:18.612367 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:18.612371 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:18.612510 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:18.612609 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:18.613594 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:18.614463 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:18.616147 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:18.616729 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:18.616858 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:18.621067 (+ 4209us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.3:35571: BlockingRecv error: recv got EOF from 127.25.25.3:35571 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 11 18:48:18 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:18 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:18.863533 10105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:18.854759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.2:45001)
0811 18:48:18.855457 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:18.855474 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:18.855656 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:18.856026 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:18.856031 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:18.856617 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:18.856849 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:18.856861 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:18.857841 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:18.857844 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:18.858762 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:18.858773 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:18.859520 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:18.859525 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:18.859655 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:18.860255 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:18.860273 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:18.863188 (+ 2915us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":309,"threads_started":1}
W20260811 18:48:18.863682 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:18.854881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:45001 (local address 127.25.25.62:38653)
0811 18:48:18.855200 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:18.855206 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:18.855590 (+ 384us) server_negotiation.cc:407] Connection header received
0811 18:48:18.855793 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:18.855798 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:18.855874 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:18.855956 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:18.856985 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:18.857730 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:18.858908 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:18.859347 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:18.859453 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:18.863448 (+ 3995us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.2:45001: BlockingRecv error: recv got EOF from 127.25.25.2:45001 (error 108)
Metrics: {"server-negotiator.queue_time_us":149}
Aug 11 18:48:19 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:19 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:19.369572 10107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:19.359718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.1:46515)
0811 18:48:19.360755 (+ 1037us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:19.360778 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:19.360950 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:19.361382 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:19.361387 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:19.362039 (+ 652us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:19.362218 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:19.362229 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:19.363452 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:19.363457 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:19.364524 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:19.364542 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:19.365388 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:19.365394 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:19.365529 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:19.366169 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:19.366190 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:19.369300 (+ 3110us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":872,"thread_start_us":759,"threads_started":1}
W20260811 18:48:19.369840 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:19.359901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:46515 (local address 127.25.25.62:38653)
0811 18:48:19.360179 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:19.360186 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:19.360882 (+ 696us) server_negotiation.cc:407] Connection header received
0811 18:48:19.361077 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:19.361083 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:19.361169 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:19.361271 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:19.362365 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:19.363266 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:19.364679 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:19.365165 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:19.365269 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:19.369567 (+ 4298us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.1:46515: BlockingRecv error: recv got EOF from 127.25.25.1:46515 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
Aug 11 18:48:19 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:19 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:19.631870 10108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:19.622285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.3:52663)
0811 18:48:19.622924 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:19.622941 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:19.623079 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:19.623455 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:19.623458 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:19.623883 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:19.624067 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:19.624130 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:19.625363 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:19.625368 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:19.626393 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:19.626410 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:19.627264 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:19.627270 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:19.627452 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:19.628165 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:19.628190 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:19.631594 (+ 3404us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":269,"threads_started":1}
W20260811 18:48:19.632030 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:19.622523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:52663 (local address 127.25.25.62:38653)
0811 18:48:19.622714 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:19.622718 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:19.623025 (+ 307us) server_negotiation.cc:407] Connection header received
0811 18:48:19.623214 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:19.623218 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:19.623289 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:19.623382 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:19.624317 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:19.625140 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:19.626589 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:19.627061 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:19.627174 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:19.631812 (+ 4638us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.3:52663: BlockingRecv error: recv got EOF from 127.25.25.3:52663 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 11 18:48:19 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:19 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:19.875181 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:19.864686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.2:52323)
0811 18:48:19.865448 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:19.865469 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:19.865635 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:19.866037 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:19.866042 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:19.866537 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:19.866708 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:19.866720 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:19.868246 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:19.868253 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:19.869703 (+ 1450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:19.869727 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:19.870962 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:19.870971 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:19.871160 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:19.871834 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:19.871853 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:19.874900 (+ 3047us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":376,"threads_started":1}
W20260811 18:48:19.875358 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:19.864934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:52323 (local address 127.25.25.62:38653)
0811 18:48:19.865202 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:19.865208 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:19.865574 (+ 366us) server_negotiation.cc:407] Connection header received
0811 18:48:19.865764 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:19.865768 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:19.865861 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:19.865972 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:19.866884 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:19.868010 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:19.870018 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:19.870748 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:19.870896 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:19.875138 (+ 4242us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.2:52323: BlockingRecv error: recv got EOF from 127.25.25.2:52323 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
Aug 11 18:48:20 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:20 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:20.380225 10115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:20.370754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.1:40399)
0811 18:48:20.371337 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:20.371354 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:20.371481 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:20.371858 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:20.371862 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:20.372352 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:20.372568 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:20.372580 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:20.373722 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:20.373726 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:20.374699 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:20.374713 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:20.375640 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:20.375647 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:20.375839 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:20.376534 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:20.376554 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:20.379917 (+ 3363us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":320,"threads_started":1}
W20260811 18:48:20.380524 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:20.370821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:40399 (local address 127.25.25.62:38653)
0811 18:48:20.371024 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:20.371031 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:20.371455 (+ 424us) server_negotiation.cc:407] Connection header received
0811 18:48:20.371595 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:20.371601 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:20.371680 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:20.371790 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:20.372723 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:20.373546 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:20.374856 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:20.375411 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:20.375535 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:20.380252 (+ 4717us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.1:40399: BlockingRecv error: recv got EOF from 127.25.25.1:40399 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 11 18:48:20 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:20 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:20.641753 10116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:20.633102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.3:50065)
0811 18:48:20.633705 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:20.633722 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:20.633855 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:20.634162 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:20.634166 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:20.634610 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:20.634772 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:20.634782 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:20.635889 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:20.635892 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:20.636861 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:20.636875 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:20.637713 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:20.637719 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:20.637890 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:20.638581 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:20.638601 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:20.641501 (+ 2900us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":325,"threads_started":1}
W20260811 18:48:20.641960 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:20.633191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:50065 (local address 127.25.25.62:38653)
0811 18:48:20.633369 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:20.633375 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:20.633834 (+ 459us) server_negotiation.cc:407] Connection header received
0811 18:48:20.633962 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:20.633967 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:20.634039 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:20.634129 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:20.634944 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:20.635755 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:20.637008 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:20.637483 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:20.637589 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:20.641719 (+ 4130us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.3:50065: BlockingRecv error: recv got EOF from 127.25.25.3:50065 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 11 18:48:20 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:20 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:20.890609 10117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:20.876465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.2:49753)
0811 18:48:20.877032 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:20.877057 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:20.877226 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:20.877602 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:20.877606 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:20.878018 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:20.878204 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:20.878214 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:20.879388 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:20.879393 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:20.880657 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:20.880682 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:20.881520 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:20.881526 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:20.881692 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:20.887051 (+ 5359us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:20.887075 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:20.890247 (+ 3172us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":301,"threads_started":1}
W20260811 18:48:20.890812 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:20.877071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:49753 (local address 127.25.25.62:38653)
0811 18:48:20.877247 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:20.877251 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:20.877269 (+ 18us) server_negotiation.cc:407] Connection header received
0811 18:48:20.877337 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:20.877340 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:20.877419 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:20.877508 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:20.878407 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:20.879167 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:20.880835 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:20.881314 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:20.881464 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:20.890537 (+ 9073us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.2:49753: BlockingRecv error: recv got EOF from 127.25.25.2:49753 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 11 18:48:21 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:21 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:21.390455 10120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:21.381340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.1:51065)
0811 18:48:21.381936 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:21.381952 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:21.382099 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:21.382473 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:21.382479 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:21.382893 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:21.383058 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:21.383068 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:21.384293 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:21.384298 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:21.385431 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:21.385446 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:21.386255 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:21.386261 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:21.386443 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:21.387034 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:21.387053 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:21.390101 (+ 3048us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":347,"threads_started":1}
W20260811 18:48:21.390627 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:21.381562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:51065 (local address 127.25.25.62:38653)
0811 18:48:21.381845 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:21.381851 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:21.382043 (+ 192us) server_negotiation.cc:407] Connection header received
0811 18:48:21.382225 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:21.382230 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:21.382295 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:21.382377 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:21.383234 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:21.384159 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:21.385580 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:21.386093 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:21.386208 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:21.390363 (+ 4155us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.1:51065: BlockingRecv error: recv got EOF from 127.25.25.1:51065 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
Aug 11 18:48:21 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:21 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:21.652521 10121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:21.642929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.3:39519)
0811 18:48:21.643523 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:21.643540 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:21.643674 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:21.644070 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:21.644074 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:21.644567 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:21.644754 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:21.644764 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:21.645891 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:21.645897 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:21.646909 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:21.646927 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:21.647861 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:21.647867 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:21.648036 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:21.648689 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:21.648708 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:21.652248 (+ 3540us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":295,"threads_started":1}
W20260811 18:48:21.652659 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:21.643022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:39519 (local address 127.25.25.62:38653)
0811 18:48:21.643237 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:21.643241 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:21.643657 (+ 416us) server_negotiation.cc:407] Connection header received
0811 18:48:21.643778 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:21.643782 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:21.643863 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:21.643957 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:21.644937 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:21.645722 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:21.647102 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:21.647670 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:21.647800 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:21.652477 (+ 4677us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.3:39519: BlockingRecv error: recv got EOF from 127.25.25.3:39519 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 11 18:48:21 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:21 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:21.902070 10124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:21.891726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.2:37261)
0811 18:48:21.892358 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:21.892379 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:21.892540 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:21.893066 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:21.893073 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:21.893604 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:21.893844 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:21.893862 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:21.895322 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:21.895328 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:21.896471 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:21.896488 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:21.897337 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:21.897344 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:21.897545 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:21.898236 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:21.898258 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:21.901662 (+ 3404us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":381,"threads_started":1}
W20260811 18:48:21.902207 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:21.891819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:37261 (local address 127.25.25.62:38653)
0811 18:48:21.892055 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:21.892063 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:21.892518 (+ 455us) server_negotiation.cc:407] Connection header received
0811 18:48:21.892733 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:21.892739 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:21.892881 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:21.893008 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:21.894025 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:21.895130 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:21.896642 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:21.897140 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:21.897277 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:21.901957 (+ 4680us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.2:37261: BlockingRecv error: recv got EOF from 127.25.25.2:37261 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 11 18:48:22 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:22 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:22.400920 10125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:22.391726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.1:54659)
0811 18:48:22.392306 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:22.392329 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:22.392467 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:22.392766 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:22.392769 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:22.393228 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:22.393428 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:22.393438 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:22.394723 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:22.394728 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:22.395811 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:22.395828 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:22.396631 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:22.396635 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:22.396763 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:22.397389 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:22.397412 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:22.400657 (+ 3245us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":267,"threads_started":1}
W20260811 18:48:22.401214 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:22.392058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:54659 (local address 127.25.25.62:38653)
0811 18:48:22.392307 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:22.392312 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:22.392407 (+ 95us) server_negotiation.cc:407] Connection header received
0811 18:48:22.392579 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:22.392583 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:22.392649 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:22.392732 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:22.393625 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:22.394574 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:22.395956 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:22.396459 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:22.396568 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:22.400978 (+ 4410us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.1:54659: BlockingRecv error: recv got EOF from 127.25.25.1:54659 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
Aug 11 18:48:22 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:22 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:22.665381 10126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:22.653731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.3:55013)
0811 18:48:22.655975 (+ 2244us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:22.655998 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:22.656254 (+ 256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:22.656708 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:22.656712 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:22.657116 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:22.657293 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:22.657302 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:22.658556 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:22.658560 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:22.659582 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:22.659598 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:22.660598 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:22.660603 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:22.660742 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:22.661489 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:22.661512 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:22.665119 (+ 3607us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":2071,"thread_start_us":1912,"threads_started":1}
W20260811 18:48:22.665619 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:22.653885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:55013 (local address 127.25.25.62:38653)
0811 18:48:22.654090 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:22.654096 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:22.656147 (+ 2051us) server_negotiation.cc:407] Connection header received
0811 18:48:22.656468 (+ 321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:22.656473 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:22.656550 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:22.656640 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:22.657556 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:22.658383 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:22.659765 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:22.660381 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:22.660497 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:22.665378 (+ 4881us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.3:55013: BlockingRecv error: recv got EOF from 127.25.25.3:55013 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 11 18:48:22 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:22 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:22.912350 10127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:22.903463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.2:50391)
0811 18:48:22.904046 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:22.904071 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:22.904245 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:22.904610 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:22.904615 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:22.905079 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:22.905303 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:22.905317 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:22.906335 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:22.906341 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:22.907423 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:22.907439 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:22.908236 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:22.908242 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:22.908424 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:22.909063 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:22.909083 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:22.912055 (+ 2972us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":306,"threads_started":1}
W20260811 18:48:22.912638 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:22.903673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:50391 (local address 127.25.25.62:38653)
0811 18:48:22.903956 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:22.903962 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:22.904182 (+ 220us) server_negotiation.cc:407] Connection header received
0811 18:48:22.904373 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:22.904378 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:22.904463 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:22.904550 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:22.905462 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:22.906184 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:22.907568 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:22.908052 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:22.908203 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:22.912370 (+ 4167us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.2:50391: BlockingRecv error: recv got EOF from 127.25.25.2:50391 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
Aug 11 18:48:23 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:23 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:23.411917 10129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:23.402124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.1:36157)
0811 18:48:23.402724 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:23.402741 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:23.402892 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:23.403362 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:23.403368 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:23.403820 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:23.404007 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:23.404018 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:23.405412 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:23.405417 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:23.406517 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:23.406536 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:23.407514 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:23.407520 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:23.407680 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:23.408395 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:23.408419 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:23.411653 (+ 3234us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":334,"threads_started":1}
W20260811 18:48:23.412161 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:23.402238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:36157 (local address 127.25.25.62:38653)
0811 18:48:23.402458 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:23.402462 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:23.402839 (+ 377us) server_negotiation.cc:407] Connection header received
0811 18:48:23.403059 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:23.403063 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:23.403138 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:23.403231 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:23.404234 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:23.405161 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:23.406713 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:23.407304 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:23.407459 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:23.411909 (+ 4450us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.1:36157: BlockingRecv error: recv got EOF from 127.25.25.1:36157 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 11 18:48:23 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:23 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:23.676322 10134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:23.666506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.3:50661)
0811 18:48:23.667149 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:23.667168 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:23.667336 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:23.667798 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:23.667804 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:23.668449 (+ 645us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:23.668663 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:23.668675 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:23.669966 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:23.669970 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:23.670908 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:23.670923 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:23.671743 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:23.671749 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:23.671921 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:23.672593 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:23.672613 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:23.675972 (+ 3359us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":339,"threads_started":1}
W20260811 18:48:23.676503 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:23.666727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:50661 (local address 127.25.25.62:38653)
0811 18:48:23.667006 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:23.667013 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:23.667265 (+ 252us) server_negotiation.cc:407] Connection header received
0811 18:48:23.667508 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:23.667513 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:23.667620 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:23.667719 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:23.668834 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:23.669791 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:23.671080 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:23.671536 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:23.671667 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:23.676298 (+ 4631us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.3:50661: BlockingRecv error: recv got EOF from 127.25.25.3:50661 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
Aug 11 18:48:23 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:23 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 18:48:23.923619 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:23.913511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:38523 (local address 127.25.25.62:38653)
0811 18:48:23.913676 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:23.913681 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:23.914028 (+ 347us) server_negotiation.cc:407] Connection header received
0811 18:48:23.914241 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:23.914247 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:23.914359 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:23.914477 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:23.915427 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:23.916293 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:23.917760 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:23.918240 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:23.918355 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:23.923314 (+ 4959us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.2:38523: BlockingRecv error: recv got EOF from 127.25.25.2:38523 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 18:48:23.923713 10135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:23.913392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.2:38523)
0811 18:48:23.913927 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:23.913944 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:23.914092 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:23.914522 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:23.914527 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:23.915083 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:23.915266 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:23.915277 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:23.916509 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:23.916516 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:23.917571 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:23.917588 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:23.918419 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:23.918425 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:23.918588 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:23.919354 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:23.919383 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:23.923108 (+ 3725us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":281,"threads_started":1}
Aug 11 18:48:24 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:24 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:24.421811 10136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:24.413043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.1:33157)
0811 18:48:24.413695 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:24.413712 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:24.413837 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:24.414136 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:24.414139 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:24.414635 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:24.414815 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:24.414834 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:24.415951 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:24.415956 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:24.416987 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:24.417003 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:24.417826 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:24.417831 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:24.417970 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:24.418562 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:24.418579 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:24.421545 (+ 2966us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":335,"threads_started":1}
W20260811 18:48:24.422078 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:24.413122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:33157 (local address 127.25.25.62:38653)
0811 18:48:24.413335 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:24.413343 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:24.413792 (+ 449us) server_negotiation.cc:407] Connection header received
0811 18:48:24.413941 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:24.413945 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:24.414030 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:24.414103 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:24.415007 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:24.415774 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:24.417160 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:24.417620 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:24.417725 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:24.421812 (+ 4087us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.1:33157: BlockingRecv error: recv got EOF from 127.25.25.1:33157 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 11 18:48:24 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:24 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:24.687425 10137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:24.677737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.3:56821)
0811 18:48:24.678292 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:24.678351 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:24.678524 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:24.678907 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:24.678913 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:24.679410 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:24.679627 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:24.679643 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:24.681007 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:24.681011 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:24.682015 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:24.682031 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:24.682903 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:24.682908 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:24.683054 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:24.683796 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:24.683821 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:24.687120 (+ 3299us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":320,"threads_started":1}
W20260811 18:48:24.687628 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:24.677752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:56821 (local address 127.25.25.62:38653)
0811 18:48:24.677996 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:24.678003 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:24.678460 (+ 457us) server_negotiation.cc:407] Connection header received
0811 18:48:24.678652 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:24.678658 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:24.678742 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:24.678860 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:24.679829 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:24.680844 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:24.682191 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:24.682735 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:24.682853 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:24.687389 (+ 4536us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.3:56821: BlockingRecv error: recv got EOF from 127.25.25.3:56821 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 11 18:48:24 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:24 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:24.933960 10138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:24.925185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.2:47229)
0811 18:48:24.925804 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:24.925820 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:24.925963 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:24.926325 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:24.926330 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:24.926787 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:24.926965 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:24.926976 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:24.928176 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:24.928181 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:24.929139 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:24.929154 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:24.929984 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:24.929991 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:24.930158 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:24.930796 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:24.930815 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:24.933715 (+ 2900us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":341,"threads_started":1}
W20260811 18:48:24.934144 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:24.925316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:47229 (local address 127.25.25.62:38653)
0811 18:48:24.925525 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:24.925531 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:24.925908 (+ 377us) server_negotiation.cc:407] Connection header received
0811 18:48:24.926084 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:24.926089 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:24.926173 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:24.926258 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:24.927126 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:24.927981 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:24.929304 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:24.929781 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:24.929901 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:24.933952 (+ 4051us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.2:47229: BlockingRecv error: recv got EOF from 127.25.25.2:47229 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 11 18:48:25 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:25 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:25.432597 10139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:25.423112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.1:50033)
0811 18:48:25.423634 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:25.423651 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:25.423795 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:25.424282 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:25.424288 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:25.424856 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:25.425129 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:25.425141 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:25.426320 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:25.426324 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:25.427301 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:25.427317 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:25.428206 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:25.428211 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:25.428349 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:25.429116 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:25.429136 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:25.432279 (+ 3143us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":271,"threads_started":1}
W20260811 18:48:25.432896 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:25.423247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:50033 (local address 127.25.25.62:38653)
0811 18:48:25.423474 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:25.423479 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:25.423747 (+ 268us) server_negotiation.cc:407] Connection header received
0811 18:48:25.423926 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:25.423931 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:25.424030 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:25.424154 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:25.425326 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:25.426136 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:25.427527 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:25.427996 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:25.428138 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:25.432633 (+ 4495us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.1:50033: BlockingRecv error: recv got EOF from 127.25.25.1:50033 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 11 18:48:25 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:25 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:25.698061 10140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:25.688598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.3:40031)
0811 18:48:25.689152 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:25.689169 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:25.689313 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:25.689708 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:25.689714 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:25.690195 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:25.690380 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:25.690391 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:25.691517 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:25.691522 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:25.692597 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:25.692614 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:25.693360 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:25.693366 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:25.693545 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:25.694226 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:25.694247 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:25.697638 (+ 3391us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":280,"threads_started":1}
W20260811 18:48:25.698216 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:25.688638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:40031 (local address 127.25.25.62:38653)
0811 18:48:25.688996 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:25.689002 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:25.689255 (+ 253us) server_negotiation.cc:407] Connection header received
0811 18:48:25.689450 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:25.689456 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:25.689553 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:25.689639 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:25.690541 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:25.691356 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:25.692761 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:25.693194 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:25.693314 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:25.697954 (+ 4640us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.3:40031: BlockingRecv error: recv got EOF from 127.25.25.3:40031 (error 108)
Metrics: {"server-negotiator.queue_time_us":217}
Aug 11 18:48:25 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:25 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:25.948259 10141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:25.935136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.2:48001)
0811 18:48:25.935802 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:25.935821 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:25.935971 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:25.936369 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:25.936374 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:25.936824 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:25.937031 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:25.937043 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:25.938355 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:25.938360 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:25.939342 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:25.939359 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:25.940211 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:25.940216 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:25.940379 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:25.944619 (+ 4240us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:25.944644 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:25.947953 (+ 3309us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":414,"threads_started":1}
W20260811 18:48:25.948612 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:25.935349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:48001 (local address 127.25.25.62:38653)
0811 18:48:25.935569 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:25.935574 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:25.935943 (+ 369us) server_negotiation.cc:407] Connection header received
0811 18:48:25.936106 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:25.936111 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:25.936186 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:25.936277 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:25.937252 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:25.938146 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:25.939551 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:25.939995 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:25.940186 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:25.948290 (+ 8104us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.2:48001: BlockingRecv error: recv got EOF from 127.25.25.2:48001 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 11 18:48:26 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:26 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:26.442898 10142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:26.433923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.1:50455)
0811 18:48:26.434464 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:26.434480 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:26.434606 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:26.434938 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:26.434942 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:26.435437 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:26.435658 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:26.435669 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:26.436878 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:26.436885 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:26.437866 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:26.437884 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:26.438736 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:26.438741 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:26.438887 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:26.439545 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:26.439565 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:26.442593 (+ 3028us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":279,"threads_started":1}
W20260811 18:48:26.443169 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:26.433958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:50455 (local address 127.25.25.62:38653)
0811 18:48:26.434172 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:26.434179 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:26.434589 (+ 410us) server_negotiation.cc:407] Connection header received
0811 18:48:26.434707 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:26.434711 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:26.434779 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:26.434887 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:26.435855 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:26.436697 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:26.438053 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:26.438568 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:26.438689 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:26.442903 (+ 4214us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.1:50455: BlockingRecv error: recv got EOF from 127.25.25.1:50455 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 11 18:48:26 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:26 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.3@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:26.709846 10143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:26.699735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.3:43615)
0811 18:48:26.700347 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:26.700365 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:26.700517 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:26.700827 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:26.700830 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:26.701224 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:26.701472 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:26.701485 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:26.702991 (+ 1506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:26.702997 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:26.704150 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:26.704168 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:26.705075 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:26.705080 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:26.705227 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:26.705998 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:26.706019 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:26.709531 (+ 3512us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":289,"threads_started":1}
W20260811 18:48:26.710171 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:26.699867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:43615 (local address 127.25.25.62:38653)
0811 18:48:26.700054 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:26.700059 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:26.700521 (+ 462us) server_negotiation.cc:407] Connection header received
0811 18:48:26.700613 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:26.700617 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:26.700691 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:26.700793 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:26.701668 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:26.702786 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:26.704315 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:26.704842 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:26.705057 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:26.709894 (+ 4837us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.3:43615: BlockingRecv error: recv got EOF from 127.25.25.3:43615 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 11 18:48:26 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:26 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.2@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:26.959529 10144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:26.949583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.2:33637)
0811 18:48:26.950187 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:26.950204 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:26.950333 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:26.950715 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:26.950720 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:26.951318 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:26.951542 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:26.951554 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:26.952885 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:26.952892 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:26.954003 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:26.954023 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:26.954908 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:26.954914 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:26.955089 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:26.955798 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:26.955819 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:26.959140 (+ 3321us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":345,"threads_started":1}
W20260811 18:48:26.959661 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:26.949733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:33637 (local address 127.25.25.62:38653)
0811 18:48:26.949898 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:26.949903 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:26.950309 (+ 406us) server_negotiation.cc:407] Connection header received
0811 18:48:26.950449 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:26.950454 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:26.950527 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:26.950615 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:26.951749 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:26.952646 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:26.954195 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:26.954698 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:26.954812 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:26.959435 (+ 4623us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.2:33637: BlockingRecv error: recv got EOF from 127.25.25.2:33637 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 11 18:48:27 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:48:27 dist-test-slave-lgr5 krb5kdc[8286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.25.1@KRBTEST.COM for oryx/127.25.25.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:48:27.453156 10145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:27.444166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38653 (local address 127.25.25.1:47077)
0811 18:48:27.444763 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:27.444780 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:27.444917 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:27.445297 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:27.445301 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:27.445724 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:27.445910 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:27.445920 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:27.447232 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:27.447237 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:27.448398 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:27.448415 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:27.449186 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:27.449191 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:27.449334 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:27.449980 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:27.449999 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:27.452919 (+ 2920us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.25.62:38653: Server oryx/127.25.25.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":330,"threads_started":1}
W20260811 18:48:27.453425 10087 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:27.444274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:47077 (local address 127.25.25.62:38653)
0811 18:48:27.444465 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:27.444469 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:27.444897 (+ 428us) server_negotiation.cc:407] Connection header received
0811 18:48:27.445077 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:27.445082 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:27.445157 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:27.445255 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:27.446102 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:27.447037 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:27.448549 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:27.449029 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:27.449130 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:27.453167 (+ 4037us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.25.1:47077: BlockingRecv error: recv got EOF from 127.25.25.1:47077 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 18:48:27.497107 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 9358
I20260811 18:48:27.511209 10151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:27.498380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50638 (local address 127.25.25.1:38121)
0811 18:48:27.499131 (+ 751us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:27.499138 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:27.499171 (+ 33us) server_negotiation.cc:407] Connection header received
0811 18:48:27.499239 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:27.499247 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:27.499486 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:27.499675 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:27.501381 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:27.502530 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:27.503938 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:27.504677 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:27.504797 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:27.507709 (+ 2912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:27.507721 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:27.507738 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:27.507792 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:27.510593 (+ 2801us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.25.25.1@KRBTEST.COM not found in keytab (ticket kvno 2)
0811 18:48:27.510947 (+ 354us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50638: Request ticket server kudu/127.25.25.1@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":410,"threads_started":1}
W20260811 18:48:27.511327 10151 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50638: Request ticket server kudu/127.25.25.1@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260811 18:48:27.511713 25700 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 9358: Not authorized: Client connection negotiation failed: client connection to 127.25.25.1:38121: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.25.25.1@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260811 18:48:27.511955 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 9358
I20260811 18:48:27.547055 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 9610
I20260811 18:48:27.559687 10152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:27.548157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59500 (local address 127.25.25.2:34157)
0811 18:48:27.548707 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:27.548715 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:27.548741 (+ 26us) server_negotiation.cc:407] Connection header received
0811 18:48:27.548803 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:27.548810 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:27.549049 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:27.549231 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:27.550553 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:27.551590 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:27.552932 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:27.553520 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:27.553645 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:27.556224 (+ 2579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:27.556233 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:27.556250 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:27.556293 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:27.558946 (+ 2653us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.25.25.2@KRBTEST.COM not found in keytab (ticket kvno 2)
0811 18:48:27.559319 (+ 373us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59500: Request ticket server kudu/127.25.25.2@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":270,"threads_started":1}
W20260811 18:48:27.559810 10152 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59500: Request ticket server kudu/127.25.25.2@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260811 18:48:27.559854 25700 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 9610: Not authorized: Client connection negotiation failed: client connection to 127.25.25.2:34157: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.25.25.2@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260811 18:48:27.560103 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 9610
I20260811 18:48:27.591754 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 9836
I20260811 18:48:27.605481 10153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:27.592898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42504 (local address 127.25.25.3:44827)
0811 18:48:27.593463 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:27.593471 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:27.593500 (+ 29us) server_negotiation.cc:407] Connection header received
0811 18:48:27.593568 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:27.593590 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:27.593837 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:27.594002 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:27.595408 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:27.596838 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:27.598259 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:27.598881 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:27.599011 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:27.601887 (+ 2876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:27.601899 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:27.601917 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:27.601971 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:27.604814 (+ 2843us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.25.25.3@KRBTEST.COM not found in keytab (ticket kvno 2)
0811 18:48:27.605145 (+ 331us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42504: Request ticket server kudu/127.25.25.3@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":255,"threads_started":1}
W20260811 18:48:27.605619 10153 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42504: Request ticket server kudu/127.25.25.3@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260811 18:48:27.605667 25700 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 9836: Not authorized: Client connection negotiation failed: client connection to 127.25.25.3:44827: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.25.25.3@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260811 18:48:27.605867 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 9836
I20260811 18:48:27.633771 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 9235
I20260811 18:48:27.635378 9346 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:48:27.756676 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 9235
2026-08-11T18:48:27Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (22190 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T18:48:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:48:27Z Disabled control of system clock
I20260811 18:48:27.862054 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:38665
--webserver_interface=127.25.25.62
--webserver_port=0
--builtin_ntp_servers=127.25.25.20:42779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:38665
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 18:48:28.229600 10164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:48:28.229997 10164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:48:28.230124 10164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:48:28.237782 10164 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:48:28.237917 10164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:48:28.237955 10164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:48:28.238008 10164 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:48:28.238051 10164 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:48:28.247689 10164 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:42779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:38665
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:38665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:48:28.249147 10164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:48:28.251112 10164 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:48:28.264034 10176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:28.263952 10179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:28.263988 10177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:48:28.265303 10164 server_base.cc:1034] running on GCE node
I20260811 18:48:28.266209 10164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:48:28.267825 10164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:48:28.269076 10164 hybrid_clock.cc:648] HybridClock initialized: now 1786474108269014 us; error 61 us; skew 500 ppm
I20260811 18:48:28.269491 10164 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:48:28.272449 10164 webserver.cc:460] Webserver started at http://127.25.25.62:36319/ using document root <none> and password file <none>
I20260811 18:48:28.273257 10164 fs_manager.cc:359] Metadata directory not provided
I20260811 18:48:28.273367 10164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:48:28.273694 10164 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:48:28.277141 10164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "28241d26be8f4c0cb1ffe65394c97c10"
format_stamp: "Formatted at 2026-08-11 18:48:28 on dist-test-slave-lgr5"
server_key: "633c8ef945c851e6d812e870ce5b95a3"
server_key_iv: "645c046918cd7e97284760ad6e8516f9"
server_key_version: "encryptionkey@0"
I20260811 18:48:28.278051 10164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "28241d26be8f4c0cb1ffe65394c97c10"
format_stamp: "Formatted at 2026-08-11 18:48:28 on dist-test-slave-lgr5"
server_key: "633c8ef945c851e6d812e870ce5b95a3"
server_key_iv: "645c046918cd7e97284760ad6e8516f9"
server_key_version: "encryptionkey@0"
I20260811 18:48:28.283839 10164 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260811 18:48:28.287698 10189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:28.289264 10164 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:48:28.289482 10164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "28241d26be8f4c0cb1ffe65394c97c10"
format_stamp: "Formatted at 2026-08-11 18:48:28 on dist-test-slave-lgr5"
server_key: "633c8ef945c851e6d812e870ce5b95a3"
server_key_iv: "645c046918cd7e97284760ad6e8516f9"
server_key_version: "encryptionkey@0"
I20260811 18:48:28.289710 10164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:48:28.310791 10164 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:48:28.311894 10164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:48:28.312245 10164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:48:28.330696 10164 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:38665
I20260811 18:48:28.330703 10268 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:38665 every 8 connection(s)
I20260811 18:48:28.332104 10164 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:48:28.336328 10269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:48:28.342602 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 10164
I20260811 18:48:28.342813 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:48:28.343562 25700 external_mini_cluster.cc:1428] Setting key 4916a4d36fe27bccf238c25ae471bf89
I20260811 18:48:28.348800 10269 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28241d26be8f4c0cb1ffe65394c97c10: Bootstrap starting.
I20260811 18:48:28.352746 10269 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 28241d26be8f4c0cb1ffe65394c97c10: Neither blocks nor log segments found. Creating new log.
I20260811 18:48:28.354285 10269 log.cc:824] T 00000000000000000000000000000000 P 28241d26be8f4c0cb1ffe65394c97c10: Log is configured to *not* fsync() on all Append() calls
I20260811 18:48:28.358302 10269 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28241d26be8f4c0cb1ffe65394c97c10: No bootstrap required, opened a new log
I20260811 18:48:28.360198 10274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:28.346091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34022 (local address 127.25.25.62:38665)
0811 18:48:28.347255 (+ 1164us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:28.347267 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:28.347317 (+ 50us) server_negotiation.cc:407] Connection header received
0811 18:48:28.349337 (+ 2020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:28.349370 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:28.349964 (+ 594us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:28.350352 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:28.351175 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:28.352575 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:28.354678 (+ 2103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:28.355875 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:28.356076 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:28.357478 (+ 1402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:28.357487 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:28.357505 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:48:28.358103 (+ 598us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:28.358189 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:48:28.358216 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:28.358318 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:28.358694 (+ 376us) server_negotiation.cc:299] Negotiation successful
0811 18:48:28.359076 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":674,"thread_start_us":422,"threads_started":1}
I20260811 18:48:28.366544 10269 raft_consensus.cc:348] T 00000000000000000000000000000000 P 28241d26be8f4c0cb1ffe65394c97c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28241d26be8f4c0cb1ffe65394c97c10" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38665 } }
I20260811 18:48:28.366999 10269 raft_consensus.cc:374] T 00000000000000000000000000000000 P 28241d26be8f4c0cb1ffe65394c97c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:48:28.367106 10269 raft_consensus.cc:729] T 00000000000000000000000000000000 P 28241d26be8f4c0cb1ffe65394c97c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28241d26be8f4c0cb1ffe65394c97c10, State: Initialized, Role: FOLLOWER
I20260811 18:48:28.367707 10269 consensus_queue.cc:260] T 00000000000000000000000000000000 P 28241d26be8f4c0cb1ffe65394c97c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28241d26be8f4c0cb1ffe65394c97c10" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38665 } }
I20260811 18:48:28.367985 10269 raft_consensus.cc:388] T 00000000000000000000000000000000 P 28241d26be8f4c0cb1ffe65394c97c10 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:48:28.368166 10269 raft_consensus.cc:482] T 00000000000000000000000000000000 P 28241d26be8f4c0cb1ffe65394c97c10 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:48:28.368381 10269 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 28241d26be8f4c0cb1ffe65394c97c10 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:48:28.370798 10269 raft_consensus.cc:504] T 00000000000000000000000000000000 P 28241d26be8f4c0cb1ffe65394c97c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28241d26be8f4c0cb1ffe65394c97c10" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38665 } }
I20260811 18:48:28.371332 10269 leader_election.cc:302] T 00000000000000000000000000000000 P 28241d26be8f4c0cb1ffe65394c97c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 28241d26be8f4c0cb1ffe65394c97c10; no voters:
I20260811 18:48:28.371930 10269 leader_election.cc:288] T 00000000000000000000000000000000 P 28241d26be8f4c0cb1ffe65394c97c10 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:48:28.372114 10276 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 28241d26be8f4c0cb1ffe65394c97c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:48:28.372838 10276 raft_consensus.cc:686] T 00000000000000000000000000000000 P 28241d26be8f4c0cb1ffe65394c97c10 [term 1 LEADER]: Becoming Leader. State: Replica: 28241d26be8f4c0cb1ffe65394c97c10, State: Running, Role: LEADER
I20260811 18:48:28.373389 10276 consensus_queue.cc:237] T 00000000000000000000000000000000 P 28241d26be8f4c0cb1ffe65394c97c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28241d26be8f4c0cb1ffe65394c97c10" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38665 } }
I20260811 18:48:28.374187 10269 sys_catalog.cc:564] T 00000000000000000000000000000000 P 28241d26be8f4c0cb1ffe65394c97c10 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:48:28.376492 10278 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28241d26be8f4c0cb1ffe65394c97c10 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 28241d26be8f4c0cb1ffe65394c97c10. Latest consensus state: current_term: 1 leader_uuid: "28241d26be8f4c0cb1ffe65394c97c10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28241d26be8f4c0cb1ffe65394c97c10" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38665 } } }
I20260811 18:48:28.376919 10278 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28241d26be8f4c0cb1ffe65394c97c10 [sys.catalog]: This master's current role is: LEADER
I20260811 18:48:28.377924 10277 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28241d26be8f4c0cb1ffe65394c97c10 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "28241d26be8f4c0cb1ffe65394c97c10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28241d26be8f4c0cb1ffe65394c97c10" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38665 } } }
I20260811 18:48:28.378366 10277 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28241d26be8f4c0cb1ffe65394c97c10 [sys.catalog]: This master's current role is: LEADER
I20260811 18:48:28.380218 10291 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:48:28.385848 10291 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:48:28.395802 10291 catalog_manager.cc:1347] Generated new cluster ID: aef9315f2ec5449ebc445c9c77375415
I20260811 18:48:28.395962 10291 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:48:28.442116 10291 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:48:28.444226 10291 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:48:28.452764 10291 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 28241d26be8f4c0cb1ffe65394c97c10: Generated new TSK 0
I20260811 18:48:28.454001 10291 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:48:28.464560 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:0
--local_ip_for_outbound_sockets=127.25.25.1
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38665
--builtin_ntp_servers=127.25.25.20:42779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 18:48:28.838987 10313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:48:28.839318 10313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:48:28.839434 10313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:48:28.847150 10313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:48:28.847282 10313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:48:28.847415 10313 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:48:28.857086 10313 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:42779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38665
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:48:28.858532 10313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:48:28.860786 10313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:48:28.874972 10320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:28.875010 10321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:28.874963 10323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:48:28.876701 10313 server_base.cc:1034] running on GCE node
I20260811 18:48:28.877458 10313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:48:28.878587 10313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:48:28.879810 10313 hybrid_clock.cc:648] HybridClock initialized: now 1786474108879740 us; error 64 us; skew 500 ppm
I20260811 18:48:28.880210 10313 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:48:28.882694 10313 webserver.cc:460] Webserver started at http://127.25.25.1:33191/ using document root <none> and password file <none>
I20260811 18:48:28.883472 10313 fs_manager.cc:359] Metadata directory not provided
I20260811 18:48:28.883575 10313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:48:28.883881 10313 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:48:28.887297 10313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/data/instance:
uuid: "39f17f8938514dc1aa1949420abefa7a"
format_stamp: "Formatted at 2026-08-11 18:48:28 on dist-test-slave-lgr5"
server_key: "5c0b7901a8bfba433fd542fe215dcb3e"
server_key_iv: "8ea9c244ef0387b0318d8fb92ca1c1c7"
server_key_version: "encryptionkey@0"
I20260811 18:48:28.888319 10313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance:
uuid: "39f17f8938514dc1aa1949420abefa7a"
format_stamp: "Formatted at 2026-08-11 18:48:28 on dist-test-slave-lgr5"
server_key: "5c0b7901a8bfba433fd542fe215dcb3e"
server_key_iv: "8ea9c244ef0387b0318d8fb92ca1c1c7"
server_key_version: "encryptionkey@0"
I20260811 18:48:28.894421 10313 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.001s
I20260811 18:48:28.898738 10333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:28.900851 10313 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 18:48:28.901072 10313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "39f17f8938514dc1aa1949420abefa7a"
format_stamp: "Formatted at 2026-08-11 18:48:28 on dist-test-slave-lgr5"
server_key: "5c0b7901a8bfba433fd542fe215dcb3e"
server_key_iv: "8ea9c244ef0387b0318d8fb92ca1c1c7"
server_key_version: "encryptionkey@0"
I20260811 18:48:28.901358 10313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:48:28.914255 10313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:48:28.915257 10313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:48:28.915560 10313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:48:28.916710 10313 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:48:28.918370 10313 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:48:28.918468 10313 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:28.918588 10313 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:48:28.918675 10313 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:28.951320 10313 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:46193
I20260811 18:48:28.951395 10516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:46193 every 8 connection(s)
I20260811 18:48:28.952867 10313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:48:28.957583 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 10313
I20260811 18:48:28.957834 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance
I20260811 18:48:28.958513 25700 external_mini_cluster.cc:1428] Setting key 7621532b8295906915ff68d40b77e114
I20260811 18:48:28.961588 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:0
--local_ip_for_outbound_sockets=127.25.25.2
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38665
--builtin_ntp_servers=127.25.25.20:42779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 18:48:28.966889 10524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:28.955512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:60603 (local address 127.25.25.62:38665)
0811 18:48:28.956154 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:28.956159 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:28.957433 (+ 1274us) server_negotiation.cc:407] Connection header received
0811 18:48:28.959470 (+ 2037us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:28.959476 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:28.959573 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:28.959673 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:28.960987 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:28.961870 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:28.963665 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:28.964144 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:28.964268 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:28.965960 (+ 1692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:28.965965 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:28.965969 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:48:28.965994 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:28.966040 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:48:28.966053 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:28.966134 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:28.966393 (+ 259us) server_negotiation.cc:299] Negotiation successful
0811 18:48:28.966519 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":502,"thread_start_us":403,"threads_started":1}
I20260811 18:48:28.968065 10525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:28.956167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38665 (local address 127.25.25.1:60603)
0811 18:48:28.957239 (+ 1072us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:28.957280 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:28.959143 (+ 1863us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:28.959971 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:28.959981 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:28.960126 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:28.960793 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:28.960813 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:28.962081 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:28.962086 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:28.963473 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:28.963490 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:28.964407 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:28.964416 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:28.964681 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:28.965535 (+ 854us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:48:28.965539 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:28.965594 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:48:28.965691 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:48:28.966161 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:48:28.966175 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:48:28.966182 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 18:48:28.966384 (+ 202us) client_negotiation.cc:240] Negotiation successful
0811 18:48:28.966866 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":321,"threads_started":1}
I20260811 18:48:28.970007 10520 heartbeater.cc:347] Connected to a master server at 127.25.25.62:38665
I20260811 18:48:28.970327 10520 heartbeater.cc:464] Registering TS with master...
I20260811 18:48:28.971148 10520 heartbeater.cc:511] Master 127.25.25.62:38665 requested a full tablet report, sending...
I20260811 18:48:28.973569 10214 ts_manager.cc:194] Registered new tserver with Master: 39f17f8938514dc1aa1949420abefa7a (127.25.25.1:46193)
I20260811 18:48:28.975395 10214 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.25.1:60603
W20260811 18:48:29.322742 10526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:48:29.323084 10526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:48:29.323216 10526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:48:29.331040 10526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:48:29.331172 10526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:48:29.331328 10526 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:48:29.341372 10526 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:42779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38665
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:48:29.342782 10526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:48:29.344870 10526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:48:29.360072 10532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:29.360011 10534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:29.360049 10537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:48:29.360903 10526 server_base.cc:1034] running on GCE node
I20260811 18:48:29.361729 10526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:48:29.363086 10526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:48:29.364337 10526 hybrid_clock.cc:648] HybridClock initialized: now 1786474109364237 us; error 89 us; skew 500 ppm
I20260811 18:48:29.364835 10526 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:48:29.367655 10526 webserver.cc:460] Webserver started at http://127.25.25.2:35923/ using document root <none> and password file <none>
I20260811 18:48:29.368554 10526 fs_manager.cc:359] Metadata directory not provided
I20260811 18:48:29.368682 10526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:48:29.369047 10526 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:48:29.372385 10526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/data/instance:
uuid: "f181dc4fb1ab43818280f1e5788da598"
format_stamp: "Formatted at 2026-08-11 18:48:29 on dist-test-slave-lgr5"
server_key: "43a5dd6f482081972c305d7a29e41ee1"
server_key_iv: "bb2d27c4f1edf529a22e383f71cd1aa3"
server_key_version: "encryptionkey@0"
I20260811 18:48:29.373330 10526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance:
uuid: "f181dc4fb1ab43818280f1e5788da598"
format_stamp: "Formatted at 2026-08-11 18:48:29 on dist-test-slave-lgr5"
server_key: "43a5dd6f482081972c305d7a29e41ee1"
server_key_iv: "bb2d27c4f1edf529a22e383f71cd1aa3"
server_key_version: "encryptionkey@0"
I20260811 18:48:29.379417 10526 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260811 18:48:29.383551 10544 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:29.385075 10526 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:48:29.385267 10526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "f181dc4fb1ab43818280f1e5788da598"
format_stamp: "Formatted at 2026-08-11 18:48:29 on dist-test-slave-lgr5"
server_key: "43a5dd6f482081972c305d7a29e41ee1"
server_key_iv: "bb2d27c4f1edf529a22e383f71cd1aa3"
server_key_version: "encryptionkey@0"
I20260811 18:48:29.385530 10526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:48:29.402009 10526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:48:29.403065 10526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:48:29.403362 10526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:48:29.404556 10526 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:48:29.406273 10526 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:48:29.406384 10526 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:29.406540 10526 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:48:29.406616 10526 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:29.442133 10526 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:33003
I20260811 18:48:29.442202 10716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:33003 every 8 connection(s)
I20260811 18:48:29.443578 10526 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:48:29.443975 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 10526
I20260811 18:48:29.444157 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance
I20260811 18:48:29.444722 25700 external_mini_cluster.cc:1428] Setting key 698ff745620aabbd061a775003ce34cb
I20260811 18:48:29.448441 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:0
--local_ip_for_outbound_sockets=127.25.25.3
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38665
--builtin_ntp_servers=127.25.25.20:42779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 18:48:29.457357 10524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:29.446422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:57197 (local address 127.25.25.62:38665)
0811 18:48:29.446604 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:29.446609 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:29.448763 (+ 2154us) server_negotiation.cc:407] Connection header received
0811 18:48:29.450640 (+ 1877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:29.450646 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:29.450730 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:29.450816 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:29.452008 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:29.452819 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:29.454470 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:29.454892 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:29.455021 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:29.456535 (+ 1514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:29.456542 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:29.456545 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:48:29.456567 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:29.456600 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:48:29.456613 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:29.456689 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:29.456931 (+ 242us) server_negotiation.cc:299] Negotiation successful
0811 18:48:29.457046 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 18:48:29.458523 10720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:29.447300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38665 (local address 127.25.25.2:57197)
0811 18:48:29.448588 (+ 1288us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:29.448649 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:29.450334 (+ 1685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:29.451094 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:29.451103 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:29.451199 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:29.451817 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:29.451837 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:29.452986 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:29.452990 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:29.454304 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:29.454319 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:29.455164 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:29.455174 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:29.455411 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:29.456186 (+ 775us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:48:29.456189 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:29.456235 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:48:29.456327 (+ 92us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:48:29.456704 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:48:29.456717 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:48:29.456725 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 18:48:29.456900 (+ 175us) client_negotiation.cc:240] Negotiation successful
0811 18:48:29.457359 (+ 459us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"thread_start_us":391,"threads_started":1}
I20260811 18:48:29.460115 10718 heartbeater.cc:347] Connected to a master server at 127.25.25.62:38665
I20260811 18:48:29.460462 10718 heartbeater.cc:464] Registering TS with master...
I20260811 18:48:29.461341 10718 heartbeater.cc:511] Master 127.25.25.62:38665 requested a full tablet report, sending...
I20260811 18:48:29.463084 10214 ts_manager.cc:194] Registered new tserver with Master: f181dc4fb1ab43818280f1e5788da598 (127.25.25.2:33003)
I20260811 18:48:29.464007 10214 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.25.2:57197
W20260811 18:48:29.811805 10721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:48:29.812194 10721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:48:29.812336 10721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:48:29.820377 10721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:48:29.820519 10721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:48:29.820662 10721 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:48:29.830533 10721 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:42779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38665
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:48:29.832017 10721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:48:29.834097 10721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:48:29.849025 10734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:29.849105 10732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:29.849061 10730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:48:29.849954 10721 server_base.cc:1034] running on GCE node
I20260811 18:48:29.850684 10721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:48:29.851796 10721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:48:29.853034 10721 hybrid_clock.cc:648] HybridClock initialized: now 1786474109852973 us; error 62 us; skew 500 ppm
I20260811 18:48:29.853415 10721 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:48:29.856117 10721 webserver.cc:460] Webserver started at http://127.25.25.3:42739/ using document root <none> and password file <none>
I20260811 18:48:29.856901 10721 fs_manager.cc:359] Metadata directory not provided
I20260811 18:48:29.857016 10721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:48:29.857366 10721 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:48:29.860634 10721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/data/instance:
uuid: "4f60db5b7e5540bb9a3d120258351b87"
format_stamp: "Formatted at 2026-08-11 18:48:29 on dist-test-slave-lgr5"
server_key: "35a70e3cc78551f4451eb1e5db86fcf9"
server_key_iv: "6addb4b894cbd32879da9dd2a00afe36"
server_key_version: "encryptionkey@0"
I20260811 18:48:29.861580 10721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance:
uuid: "4f60db5b7e5540bb9a3d120258351b87"
format_stamp: "Formatted at 2026-08-11 18:48:29 on dist-test-slave-lgr5"
server_key: "35a70e3cc78551f4451eb1e5db86fcf9"
server_key_iv: "6addb4b894cbd32879da9dd2a00afe36"
server_key_version: "encryptionkey@0"
I20260811 18:48:29.868139 10721 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 18:48:29.872270 10746 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:29.873898 10721 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260811 18:48:29.874109 10721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "4f60db5b7e5540bb9a3d120258351b87"
format_stamp: "Formatted at 2026-08-11 18:48:29 on dist-test-slave-lgr5"
server_key: "35a70e3cc78551f4451eb1e5db86fcf9"
server_key_iv: "6addb4b894cbd32879da9dd2a00afe36"
server_key_version: "encryptionkey@0"
I20260811 18:48:29.874354 10721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:48:29.897830 10721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:48:29.898772 10721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:48:29.899076 10721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:48:29.900262 10721 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:48:29.902081 10721 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:48:29.902238 10721 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260811 18:48:29.902366 10721 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:48:29.902463 10721 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:29.934870 10721 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:32947
I20260811 18:48:29.934950 10944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:32947 every 8 connection(s)
I20260811 18:48:29.936308 10721 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:48:29.940290 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 10721
I20260811 18:48:29.940459 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance
I20260811 18:48:29.941061 25700 external_mini_cluster.cc:1428] Setting key 1f8d2416edaf7bde6f349bcff1acd6d3
I20260811 18:48:29.951098 10524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:29.939608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:53063 (local address 127.25.25.62:38665)
0811 18:48:29.939816 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:29.939824 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:29.941805 (+ 1981us) server_negotiation.cc:407] Connection header received
0811 18:48:29.944173 (+ 2368us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:29.944178 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:29.944270 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:29.944375 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:29.945654 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:29.946435 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:29.948249 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:29.948652 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:29.948755 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:29.950217 (+ 1462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:29.950222 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:29.950225 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:48:29.950247 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:29.950279 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:48:29.950291 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:29.950360 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:29.950675 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 18:48:29.950768 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 18:48:29.952618 10948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:29.940165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38665 (local address 127.25.25.3:53063)
0811 18:48:29.941576 (+ 1411us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:29.941639 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:29.943853 (+ 2214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:29.944679 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:29.944688 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:29.944796 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:29.945489 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:29.945512 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:29.946634 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:29.946638 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:29.948040 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:29.948055 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:29.948892 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:29.948898 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:29.949133 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:29.949877 (+ 744us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:48:29.949880 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:29.949928 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:48:29.950028 (+ 100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:48:29.950411 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:48:29.950422 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:48:29.950457 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 18:48:29.950685 (+ 228us) client_negotiation.cc:240] Negotiation successful
0811 18:48:29.951161 (+ 476us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"thread_start_us":400,"threads_started":1}
I20260811 18:48:29.954118 10945 heartbeater.cc:347] Connected to a master server at 127.25.25.62:38665
I20260811 18:48:29.954486 10945 heartbeater.cc:464] Registering TS with master...
I20260811 18:48:29.955480 10945 heartbeater.cc:511] Master 127.25.25.62:38665 requested a full tablet report, sending...
I20260811 18:48:29.957170 10214 ts_manager.cc:194] Registered new tserver with Master: 4f60db5b7e5540bb9a3d120258351b87 (127.25.25.3:32947)
I20260811 18:48:29.957984 10214 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.25.3:53063
I20260811 18:48:29.969967 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 18:48:29.978937 10524 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:29.976970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52180 (local address 127.25.25.62:38665)
0811 18:48:29.977333 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:29.977339 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:29.977618 (+ 279us) server_negotiation.cc:407] Connection header received
0811 18:48:29.977855 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:29.977861 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:29.977995 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:29.978094 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:29.978659 (+ 565us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52180: BlockingRecv error: recv got EOF from 127.0.0.1:52180 (error 108)
Metrics: {"server-negotiator.queue_time_us":147}
I20260811 18:48:29.979415 10520 heartbeater.cc:503] Master 127.25.25.62:38665 was elected leader, sending a full tablet report...
I20260811 18:48:29.981285 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 10313
I20260811 18:48:29.990788 10963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:29.982730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48654 (local address 127.25.25.1:46193)
0811 18:48:29.983299 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:29.983354 (+ 55us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:29.983382 (+ 28us) server_negotiation.cc:407] Connection header received
0811 18:48:29.983440 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:29.983447 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:29.983669 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:29.983801 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:29.984507 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:29.985574 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:29.987052 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:29.987717 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:29.987833 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:29.989138 (+ 1305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:29.989148 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:29.989166 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:48:29.989904 (+ 738us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:29.989972 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:48:29.990001 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:29.990107 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:29.990286 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 18:48:29.990424 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":280,"threads_started":1}
I20260811 18:48:29.992272 10508 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:48:30.076599 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 10313
I20260811 18:48:30.100396 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 10526
I20260811 18:48:30.109156 10966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:30.101524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58954 (local address 127.25.25.2:33003)
0811 18:48:30.102165 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:30.102172 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:30.102201 (+ 29us) server_negotiation.cc:407] Connection header received
0811 18:48:30.102271 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:30.102278 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:30.102505 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:30.102649 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:30.103084 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:30.104233 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:30.105666 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:30.106284 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:30.106454 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:30.107510 (+ 1056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:30.107518 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:30.107533 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:48:30.108206 (+ 673us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:30.108275 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:48:30.108298 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:30.108398 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:30.108573 (+ 175us) server_negotiation.cc:299] Negotiation successful
0811 18:48:30.108751 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":495,"thread_start_us":362,"threads_started":1}
I20260811 18:48:30.110533 10711 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:48:30.196203 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 10526
I20260811 18:48:30.223657 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 10721
I20260811 18:48:30.232560 10971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:30.224745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55954 (local address 127.25.25.3:32947)
0811 18:48:30.225539 (+ 794us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:30.225555 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:30.225592 (+ 37us) server_negotiation.cc:407] Connection header received
0811 18:48:30.225660 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:30.225668 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:30.225915 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:30.226064 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:30.226563 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:30.227672 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:30.229071 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:30.229729 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:30.229849 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:30.230949 (+ 1100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:30.230957 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:30.230972 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:48:30.231611 (+ 639us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:30.231662 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:48:30.231684 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:30.231772 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:30.231952 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 18:48:30.232141 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":605,"thread_start_us":417,"threads_started":1}
I20260811 18:48:30.233870 10939 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:48:30.318732 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 10721
I20260811 18:48:30.353215 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 10164
I20260811 18:48:30.354712 10263 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:48:30.465533 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 10164
2026-08-11T18:48:30Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2702 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T18:48:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:48:30Z Disabled control of system clock
I20260811 18:48:30.562196 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:41521
--webserver_interface=127.25.25.62
--webserver_port=0
--builtin_ntp_servers=127.25.25.20:42015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:41521
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 18:48:30.935321 10981 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:48:30.935698 10981 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:48:30.935791 10981 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:48:30.943701 10981 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:48:30.943849 10981 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:48:30.943888 10981 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:48:30.943938 10981 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:48:30.943981 10981 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:48:30.953845 10981 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:42015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:41521
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:41521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:48:30.955235 10981 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:48:30.957261 10981 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:48:30.970918 10992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:30.970846 10990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:30.970942 10989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:48:30.971787 10981 server_base.cc:1034] running on GCE node
I20260811 18:48:30.972734 10981 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:48:30.974382 10981 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:48:30.975651 10981 hybrid_clock.cc:648] HybridClock initialized: now 1786474110975600 us; error 46 us; skew 500 ppm
I20260811 18:48:30.976162 10981 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:48:30.983245 10981 webserver.cc:460] Webserver started at http://127.25.25.62:42277/ using document root <none> and password file <none>
I20260811 18:48:30.984189 10981 fs_manager.cc:359] Metadata directory not provided
I20260811 18:48:30.984335 10981 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:48:30.984716 10981 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:48:30.988241 10981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "cdefd547bdb5440e843998aae375a79d"
format_stamp: "Formatted at 2026-08-11 18:48:30 on dist-test-slave-lgr5"
server_key: "8627dfc1c6f3efd7298f3ebb66f26b68"
server_key_iv: "da90719df94ef6726526bfc892827bcb"
server_key_version: "encryptionkey@0"
I20260811 18:48:30.989305 10981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "cdefd547bdb5440e843998aae375a79d"
format_stamp: "Formatted at 2026-08-11 18:48:30 on dist-test-slave-lgr5"
server_key: "8627dfc1c6f3efd7298f3ebb66f26b68"
server_key_iv: "da90719df94ef6726526bfc892827bcb"
server_key_version: "encryptionkey@0"
I20260811 18:48:30.996270 10981 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 18:48:31.000712 11003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:31.002599 10981 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260811 18:48:31.002821 10981 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "cdefd547bdb5440e843998aae375a79d"
format_stamp: "Formatted at 2026-08-11 18:48:30 on dist-test-slave-lgr5"
server_key: "8627dfc1c6f3efd7298f3ebb66f26b68"
server_key_iv: "da90719df94ef6726526bfc892827bcb"
server_key_version: "encryptionkey@0"
I20260811 18:48:31.003093 10981 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:48:31.010304 10981 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:48:31.011312 10981 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:48:31.011636 10981 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:48:31.032447 10981 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:41521
I20260811 18:48:31.032527 11085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:41521 every 8 connection(s)
I20260811 18:48:31.033948 10981 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:48:31.038419 11087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:48:31.042387 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 10981
I20260811 18:48:31.042649 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:48:31.043561 25700 external_mini_cluster.cc:1428] Setting key ac0df5ebecd9c5fd03a514914cd84142
I20260811 18:48:31.053273 11095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:31.046151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38412 (local address 127.25.25.62:41521)
0811 18:48:31.047399 (+ 1248us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:31.047411 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:31.047461 (+ 50us) server_negotiation.cc:407] Connection header received
0811 18:48:31.049228 (+ 1767us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:31.049255 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:31.049755 (+ 500us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:31.050196 (+ 441us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:31.051415 (+ 1219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:31.051421 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:31.051436 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:48:31.051463 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:31.051531 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:48:31.051549 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:31.051776 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:31.051933 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 18:48:31.052252 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":727,"thread_start_us":422,"threads_started":1}
I20260811 18:48:31.053386 11087 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdefd547bdb5440e843998aae375a79d: Bootstrap starting.
I20260811 18:48:31.057287 11087 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cdefd547bdb5440e843998aae375a79d: Neither blocks nor log segments found. Creating new log.
I20260811 18:48:31.058666 11087 log.cc:824] T 00000000000000000000000000000000 P cdefd547bdb5440e843998aae375a79d: Log is configured to *not* fsync() on all Append() calls
I20260811 18:48:31.062808 11087 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdefd547bdb5440e843998aae375a79d: No bootstrap required, opened a new log
I20260811 18:48:31.071201 11087 raft_consensus.cc:348] T 00000000000000000000000000000000 P cdefd547bdb5440e843998aae375a79d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdefd547bdb5440e843998aae375a79d" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41521 } }
I20260811 18:48:31.071645 11087 raft_consensus.cc:374] T 00000000000000000000000000000000 P cdefd547bdb5440e843998aae375a79d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:48:31.071751 11087 raft_consensus.cc:729] T 00000000000000000000000000000000 P cdefd547bdb5440e843998aae375a79d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdefd547bdb5440e843998aae375a79d, State: Initialized, Role: FOLLOWER
I20260811 18:48:31.072484 11087 consensus_queue.cc:260] T 00000000000000000000000000000000 P cdefd547bdb5440e843998aae375a79d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdefd547bdb5440e843998aae375a79d" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41521 } }
I20260811 18:48:31.072723 11087 raft_consensus.cc:388] T 00000000000000000000000000000000 P cdefd547bdb5440e843998aae375a79d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:48:31.072863 11087 raft_consensus.cc:482] T 00000000000000000000000000000000 P cdefd547bdb5440e843998aae375a79d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:48:31.073026 11087 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cdefd547bdb5440e843998aae375a79d [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:48:31.075971 11087 raft_consensus.cc:504] T 00000000000000000000000000000000 P cdefd547bdb5440e843998aae375a79d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdefd547bdb5440e843998aae375a79d" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41521 } }
I20260811 18:48:31.076642 11087 leader_election.cc:302] T 00000000000000000000000000000000 P cdefd547bdb5440e843998aae375a79d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cdefd547bdb5440e843998aae375a79d; no voters:
I20260811 18:48:31.077339 11087 leader_election.cc:288] T 00000000000000000000000000000000 P cdefd547bdb5440e843998aae375a79d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:48:31.077498 11097 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cdefd547bdb5440e843998aae375a79d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:48:31.078712 11097 raft_consensus.cc:686] T 00000000000000000000000000000000 P cdefd547bdb5440e843998aae375a79d [term 1 LEADER]: Becoming Leader. State: Replica: cdefd547bdb5440e843998aae375a79d, State: Running, Role: LEADER
I20260811 18:48:31.079298 11097 consensus_queue.cc:237] T 00000000000000000000000000000000 P cdefd547bdb5440e843998aae375a79d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdefd547bdb5440e843998aae375a79d" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41521 } }
I20260811 18:48:31.079802 11087 sys_catalog.cc:564] T 00000000000000000000000000000000 P cdefd547bdb5440e843998aae375a79d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:48:31.083436 11100 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdefd547bdb5440e843998aae375a79d [sys.catalog]: SysCatalogTable state changed. Reason: New leader cdefd547bdb5440e843998aae375a79d. Latest consensus state: current_term: 1 leader_uuid: "cdefd547bdb5440e843998aae375a79d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdefd547bdb5440e843998aae375a79d" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41521 } } }
I20260811 18:48:31.083455 11098 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdefd547bdb5440e843998aae375a79d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cdefd547bdb5440e843998aae375a79d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdefd547bdb5440e843998aae375a79d" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41521 } } }
I20260811 18:48:31.083977 11100 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdefd547bdb5440e843998aae375a79d [sys.catalog]: This master's current role is: LEADER
I20260811 18:48:31.083982 11098 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdefd547bdb5440e843998aae375a79d [sys.catalog]: This master's current role is: LEADER
I20260811 18:48:31.084925 11105 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:48:31.090291 11105 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:48:31.100831 11105 catalog_manager.cc:1347] Generated new cluster ID: d5ca9f92d1084d9c87765842baf90848
I20260811 18:48:31.100989 11105 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:48:31.125072 11105 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:48:31.125607 11105 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:48:31.133930 11105 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cdefd547bdb5440e843998aae375a79d: Generated new TSK 0
I20260811 18:48:31.134928 11105 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:48:31.155627 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:0
--local_ip_for_outbound_sockets=127.25.25.1
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:41521
--builtin_ntp_servers=127.25.25.20:42015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 18:48:31.546627 11126 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:48:31.546964 11126 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:48:31.547060 11126 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:48:31.554862 11126 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:48:31.555002 11126 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:48:31.555138 11126 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:48:31.565176 11126 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:42015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:41521
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:48:31.566679 11126 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:48:31.568612 11126 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:48:31.583401 11141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:31.583472 11134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:31.583390 11136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:48:31.584007 11126 server_base.cc:1034] running on GCE node
I20260811 18:48:31.584846 11126 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:48:31.585903 11126 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:48:31.587129 11126 hybrid_clock.cc:648] HybridClock initialized: now 1786474111587068 us; error 53 us; skew 500 ppm
I20260811 18:48:31.587478 11126 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:48:31.590075 11126 webserver.cc:460] Webserver started at http://127.25.25.1:46421/ using document root <none> and password file <none>
I20260811 18:48:31.590875 11126 fs_manager.cc:359] Metadata directory not provided
I20260811 18:48:31.591008 11126 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:48:31.591361 11126 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:48:31.594635 11126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/data/instance:
uuid: "24744389ffd644479de3bbafcad970b3"
format_stamp: "Formatted at 2026-08-11 18:48:31 on dist-test-slave-lgr5"
server_key: "6b35adf9d445fb0c7f86fc0d445a2cde"
server_key_iv: "014fc6c948b7bef5a49d4cbca4b7c527"
server_key_version: "encryptionkey@0"
I20260811 18:48:31.595553 11126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance:
uuid: "24744389ffd644479de3bbafcad970b3"
format_stamp: "Formatted at 2026-08-11 18:48:31 on dist-test-slave-lgr5"
server_key: "6b35adf9d445fb0c7f86fc0d445a2cde"
server_key_iv: "014fc6c948b7bef5a49d4cbca4b7c527"
server_key_version: "encryptionkey@0"
I20260811 18:48:31.601397 11126 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260811 18:48:31.605504 11151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:31.607177 11126 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:48:31.607357 11126 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "24744389ffd644479de3bbafcad970b3"
format_stamp: "Formatted at 2026-08-11 18:48:31 on dist-test-slave-lgr5"
server_key: "6b35adf9d445fb0c7f86fc0d445a2cde"
server_key_iv: "014fc6c948b7bef5a49d4cbca4b7c527"
server_key_version: "encryptionkey@0"
I20260811 18:48:31.607596 11126 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:48:31.614050 11126 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:48:31.615015 11126 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:48:31.615309 11126 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:48:31.616371 11126 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:48:31.618054 11126 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:48:31.618158 11126 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:31.618273 11126 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:48:31.618345 11126 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:31.651181 11126 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:43951
I20260811 18:48:31.651266 11355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:43951 every 8 connection(s)
I20260811 18:48:31.652597 11126 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:48:31.653277 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 11126
I20260811 18:48:31.653501 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance
I20260811 18:48:31.654263 25700 external_mini_cluster.cc:1428] Setting key 411f87d3fe6fd12655acd6276e7006f4
I20260811 18:48:31.658027 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:0
--local_ip_for_outbound_sockets=127.25.25.2
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:41521
--builtin_ntp_servers=127.25.25.20:42015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 18:48:31.663167 11358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:31.655570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:43785 (local address 127.25.25.62:41521)
0811 18:48:31.656466 (+ 896us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:31.656472 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:31.657903 (+ 1431us) server_negotiation.cc:407] Connection header received
0811 18:48:31.660455 (+ 2552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:31.660460 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:31.660524 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:31.660630 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:31.662346 (+ 1716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:31.662351 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:31.662354 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:48:31.662378 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:31.662425 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:48:31.662439 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:31.662554 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:31.662845 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 18:48:31.662918 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":770,"thread_start_us":665,"threads_started":1}
I20260811 18:48:31.664549 11359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:31.656271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:41521 (local address 127.25.25.1:43785)
0811 18:48:31.657671 (+ 1400us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:31.657740 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:31.660028 (+ 2288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:31.660957 (+ 929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:31.660970 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:31.661114 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:31.661952 (+ 838us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:48:31.661955 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:31.662014 (+ 59us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:48:31.662145 (+ 131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:48:31.662539 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:48:31.662549 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:48:31.662557 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 18:48:31.662865 (+ 308us) client_negotiation.cc:240] Negotiation successful
0811 18:48:31.663187 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":741,"thread_start_us":469,"threads_started":1}
I20260811 18:48:31.666532 11356 heartbeater.cc:347] Connected to a master server at 127.25.25.62:41521
I20260811 18:48:31.666913 11356 heartbeater.cc:464] Registering TS with master...
I20260811 18:48:31.667599 11356 heartbeater.cc:511] Master 127.25.25.62:41521 requested a full tablet report, sending...
I20260811 18:48:31.670083 11038 ts_manager.cc:194] Registered new tserver with Master: 24744389ffd644479de3bbafcad970b3 (127.25.25.1:43951)
W20260811 18:48:32.029569 11360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:48:32.029901 11360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:48:32.029999 11360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:48:32.037935 11360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:48:32.038081 11360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:48:32.038235 11360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:48:32.048844 11360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:42015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:41521
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:48:32.050277 11360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:48:32.052489 11360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:48:32.068347 11373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:32.068450 11367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:32.068327 11369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:48:32.069674 11360 server_base.cc:1034] running on GCE node
I20260811 18:48:32.070458 11360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:48:32.071619 11360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:48:32.072923 11360 hybrid_clock.cc:648] HybridClock initialized: now 1786474112072856 us; error 51 us; skew 500 ppm
I20260811 18:48:32.073369 11360 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:48:32.076300 11360 webserver.cc:460] Webserver started at http://127.25.25.2:35371/ using document root <none> and password file <none>
I20260811 18:48:32.077186 11360 fs_manager.cc:359] Metadata directory not provided
I20260811 18:48:32.077302 11360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:48:32.077668 11360 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:48:32.081244 11360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/data/instance:
uuid: "0b6f648bfb1e4157bb0f03ae043f85d1"
format_stamp: "Formatted at 2026-08-11 18:48:32 on dist-test-slave-lgr5"
server_key: "c5aebad1278a5bb21aae4618659fa11e"
server_key_iv: "1b8ec01e47d9334207fcbd47d89240ef"
server_key_version: "encryptionkey@0"
I20260811 18:48:32.082348 11360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance:
uuid: "0b6f648bfb1e4157bb0f03ae043f85d1"
format_stamp: "Formatted at 2026-08-11 18:48:32 on dist-test-slave-lgr5"
server_key: "c5aebad1278a5bb21aae4618659fa11e"
server_key_iv: "1b8ec01e47d9334207fcbd47d89240ef"
server_key_version: "encryptionkey@0"
I20260811 18:48:32.089200 11360 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.007s
I20260811 18:48:32.094013 11379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:32.095816 11360 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260811 18:48:32.096048 11360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "0b6f648bfb1e4157bb0f03ae043f85d1"
format_stamp: "Formatted at 2026-08-11 18:48:32 on dist-test-slave-lgr5"
server_key: "c5aebad1278a5bb21aae4618659fa11e"
server_key_iv: "1b8ec01e47d9334207fcbd47d89240ef"
server_key_version: "encryptionkey@0"
I20260811 18:48:32.096371 11360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:48:32.102946 11360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:48:32.103957 11360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:48:32.104288 11360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:48:32.105433 11360 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:48:32.107174 11360 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:48:32.107282 11360 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:32.107415 11360 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:48:32.107479 11360 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:32.139492 11360 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:45589
I20260811 18:48:32.139582 11558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:45589 every 8 connection(s)
I20260811 18:48:32.141003 11360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:48:32.141597 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 11360
I20260811 18:48:32.141788 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance
I20260811 18:48:32.142402 25700 external_mini_cluster.cc:1428] Setting key ef8490fb0da0719830846c324fb58b34
I20260811 18:48:32.145675 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:0
--local_ip_for_outbound_sockets=127.25.25.3
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:41521
--builtin_ntp_servers=127.25.25.20:42015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 18:48:32.151356 11358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:32.143865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:48277 (local address 127.25.25.62:41521)
0811 18:48:32.144104 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:32.144111 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:32.146395 (+ 2284us) server_negotiation.cc:407] Connection header received
0811 18:48:32.148593 (+ 2198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:32.148600 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:32.148681 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:32.148801 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:32.150545 (+ 1744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:32.150551 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:32.150555 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:48:32.150582 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:32.150629 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:48:32.150646 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:32.150796 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:32.150989 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 18:48:32.151065 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 18:48:32.152618 11561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:32.144660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:41521 (local address 127.25.25.2:48277)
0811 18:48:32.146162 (+ 1502us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:32.146229 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:32.148074 (+ 1845us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:32.149177 (+ 1103us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:32.149189 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:32.149317 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:32.150121 (+ 804us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:48:32.150124 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:32.150177 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:48:32.150299 (+ 122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:48:32.150760 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:48:32.150771 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:48:32.150778 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 18:48:32.151054 (+ 276us) client_negotiation.cc:240] Negotiation successful
0811 18:48:32.151329 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":836,"thread_start_us":530,"threads_started":1}
I20260811 18:48:32.154489 11559 heartbeater.cc:347] Connected to a master server at 127.25.25.62:41521
I20260811 18:48:32.154838 11559 heartbeater.cc:464] Registering TS with master...
I20260811 18:48:32.155563 11559 heartbeater.cc:511] Master 127.25.25.62:41521 requested a full tablet report, sending...
I20260811 18:48:32.157384 11038 ts_manager.cc:194] Registered new tserver with Master: 0b6f648bfb1e4157bb0f03ae043f85d1 (127.25.25.2:45589)
W20260811 18:48:32.513028 11564 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:48:32.513363 11564 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:48:32.513468 11564 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:48:32.521111 11564 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:48:32.521230 11564 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:48:32.521346 11564 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:48:32.530793 11564 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:42015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:41521
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:48:32.532248 11564 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:48:32.534157 11564 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:48:32.548308 11584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:32.548342 11586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:32.548272 11583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:48:32.549018 11564 server_base.cc:1034] running on GCE node
I20260811 18:48:32.549680 11564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:48:32.550793 11564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:48:32.552040 11564 hybrid_clock.cc:648] HybridClock initialized: now 1786474112551976 us; error 52 us; skew 500 ppm
I20260811 18:48:32.552485 11564 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:48:32.555052 11564 webserver.cc:460] Webserver started at http://127.25.25.3:43377/ using document root <none> and password file <none>
I20260811 18:48:32.555837 11564 fs_manager.cc:359] Metadata directory not provided
I20260811 18:48:32.555939 11564 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:48:32.556357 11564 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:48:32.559609 11564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/data/instance:
uuid: "c3ca61cb7fb8457bb6aa9e682d9d72b8"
format_stamp: "Formatted at 2026-08-11 18:48:32 on dist-test-slave-lgr5"
server_key: "7ef4578d33a11025ced7d83e80c6e850"
server_key_iv: "c2afb22440fb9e5a45df7bac793e2bda"
server_key_version: "encryptionkey@0"
I20260811 18:48:32.560585 11564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance:
uuid: "c3ca61cb7fb8457bb6aa9e682d9d72b8"
format_stamp: "Formatted at 2026-08-11 18:48:32 on dist-test-slave-lgr5"
server_key: "7ef4578d33a11025ced7d83e80c6e850"
server_key_iv: "c2afb22440fb9e5a45df7bac793e2bda"
server_key_version: "encryptionkey@0"
I20260811 18:48:32.566294 11564 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260811 18:48:32.570278 11595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:32.571846 11564 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 18:48:32.572018 11564 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "c3ca61cb7fb8457bb6aa9e682d9d72b8"
format_stamp: "Formatted at 2026-08-11 18:48:32 on dist-test-slave-lgr5"
server_key: "7ef4578d33a11025ced7d83e80c6e850"
server_key_iv: "c2afb22440fb9e5a45df7bac793e2bda"
server_key_version: "encryptionkey@0"
I20260811 18:48:32.572297 11564 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:48:32.578425 11564 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:48:32.579479 11564 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:48:32.579759 11564 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:48:32.580852 11564 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:48:32.582492 11564 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:48:32.582594 11564 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:32.582706 11564 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:48:32.582777 11564 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:32.616802 11564 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:44523
I20260811 18:48:32.616848 11789 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:44523 every 8 connection(s)
I20260811 18:48:32.618270 11564 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:48:32.619022 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 11564
I20260811 18:48:32.619220 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance
I20260811 18:48:32.619799 25700 external_mini_cluster.cc:1428] Setting key 54de7da7198b3a0fe4fdf214aaecc27a
I20260811 18:48:32.626986 11358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:32.621006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:47451 (local address 127.25.25.62:41521)
0811 18:48:32.621203 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:32.621210 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:32.622816 (+ 1606us) server_negotiation.cc:407] Connection header received
0811 18:48:32.624759 (+ 1943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:32.624765 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:32.624841 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:32.624927 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:32.626228 (+ 1301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:32.626234 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:32.626238 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:48:32.626255 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:32.626287 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:48:32.626298 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:32.626409 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:32.626615 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 18:48:32.626685 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 18:48:32.627934 11794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:32.621664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:41521 (local address 127.25.25.3:47451)
0811 18:48:32.622673 (+ 1009us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:32.622725 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:32.624490 (+ 1765us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:32.625186 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:32.625196 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:32.625294 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:32.625927 (+ 633us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:48:32.625929 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:32.625968 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:48:32.626057 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:48:32.626404 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:48:32.626416 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:48:32.626424 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 18:48:32.626689 (+ 265us) client_negotiation.cc:240] Negotiation successful
0811 18:48:32.626964 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":320,"threads_started":1}
I20260811 18:48:32.629266 11790 heartbeater.cc:347] Connected to a master server at 127.25.25.62:41521
I20260811 18:48:32.629580 11790 heartbeater.cc:464] Registering TS with master...
I20260811 18:48:32.630219 11790 heartbeater.cc:511] Master 127.25.25.62:41521 requested a full tablet report, sending...
I20260811 18:48:32.631656 11038 ts_manager.cc:194] Registered new tserver with Master: c3ca61cb7fb8457bb6aa9e682d9d72b8 (127.25.25.3:44523)
I20260811 18:48:32.635365 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 18:48:32.641693 11358 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:48:32.640130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38418 (local address 127.25.25.62:41521)
0811 18:48:32.640285 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:32.640290 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:32.640816 (+ 526us) server_negotiation.cc:407] Connection header received
0811 18:48:32.640985 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:32.640989 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:32.641048 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:32.641124 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:32.641434 (+ 310us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38418: BlockingRecv error: recv got EOF from 127.0.0.1:38418 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 18:48:32.642545 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 11126
I20260811 18:48:32.646143 11802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:32.643626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45200 (local address 127.25.25.1:43951)
0811 18:48:32.644146 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:32.644156 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:32.644186 (+ 30us) server_negotiation.cc:407] Connection header received
0811 18:48:32.644249 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:32.644256 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:32.644476 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:32.644601 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:32.645451 (+ 850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:32.645457 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:32.645469 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:48:32.645481 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:32.645523 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:48:32.645540 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:32.645649 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:32.645723 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 18:48:32.645831 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":225,"threads_started":1}
I20260811 18:48:32.647454 11348 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:48:32.729619 11356 heartbeater.cc:503] Master 127.25.25.62:41521 was elected leader, sending a full tablet report...
I20260811 18:48:32.730963 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 11126
W20260811 18:48:32.755272 11010 connection.cc:535] server connection from 127.25.25.1:43785 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 18:48:32.755622 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 11360
I20260811 18:48:32.759491 11804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:32.756620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53352 (local address 127.25.25.2:45589)
0811 18:48:32.757149 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:32.757156 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:32.757185 (+ 29us) server_negotiation.cc:407] Connection header received
0811 18:48:32.757250 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:32.757257 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:32.757527 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:32.757690 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:32.758734 (+ 1044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:32.758740 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:32.758754 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:48:32.758773 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:32.758817 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:48:32.758831 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:32.758969 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:32.759101 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 18:48:32.759215 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":236,"threads_started":1}
I20260811 18:48:32.760964 11552 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:48:32.843688 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 11360
I20260811 18:48:32.871583 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 11564
I20260811 18:48:32.875643 11806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:32.872697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34708 (local address 127.25.25.3:44523)
0811 18:48:32.873352 (+ 655us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:32.873360 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:32.873394 (+ 34us) server_negotiation.cc:407] Connection header received
0811 18:48:32.873483 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:32.873492 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:32.873773 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:32.873952 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:32.874951 (+ 999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:32.874958 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:32.874971 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:48:32.874984 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:32.875043 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:48:32.875059 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:32.875202 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:32.875253 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 18:48:32.875347 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":303,"threads_started":1}
I20260811 18:48:32.877101 11784 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:48:32.962054 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 11564
I20260811 18:48:32.986590 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 10981
I20260811 18:48:32.987934 11081 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:48:33.094018 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 10981
2026-08-11T18:48:33Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2630 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:48:33 dist-test-slave-lgr5 krb5kdc[11813](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:48:33 dist-test-slave-lgr5 krb5kdc[11813](info): set up 2 sockets
Aug 11 18:48:33 dist-test-slave-lgr5 krb5kdc[11813](info): commencing operation
krb5kdc: starting...
W20260811 18:48:34.393857 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.245s user 0.006s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:48:34 dist-test-slave-lgr5 krb5kdc[11813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474114, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:48:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:48:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:48:34.715977 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:38705
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:44319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:38705
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:48:35.088306 11834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:48:35.088670 11834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:48:35.088811 11834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:48:35.096712 11834 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:48:35.096870 11834 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:48:35.096956 11834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:48:35.097039 11834 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:48:35.097102 11834 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:48:35.107884 11834 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:44319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:38705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:38705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:48:35.109449 11834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:48:35.110896 11834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:48:35.124185 11840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:35.124337 11847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:35.124198 11842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:48:35.125032 11834 server_base.cc:1034] running on GCE node
I20260811 18:48:35.126024 11834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:48:35.127842 11834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:48:35.129123 11834 hybrid_clock.cc:648] HybridClock initialized: now 1786474115129066 us; error 49 us; skew 500 ppm
I20260811 18:48:35.129606 11834 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:48:35 dist-test-slave-lgr5 krb5kdc[11813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474115, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:48:35.133363 11834 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:48:35.135318 11834 webserver.cc:460] Webserver started at http://127.25.25.62:38687/ using document root <none> and password file <none>
I20260811 18:48:35.136199 11834 fs_manager.cc:359] Metadata directory not provided
I20260811 18:48:35.136355 11834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:48:35.136708 11834 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:48:35.140142 11834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "658b8a4c854b413fb8c58bb886dec79f"
format_stamp: "Formatted at 2026-08-11 18:48:35 on dist-test-slave-lgr5"
server_key: "6c7ab5fed4f796758619f792d4e6a0e0"
server_key_iv: "bb90110fbd7e693aa0f5410c443692c9"
server_key_version: "encryptionkey@0"
I20260811 18:48:35.141093 11834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "658b8a4c854b413fb8c58bb886dec79f"
format_stamp: "Formatted at 2026-08-11 18:48:35 on dist-test-slave-lgr5"
server_key: "6c7ab5fed4f796758619f792d4e6a0e0"
server_key_iv: "bb90110fbd7e693aa0f5410c443692c9"
server_key_version: "encryptionkey@0"
I20260811 18:48:35.146894 11834 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 18:48:35.150822 11860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:35.152393 11834 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 18:48:35.152598 11834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "658b8a4c854b413fb8c58bb886dec79f"
format_stamp: "Formatted at 2026-08-11 18:48:35 on dist-test-slave-lgr5"
server_key: "6c7ab5fed4f796758619f792d4e6a0e0"
server_key_iv: "bb90110fbd7e693aa0f5410c443692c9"
server_key_version: "encryptionkey@0"
I20260811 18:48:35.152806 11834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:48:35.172659 11834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:48:35.178104 11834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:48:35.178434 11834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:48:35.197984 11834 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:38705
I20260811 18:48:35.198063 11944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:38705 every 8 connection(s)
I20260811 18:48:35.199527 11834 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:48:35.203728 11947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:48:35.208549 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 11834
I20260811 18:48:35.208815 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:48:35.209619 25700 external_mini_cluster.cc:1428] Setting key 46509fd4feddbc5fac33ddb8fecc8aca
I20260811 18:48:35.217042 11947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 658b8a4c854b413fb8c58bb886dec79f: Bootstrap starting.
I20260811 18:48:35.221227 11947 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 658b8a4c854b413fb8c58bb886dec79f: Neither blocks nor log segments found. Creating new log.
I20260811 18:48:35.222563 11947 log.cc:824] T 00000000000000000000000000000000 P 658b8a4c854b413fb8c58bb886dec79f: Log is configured to *not* fsync() on all Append() calls
Aug 11 18:48:35 dist-test-slave-lgr5 krb5kdc[11813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474114, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:48:35.226727 11947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 658b8a4c854b413fb8c58bb886dec79f: No bootstrap required, opened a new log
I20260811 18:48:35.236618 11947 raft_consensus.cc:348] T 00000000000000000000000000000000 P 658b8a4c854b413fb8c58bb886dec79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "658b8a4c854b413fb8c58bb886dec79f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38705 } }
I20260811 18:48:35.237057 11947 raft_consensus.cc:374] T 00000000000000000000000000000000 P 658b8a4c854b413fb8c58bb886dec79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:48:35.237082 11954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:35.212016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36186 (local address 127.25.25.62:38705)
0811 18:48:35.212886 (+ 870us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:35.212899 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:35.212945 (+ 46us) server_negotiation.cc:407] Connection header received
0811 18:48:35.215203 (+ 2258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:35.215237 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:35.215752 (+ 515us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:35.216237 (+ 485us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:35.218254 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:35.219762 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:35.221703 (+ 1941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:35.222478 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:35.222652 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:35.228283 (+ 5631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:35.228294 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:35.228314 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:35.228369 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:35.231930 (+ 3561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:35.233059 (+ 1129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:35.233069 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:35.233081 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:35.233323 (+ 242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:35.233791 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:35.233794 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:35.233796 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:35.234507 (+ 711us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:35.234848 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:35.235325 (+ 477us) server_negotiation.cc:299] Negotiation successful
0811 18:48:35.235825 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":635,"thread_start_us":354,"threads_started":1}
I20260811 18:48:35.237190 11947 raft_consensus.cc:729] T 00000000000000000000000000000000 P 658b8a4c854b413fb8c58bb886dec79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658b8a4c854b413fb8c58bb886dec79f, State: Initialized, Role: FOLLOWER
I20260811 18:48:35.237804 11947 consensus_queue.cc:260] T 00000000000000000000000000000000 P 658b8a4c854b413fb8c58bb886dec79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "658b8a4c854b413fb8c58bb886dec79f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38705 } }
I20260811 18:48:35.238041 11947 raft_consensus.cc:388] T 00000000000000000000000000000000 P 658b8a4c854b413fb8c58bb886dec79f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:48:35.238169 11947 raft_consensus.cc:482] T 00000000000000000000000000000000 P 658b8a4c854b413fb8c58bb886dec79f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:48:35.238339 11947 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 658b8a4c854b413fb8c58bb886dec79f [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:48:35.240886 11947 raft_consensus.cc:504] T 00000000000000000000000000000000 P 658b8a4c854b413fb8c58bb886dec79f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "658b8a4c854b413fb8c58bb886dec79f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38705 } }
I20260811 18:48:35.241436 11947 leader_election.cc:302] T 00000000000000000000000000000000 P 658b8a4c854b413fb8c58bb886dec79f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 658b8a4c854b413fb8c58bb886dec79f; no voters:
I20260811 18:48:35.242197 11947 leader_election.cc:288] T 00000000000000000000000000000000 P 658b8a4c854b413fb8c58bb886dec79f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:48:35.242332 11958 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 658b8a4c854b413fb8c58bb886dec79f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:48:35.243461 11958 raft_consensus.cc:686] T 00000000000000000000000000000000 P 658b8a4c854b413fb8c58bb886dec79f [term 1 LEADER]: Becoming Leader. State: Replica: 658b8a4c854b413fb8c58bb886dec79f, State: Running, Role: LEADER
I20260811 18:48:35.244510 11958 consensus_queue.cc:237] T 00000000000000000000000000000000 P 658b8a4c854b413fb8c58bb886dec79f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "658b8a4c854b413fb8c58bb886dec79f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38705 } }
I20260811 18:48:35.244769 11947 sys_catalog.cc:564] T 00000000000000000000000000000000 P 658b8a4c854b413fb8c58bb886dec79f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:48:35.247824 11959 sys_catalog.cc:455] T 00000000000000000000000000000000 P 658b8a4c854b413fb8c58bb886dec79f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "658b8a4c854b413fb8c58bb886dec79f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "658b8a4c854b413fb8c58bb886dec79f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38705 } } }
I20260811 18:48:35.248446 11959 sys_catalog.cc:458] T 00000000000000000000000000000000 P 658b8a4c854b413fb8c58bb886dec79f [sys.catalog]: This master's current role is: LEADER
I20260811 18:48:35.247951 11960 sys_catalog.cc:455] T 00000000000000000000000000000000 P 658b8a4c854b413fb8c58bb886dec79f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 658b8a4c854b413fb8c58bb886dec79f. Latest consensus state: current_term: 1 leader_uuid: "658b8a4c854b413fb8c58bb886dec79f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "658b8a4c854b413fb8c58bb886dec79f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38705 } } }
I20260811 18:48:35.248910 11960 sys_catalog.cc:458] T 00000000000000000000000000000000 P 658b8a4c854b413fb8c58bb886dec79f [sys.catalog]: This master's current role is: LEADER
I20260811 18:48:35.249331 11973 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:48:35.255208 11973 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:48:35.265679 11973 catalog_manager.cc:1347] Generated new cluster ID: 760a1631c0e246c992c6b37c8ea9fbe1
I20260811 18:48:35.265823 11973 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:48:35.283576 11973 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:48:35.285750 11973 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:48:35.304705 11973 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 658b8a4c854b413fb8c58bb886dec79f: Generated new TSK 0
I20260811 18:48:35.306030 11973 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.25.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
I20260811 18:48:35.380771 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:0
--local_ip_for_outbound_sockets=127.25.25.1
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38705
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:44319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:48:35.748782 11992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:48:35.749118 11992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:48:35.749248 11992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:48:35.757270 11992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:48:35.757400 11992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:48:35.757542 11992 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:48:35.767856 11992 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:44319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38705
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:48:35.769357 11992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:48:35.770764 11992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:48:35.788148 11999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:35.788976 12001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:35.789162 11997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:48:35.789628 11992 server_base.cc:1034] running on GCE node
I20260811 18:48:35.790380 11992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:48:35.791536 11992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:48:35.792791 11992 hybrid_clock.cc:648] HybridClock initialized: now 1786474115792714 us; error 66 us; skew 500 ppm
I20260811 18:48:35.793167 11992 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:48:35 dist-test-slave-lgr5 krb5kdc[11813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474115, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:48:35.796810 11992 init.cc:377] Logged in from keytab as kudu/127.25.25.1@KRBTEST.COM (short username kudu)
I20260811 18:48:35.798623 11992 webserver.cc:460] Webserver started at http://127.25.25.1:42637/ using document root <none> and password file <none>
I20260811 18:48:35.799423 11992 fs_manager.cc:359] Metadata directory not provided
I20260811 18:48:35.799553 11992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:48:35.799868 11992 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:48:35.803553 11992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/data/instance:
uuid: "9c01238ecaec4dfaabba6a24b767f97e"
format_stamp: "Formatted at 2026-08-11 18:48:35 on dist-test-slave-lgr5"
server_key: "27c14f4defe499fe59b769caa561ec9a"
server_key_iv: "37e78dbb8b493bc36392ae568a01110f"
server_key_version: "encryptionkey@0"
I20260811 18:48:35.804523 11992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance:
uuid: "9c01238ecaec4dfaabba6a24b767f97e"
format_stamp: "Formatted at 2026-08-11 18:48:35 on dist-test-slave-lgr5"
server_key: "27c14f4defe499fe59b769caa561ec9a"
server_key_iv: "37e78dbb8b493bc36392ae568a01110f"
server_key_version: "encryptionkey@0"
I20260811 18:48:35.810753 11992 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 18:48:35.814913 12012 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:35.816792 11992 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260811 18:48:35.817020 11992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "9c01238ecaec4dfaabba6a24b767f97e"
format_stamp: "Formatted at 2026-08-11 18:48:35 on dist-test-slave-lgr5"
server_key: "27c14f4defe499fe59b769caa561ec9a"
server_key_iv: "37e78dbb8b493bc36392ae568a01110f"
server_key_version: "encryptionkey@0"
I20260811 18:48:35.817258 11992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:48:35.835709 11992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:48:35.840802 11992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:48:35.841131 11992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:48:35.842224 11992 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:48:35.843796 11992 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:48:35.843888 11992 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:35.844007 11992 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:48:35.844065 11992 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:35.878108 11992 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:45481
I20260811 18:48:35.878156 12201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:45481 every 8 connection(s)
I20260811 18:48:35.879557 11992 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:48:35.883798 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 11992
I20260811 18:48:35.884032 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance
I20260811 18:48:35.884690 25700 external_mini_cluster.cc:1428] Setting key 0deb6567c5ceb3d4739d43e08f4bc6b0
Aug 11 18:48:35 dist-test-slave-lgr5 krb5kdc[11813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474115, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:48:35.901715 12205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:35.882230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:51247 (local address 127.25.25.62:38705)
0811 18:48:35.882692 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:35.882697 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:35.883645 (+ 948us) server_negotiation.cc:407] Connection header received
0811 18:48:35.885632 (+ 1987us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:35.885637 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:35.885717 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:35.885865 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:35.887488 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:35.888523 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:35.890212 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:35.890737 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:35.890871 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:35.894693 (+ 3822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:35.894700 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:35.894704 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:35.894747 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:35.897942 (+ 3195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:35.898930 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:35.898936 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:35.898939 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:35.899102 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:35.899766 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:35.899771 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:35.899773 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:35.900125 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:35.900268 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:35.901226 (+ 958us) server_negotiation.cc:299] Negotiation successful
0811 18:48:35.901447 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":255,"threads_started":1}
I20260811 18:48:35.903225 12206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:35.882705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38705 (local address 127.25.25.1:51247)
0811 18:48:35.883477 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:35.883519 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:35.885330 (+ 1811us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:35.886052 (+ 722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:35.886061 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:35.886699 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:35.887299 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:35.887320 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:35.888727 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:35.888732 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:35.890052 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:35.890065 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:35.890944 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:35.890948 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:35.891151 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:35.891841 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:35.891865 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:35.894430 (+ 2565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:48:35.898140 (+ 3710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:48:35.898150 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:48:35.898166 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:48:35.898778 (+ 612us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:48:35.899253 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:48:35.899259 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:48:35.899263 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:48:35.899617 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:48:35.900274 (+ 657us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:48:35.900283 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:48:35.900784 (+ 501us) client_negotiation.cc:769] Sending connection context
0811 18:48:35.901118 (+ 334us) client_negotiation.cc:240] Negotiation successful
0811 18:48:35.901727 (+ 609us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":282,"threads_started":1}
I20260811 18:48:35.905184 12203 heartbeater.cc:347] Connected to a master server at 127.25.25.62:38705
I20260811 18:48:35.905534 12203 heartbeater.cc:464] Registering TS with master...
I20260811 18:48:35.906363 12203 heartbeater.cc:511] Master 127.25.25.62:38705 requested a full tablet report, sending...
I20260811 18:48:35.908761 11891 ts_manager.cc:194] Registered new tserver with Master: 9c01238ecaec4dfaabba6a24b767f97e (127.25.25.1:45481)
I20260811 18:48:35.910364 11891 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.1@KRBTEST.COM'} at 127.25.25.1:51247
WARNING: no policy specified for kudu/127.25.25.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
I20260811 18:48:35.955842 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:0
--local_ip_for_outbound_sockets=127.25.25.2
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38705
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:44319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:48:36.324337 12210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:48:36.324677 12210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:48:36.324820 12210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:48:36.332671 12210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:48:36.332829 12210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:48:36.332994 12210 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:48:36.343431 12210 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:44319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38705
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:48:36.344980 12210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:48:36.346491 12210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:48:36.361191 12221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:36.361230 12218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:36.361264 12216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:48:36.362231 12210 server_base.cc:1034] running on GCE node
I20260811 18:48:36.362928 12210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:48:36.364028 12210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:48:36.365360 12210 hybrid_clock.cc:648] HybridClock initialized: now 1786474116365235 us; error 69 us; skew 500 ppm
I20260811 18:48:36.365770 12210 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:48:36 dist-test-slave-lgr5 krb5kdc[11813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474116, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:48:36.374199 12210 init.cc:377] Logged in from keytab as kudu/127.25.25.2@KRBTEST.COM (short username kudu)
I20260811 18:48:36.376040 12210 webserver.cc:460] Webserver started at http://127.25.25.2:43173/ using document root <none> and password file <none>
I20260811 18:48:36.376857 12210 fs_manager.cc:359] Metadata directory not provided
I20260811 18:48:36.376991 12210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:48:36.377313 12210 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:48:36.380599 12210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/data/instance:
uuid: "db0d68ca2fcf4233aabe95c5ad00bc50"
format_stamp: "Formatted at 2026-08-11 18:48:36 on dist-test-slave-lgr5"
server_key: "573e7c5fceb31cc3049d32a533a0ab58"
server_key_iv: "cbaa105c5143235d503746767895c558"
server_key_version: "encryptionkey@0"
I20260811 18:48:36.381404 12210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance:
uuid: "db0d68ca2fcf4233aabe95c5ad00bc50"
format_stamp: "Formatted at 2026-08-11 18:48:36 on dist-test-slave-lgr5"
server_key: "573e7c5fceb31cc3049d32a533a0ab58"
server_key_iv: "cbaa105c5143235d503746767895c558"
server_key_version: "encryptionkey@0"
I20260811 18:48:36.387598 12210 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 18:48:36.391642 12232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:36.393353 12210 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:48:36.393563 12210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "db0d68ca2fcf4233aabe95c5ad00bc50"
format_stamp: "Formatted at 2026-08-11 18:48:36 on dist-test-slave-lgr5"
server_key: "573e7c5fceb31cc3049d32a533a0ab58"
server_key_iv: "cbaa105c5143235d503746767895c558"
server_key_version: "encryptionkey@0"
I20260811 18:48:36.393782 12210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:48:36.421919 12210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:48:36.426563 12210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:48:36.426896 12210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:48:36.427999 12210 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:48:36.429618 12210 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:48:36.429710 12210 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:36.429842 12210 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:48:36.429898 12210 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:36.465966 12210 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:42163
I20260811 18:48:36.466100 12410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:42163 every 8 connection(s)
I20260811 18:48:36.467401 12210 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:48:36.471235 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 12210
I20260811 18:48:36.471503 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance
I20260811 18:48:36.471987 25700 external_mini_cluster.cc:1428] Setting key 7d145675e49936e92eb7188f198a8172
Aug 11 18:48:36 dist-test-slave-lgr5 krb5kdc[11813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474116, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:48:36.491699 12414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:36.470384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:48365 (local address 127.25.25.62:38705)
0811 18:48:36.470979 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:36.470987 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:36.472025 (+ 1038us) server_negotiation.cc:407] Connection header received
0811 18:48:36.474168 (+ 2143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:36.474172 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:36.474245 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:36.474366 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:36.476144 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:36.477265 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:36.479069 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:36.479702 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:36.479865 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:36.483901 (+ 4036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:36.483910 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:36.483915 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:36.483968 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:36.487544 (+ 3576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:36.488809 (+ 1265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:36.488815 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:36.488817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:36.489009 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:36.489592 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:36.489597 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:36.489599 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:36.489944 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:36.490077 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:36.491143 (+ 1066us) server_negotiation.cc:299] Negotiation successful
0811 18:48:36.491374 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":269,"threads_started":1}
I20260811 18:48:36.493222 12415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:36.470932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38705 (local address 127.25.25.2:48365)
0811 18:48:36.471807 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:36.471871 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:36.473845 (+ 1974us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:36.474611 (+ 766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:36.474620 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:36.475227 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:36.475898 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:36.475919 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:36.477523 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:36.477528 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:36.478868 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:36.478885 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:36.480001 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:36.480007 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:36.480300 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:36.481069 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:36.481095 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:36.483545 (+ 2450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:48:36.487792 (+ 4247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:48:36.487806 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:48:36.487851 (+ 45us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:48:36.488604 (+ 753us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:48:36.489141 (+ 537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:48:36.489146 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:48:36.489150 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:48:36.489431 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:48:36.490097 (+ 666us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:48:36.490105 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:48:36.490589 (+ 484us) client_negotiation.cc:769] Sending connection context
0811 18:48:36.490994 (+ 405us) client_negotiation.cc:240] Negotiation successful
0811 18:48:36.491590 (+ 596us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":353,"threads_started":1}
I20260811 18:48:36.495096 12411 heartbeater.cc:347] Connected to a master server at 127.25.25.62:38705
I20260811 18:48:36.495488 12411 heartbeater.cc:464] Registering TS with master...
I20260811 18:48:36.496596 12411 heartbeater.cc:511] Master 127.25.25.62:38705 requested a full tablet report, sending...
I20260811 18:48:36.498665 11891 ts_manager.cc:194] Registered new tserver with Master: db0d68ca2fcf4233aabe95c5ad00bc50 (127.25.25.2:42163)
I20260811 18:48:36.499650 11891 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.2@KRBTEST.COM'} at 127.25.25.2:48365
WARNING: no policy specified for kudu/127.25.25.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
I20260811 18:48:36.544445 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:0
--local_ip_for_outbound_sockets=127.25.25.3
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38705
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:44319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:48:36.912588 12420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:48:36.912935 12420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:48:36.913079 12420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260811 18:48:36.913956 12203 heartbeater.cc:503] Master 127.25.25.62:38705 was elected leader, sending a full tablet report...
W20260811 18:48:36.921176 12420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:48:36.921343 12420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:48:36.921546 12420 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:48:36.934165 12420 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:44319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38705
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:48:36.935724 12420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:48:36.937250 12420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:48:36.952492 12432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:36.952548 12428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:48:36.952572 12427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:48:36.953362 12420 server_base.cc:1034] running on GCE node
I20260811 18:48:36.954064 12420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:48:36.955152 12420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:48:36.956413 12420 hybrid_clock.cc:648] HybridClock initialized: now 1786474116956358 us; error 52 us; skew 500 ppm
I20260811 18:48:36.956766 12420 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:48:36 dist-test-slave-lgr5 krb5kdc[11813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474116, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:48:36.960352 12420 init.cc:377] Logged in from keytab as kudu/127.25.25.3@KRBTEST.COM (short username kudu)
I20260811 18:48:36.962194 12420 webserver.cc:460] Webserver started at http://127.25.25.3:36159/ using document root <none> and password file <none>
I20260811 18:48:36.963027 12420 fs_manager.cc:359] Metadata directory not provided
I20260811 18:48:36.963173 12420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:48:36.963511 12420 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:48:36.967078 12420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/data/instance:
uuid: "7a32a57a69694ebda80376b0b558236c"
format_stamp: "Formatted at 2026-08-11 18:48:36 on dist-test-slave-lgr5"
server_key: "530c65c951abc80ec68ea8c2cdb63bab"
server_key_iv: "6227709ea172a90049d7b6259a19602a"
server_key_version: "encryptionkey@0"
I20260811 18:48:36.968050 12420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance:
uuid: "7a32a57a69694ebda80376b0b558236c"
format_stamp: "Formatted at 2026-08-11 18:48:36 on dist-test-slave-lgr5"
server_key: "530c65c951abc80ec68ea8c2cdb63bab"
server_key_iv: "6227709ea172a90049d7b6259a19602a"
server_key_version: "encryptionkey@0"
I20260811 18:48:36.974601 12420 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 18:48:36.978848 12443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:36.980571 12420 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 18:48:36.980772 12420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "7a32a57a69694ebda80376b0b558236c"
format_stamp: "Formatted at 2026-08-11 18:48:36 on dist-test-slave-lgr5"
server_key: "530c65c951abc80ec68ea8c2cdb63bab"
server_key_iv: "6227709ea172a90049d7b6259a19602a"
server_key_version: "encryptionkey@0"
I20260811 18:48:36.981026 12420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:48:36.996320 12420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:48:37.001088 12420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:48:37.001403 12420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:48:37.002563 12420 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:48:37.004151 12420 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:48:37.004238 12420 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:37.004372 12420 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:48:37.004429 12420 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:48:37.037474 12420 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:41431
I20260811 18:48:37.037524 12631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:41431 every 8 connection(s)
I20260811 18:48:37.038902 12420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:48:37.047346 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 12420
I20260811 18:48:37.047544 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance
I20260811 18:48:37.047968 25700 external_mini_cluster.cc:1428] Setting key 79264fe37b81e224eca482e8e79c1181
Aug 11 18:48:37 dist-test-slave-lgr5 krb5kdc[11813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474116, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:48:37.061789 12636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:37.041739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:45393 (local address 127.25.25.62:38705)
0811 18:48:37.042206 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:37.042212 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:37.043205 (+ 993us) server_negotiation.cc:407] Connection header received
0811 18:48:37.045224 (+ 2019us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:37.045230 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:37.045335 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:37.045437 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:37.047341 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.048320 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.050581 (+ 2261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.051031 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.051170 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:37.055302 (+ 4132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:37.055308 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:37.055311 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:37.055363 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:37.058198 (+ 2835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:37.059154 (+ 956us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:37.059160 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:37.059162 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:37.059310 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:37.059794 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:37.059798 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:37.059801 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:37.060150 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:37.060308 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:37.061108 (+ 800us) server_negotiation.cc:299] Negotiation successful
0811 18:48:37.061387 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":246,"threads_started":1}
I20260811 18:48:37.063200 12637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:37.042198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38705 (local address 127.25.25.3:45393)
0811 18:48:37.043028 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:37.043076 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:37.044903 (+ 1827us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:37.045719 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:37.045729 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:37.046355 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:48:37.047095 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:37.047127 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.048545 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.048550 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:37.050432 (+ 1882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:37.050447 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.051308 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.051316 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:37.051742 (+ 426us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:37.052519 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:48:37.052545 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:48:37.055049 (+ 2504us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:48:37.058388 (+ 3339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:48:37.058399 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:48:37.058416 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:48:37.059014 (+ 598us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:48:37.059436 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:48:37.059441 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:48:37.059444 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:48:37.059666 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:48:37.060289 (+ 623us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:48:37.060298 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:48:37.060706 (+ 408us) client_negotiation.cc:769] Sending connection context
0811 18:48:37.060993 (+ 287us) client_negotiation.cc:240] Negotiation successful
0811 18:48:37.061629 (+ 636us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":311,"threads_started":1}
I20260811 18:48:37.064903 12633 heartbeater.cc:347] Connected to a master server at 127.25.25.62:38705
I20260811 18:48:37.065300 12633 heartbeater.cc:464] Registering TS with master...
I20260811 18:48:37.066203 12633 heartbeater.cc:511] Master 127.25.25.62:38705 requested a full tablet report, sending...
I20260811 18:48:37.068269 11889 ts_manager.cc:194] Registered new tserver with Master: 7a32a57a69694ebda80376b0b558236c (127.25.25.3:41431)
I20260811 18:48:37.069264 11889 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.3@KRBTEST.COM'} at 127.25.25.3:45393
I20260811 18:48:37.077647 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:48:37.096527 12636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:37.082609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36198 (local address 127.25.25.62:38705)
0811 18:48:37.082785 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:37.082790 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:37.083311 (+ 521us) server_negotiation.cc:407] Connection header received
0811 18:48:37.083498 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:37.083502 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:37.083590 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:37.083682 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:37.085353 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.086176 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.087523 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.087986 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.088131 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:37.090627 (+ 2496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:37.090633 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:37.090636 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:37.090678 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:37.093507 (+ 2829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:37.094297 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:37.094302 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:37.094305 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:37.094470 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:37.094884 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:37.094888 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:37.094891 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:37.095265 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:37.095519 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:37.095904 (+ 385us) server_negotiation.cc:299] Negotiation successful
0811 18:48:37.096219 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 18:48:37.101523 11889 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36198:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:48:37.108842 11889 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:48:37.134454 12662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:37.125181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53748 (local address 127.25.25.1:45481)
0811 18:48:37.126107 (+ 926us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:37.126114 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:37.126136 (+ 22us) server_negotiation.cc:407] Connection header received
0811 18:48:37.126210 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:37.126216 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:37.126457 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:37.126664 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:48:37.127691 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.129208 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.131093 (+ 1885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.132585 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.132719 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:37.133003 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:37.133883 (+ 880us) server_negotiation.cc:299] Negotiation successful
0811 18:48:37.134091 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":757,"thread_start_us":611,"threads_started":1}
I20260811 18:48:37.134538 12656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:37.123810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59172 (local address 127.25.25.3:41431)
0811 18:48:37.124736 (+ 926us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:37.124745 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:37.124778 (+ 33us) server_negotiation.cc:407] Connection header received
0811 18:48:37.124866 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:37.124872 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:37.125135 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:37.125367 (+ 232us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:48:37.126380 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.128157 (+ 1777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.131248 (+ 3091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.132811 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.132981 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:37.133212 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:37.134004 (+ 792us) server_negotiation.cc:299] Negotiation successful
0811 18:48:37.134183 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":744,"thread_start_us":571,"threads_started":1}
I20260811 18:48:37.134526 12657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:37.124828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:45481 (local address 127.0.0.1:53748)
0811 18:48:37.125369 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:37.125395 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:37.125512 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:37.126920 (+ 1408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:37.126925 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:37.126950 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:48:37.127475 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:37.127487 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.129321 (+ 1834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.129326 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:37.130844 (+ 1518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:37.130858 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.133158 (+ 2300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.133166 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:37.133537 (+ 371us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:37.133648 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 18:48:37.133800 (+ 152us) client_negotiation.cc:240] Negotiation successful
0811 18:48:37.134058 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"mutex_wait_us":112,"thread_start_us":279,"threads_started":1}
I20260811 18:48:37.135408 12654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:37.123427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:41431 (local address 127.0.0.1:59172)
0811 18:48:37.124270 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:37.124336 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:37.124552 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:37.125683 (+ 1131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:37.125690 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:37.125720 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:48:37.126161 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:37.126178 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.128341 (+ 2163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.128346 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:37.130995 (+ 2649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:37.131009 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.133345 (+ 2336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.133351 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:37.133537 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:37.133648 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 18:48:37.133800 (+ 152us) client_negotiation.cc:240] Negotiation successful
0811 18:48:37.134940 (+ 1140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"mutex_wait_us":978,"thread_start_us":305,"threads_started":1}
I20260811 18:48:37.136744 12664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:37.126228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60216 (local address 127.25.25.2:42163)
0811 18:48:37.126810 (+ 582us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:37.126818 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:37.127662 (+ 844us) server_negotiation.cc:407] Connection header received
0811 18:48:37.127870 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:37.127878 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:37.128151 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:37.128341 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:48:37.129266 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.130816 (+ 1550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.133539 (+ 2723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.135054 (+ 1515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.135192 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:37.135417 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:37.136214 (+ 797us) server_negotiation.cc:299] Negotiation successful
0811 18:48:37.136430 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":322,"threads_started":1}
I20260811 18:48:37.136962 12665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:37.126862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:42163 (local address 127.0.0.1:60216)
0811 18:48:37.127530 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:37.127554 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:37.127668 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:37.128612 (+ 944us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:37.128616 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:37.128647 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:48:37.129051 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:37.129068 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.130983 (+ 1915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.130988 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:37.133358 (+ 2370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:37.133372 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.135305 (+ 1933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.135312 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:37.135534 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:37.135571 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 18:48:37.135660 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 18:48:37.135801 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"mutex_wait_us":3,"thread_start_us":304,"threads_started":1}
I20260811 18:48:37.139402 12089 tablet_service.cc:1467] Processing CreateTablet for tablet ca12ec16a539484eb3426c476a300951 (DEFAULT_TABLE table=test-table [id=b278298603754d28b2e96f1dc6f854c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:48:37.139459 12522 tablet_service.cc:1467] Processing CreateTablet for tablet ca12ec16a539484eb3426c476a300951 (DEFAULT_TABLE table=test-table [id=b278298603754d28b2e96f1dc6f854c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:48:37.140813 12089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca12ec16a539484eb3426c476a300951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:48:37.140970 12522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca12ec16a539484eb3426c476a300951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:48:37.140893 12315 tablet_service.cc:1467] Processing CreateTablet for tablet ca12ec16a539484eb3426c476a300951 (DEFAULT_TABLE table=test-table [id=b278298603754d28b2e96f1dc6f854c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:48:37.142336 12315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca12ec16a539484eb3426c476a300951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:48:37.153740 12667 tablet_bootstrap.cc:492] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e: Bootstrap starting.
I20260811 18:48:37.156279 12669 tablet_bootstrap.cc:492] T ca12ec16a539484eb3426c476a300951 P 7a32a57a69694ebda80376b0b558236c: Bootstrap starting.
I20260811 18:48:37.159199 12667 tablet_bootstrap.cc:654] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e: Neither blocks nor log segments found. Creating new log.
I20260811 18:48:37.159324 12670 tablet_bootstrap.cc:492] T ca12ec16a539484eb3426c476a300951 P db0d68ca2fcf4233aabe95c5ad00bc50: Bootstrap starting.
I20260811 18:48:37.160753 12669 tablet_bootstrap.cc:654] T ca12ec16a539484eb3426c476a300951 P 7a32a57a69694ebda80376b0b558236c: Neither blocks nor log segments found. Creating new log.
I20260811 18:48:37.160840 12667 log.cc:824] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e: Log is configured to *not* fsync() on all Append() calls
I20260811 18:48:37.162139 12669 log.cc:824] T ca12ec16a539484eb3426c476a300951 P 7a32a57a69694ebda80376b0b558236c: Log is configured to *not* fsync() on all Append() calls
I20260811 18:48:37.163015 12670 tablet_bootstrap.cc:654] T ca12ec16a539484eb3426c476a300951 P db0d68ca2fcf4233aabe95c5ad00bc50: Neither blocks nor log segments found. Creating new log.
I20260811 18:48:37.164264 12670 log.cc:824] T ca12ec16a539484eb3426c476a300951 P db0d68ca2fcf4233aabe95c5ad00bc50: Log is configured to *not* fsync() on all Append() calls
I20260811 18:48:37.164696 12667 tablet_bootstrap.cc:492] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e: No bootstrap required, opened a new log
I20260811 18:48:37.165098 12667 ts_tablet_manager.cc:1397] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.004s
I20260811 18:48:37.165580 12669 tablet_bootstrap.cc:492] T ca12ec16a539484eb3426c476a300951 P 7a32a57a69694ebda80376b0b558236c: No bootstrap required, opened a new log
I20260811 18:48:37.165894 12669 ts_tablet_manager.cc:1397] T ca12ec16a539484eb3426c476a300951 P 7a32a57a69694ebda80376b0b558236c: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260811 18:48:37.167629 12670 tablet_bootstrap.cc:492] T ca12ec16a539484eb3426c476a300951 P db0d68ca2fcf4233aabe95c5ad00bc50: No bootstrap required, opened a new log
I20260811 18:48:37.167886 12670 ts_tablet_manager.cc:1397] T ca12ec16a539484eb3426c476a300951 P db0d68ca2fcf4233aabe95c5ad00bc50: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260811 18:48:37.175284 12670 raft_consensus.cc:348] T ca12ec16a539484eb3426c476a300951 P db0d68ca2fcf4233aabe95c5ad00bc50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a32a57a69694ebda80376b0b558236c" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 41431 } } peers { permanent_uuid: "9c01238ecaec4dfaabba6a24b767f97e" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45481 } } peers { permanent_uuid: "db0d68ca2fcf4233aabe95c5ad00bc50" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 42163 } }
I20260811 18:48:37.175777 12670 raft_consensus.cc:374] T ca12ec16a539484eb3426c476a300951 P db0d68ca2fcf4233aabe95c5ad00bc50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:48:37.175904 12670 raft_consensus.cc:729] T ca12ec16a539484eb3426c476a300951 P db0d68ca2fcf4233aabe95c5ad00bc50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db0d68ca2fcf4233aabe95c5ad00bc50, State: Initialized, Role: FOLLOWER
I20260811 18:48:37.176622 12670 consensus_queue.cc:260] T ca12ec16a539484eb3426c476a300951 P db0d68ca2fcf4233aabe95c5ad00bc50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a32a57a69694ebda80376b0b558236c" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 41431 } } peers { permanent_uuid: "9c01238ecaec4dfaabba6a24b767f97e" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45481 } } peers { permanent_uuid: "db0d68ca2fcf4233aabe95c5ad00bc50" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 42163 } }
I20260811 18:48:37.176496 12667 raft_consensus.cc:348] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a32a57a69694ebda80376b0b558236c" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 41431 } } peers { permanent_uuid: "9c01238ecaec4dfaabba6a24b767f97e" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45481 } } peers { permanent_uuid: "db0d68ca2fcf4233aabe95c5ad00bc50" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 42163 } }
I20260811 18:48:37.176762 12669 raft_consensus.cc:348] T ca12ec16a539484eb3426c476a300951 P 7a32a57a69694ebda80376b0b558236c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a32a57a69694ebda80376b0b558236c" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 41431 } } peers { permanent_uuid: "9c01238ecaec4dfaabba6a24b767f97e" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45481 } } peers { permanent_uuid: "db0d68ca2fcf4233aabe95c5ad00bc50" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 42163 } }
I20260811 18:48:37.177100 12667 raft_consensus.cc:374] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:48:37.177206 12667 raft_consensus.cc:729] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c01238ecaec4dfaabba6a24b767f97e, State: Initialized, Role: FOLLOWER
I20260811 18:48:37.177356 12669 raft_consensus.cc:374] T ca12ec16a539484eb3426c476a300951 P 7a32a57a69694ebda80376b0b558236c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:48:37.177508 12669 raft_consensus.cc:729] T ca12ec16a539484eb3426c476a300951 P 7a32a57a69694ebda80376b0b558236c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a32a57a69694ebda80376b0b558236c, State: Initialized, Role: FOLLOWER
I20260811 18:48:37.178114 12667 consensus_queue.cc:260] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a32a57a69694ebda80376b0b558236c" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 41431 } } peers { permanent_uuid: "9c01238ecaec4dfaabba6a24b767f97e" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45481 } } peers { permanent_uuid: "db0d68ca2fcf4233aabe95c5ad00bc50" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 42163 } }
I20260811 18:48:37.178267 12669 consensus_queue.cc:260] T ca12ec16a539484eb3426c476a300951 P 7a32a57a69694ebda80376b0b558236c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a32a57a69694ebda80376b0b558236c" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 41431 } } peers { permanent_uuid: "9c01238ecaec4dfaabba6a24b767f97e" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45481 } } peers { permanent_uuid: "db0d68ca2fcf4233aabe95c5ad00bc50" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 42163 } }
I20260811 18:48:37.179457 12411 heartbeater.cc:503] Master 127.25.25.62:38705 was elected leader, sending a full tablet report...
I20260811 18:48:37.180629 12670 ts_tablet_manager.cc:1428] T ca12ec16a539484eb3426c476a300951 P db0d68ca2fcf4233aabe95c5ad00bc50: Time spent starting tablet: real 0.013s user 0.011s sys 0.001s
I20260811 18:48:37.182129 12633 heartbeater.cc:503] Master 127.25.25.62:38705 was elected leader, sending a full tablet report...
I20260811 18:48:37.183027 12669 ts_tablet_manager.cc:1428] T ca12ec16a539484eb3426c476a300951 P 7a32a57a69694ebda80376b0b558236c: Time spent starting tablet: real 0.017s user 0.010s sys 0.006s
I20260811 18:48:37.185863 12667 ts_tablet_manager.cc:1428] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e: Time spent starting tablet: real 0.021s user 0.018s sys 0.001s
W20260811 18:48:37.219636 12413 tablet.cc:2369] T ca12ec16a539484eb3426c476a300951 P db0d68ca2fcf4233aabe95c5ad00bc50: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:48:37.262665 12678 raft_consensus.cc:482] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:48:37.263063 12678 raft_consensus.cc:504] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a32a57a69694ebda80376b0b558236c" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 41431 } } peers { permanent_uuid: "9c01238ecaec4dfaabba6a24b767f97e" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45481 } } peers { permanent_uuid: "db0d68ca2fcf4233aabe95c5ad00bc50" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 42163 } }
I20260811 18:48:37.265161 12678 leader_election.cc:288] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a32a57a69694ebda80376b0b558236c (127.25.25.3:41431), db0d68ca2fcf4233aabe95c5ad00bc50 (127.25.25.2:42163)
I20260811 18:48:37.271704 12656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:37.265716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:53463 (local address 127.25.25.3:41431)
0811 18:48:37.265969 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:37.265976 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:37.266243 (+ 267us) server_negotiation.cc:407] Connection header received
0811 18:48:37.266538 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:37.266545 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:37.266634 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:37.266735 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:48:37.267380 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.268160 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.269966 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.270775 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.270897 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:37.271005 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:37.271313 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 18:48:37.271453 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 18:48:37.271823 12683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:37.265451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:41431 (local address 127.25.25.1:53463)
0811 18:48:37.266111 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:37.266129 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:37.266304 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:37.266799 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:37.266803 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:37.266830 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:48:37.267227 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:37.267238 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.268295 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.268300 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:37.269784 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:37.269798 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.271006 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.271012 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:37.271152 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:37.271178 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 18:48:37.271262 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 18:48:37.271410 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"spinlock_wait_cycles":54144,"thread_start_us":329,"threads_started":1}
I20260811 18:48:37.272060 12664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:37.266421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:33951 (local address 127.25.25.2:42163)
0811 18:48:37.266663 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:37.266669 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:37.266991 (+ 322us) server_negotiation.cc:407] Connection header received
0811 18:48:37.267186 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:37.267190 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:37.267248 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:37.267324 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:48:37.267851 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.268627 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.270354 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.271149 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.271274 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:37.271373 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:37.271688 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 18:48:37.271824 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260811 18:48:37.272372 12686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:37.266274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:42163 (local address 127.25.25.1:33951)
0811 18:48:37.266886 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0811 18:48:37.266904 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:48:37.267053 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:48:37.267360 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:48:37.267364 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:48:37.267388 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:48:37.267699 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:37.267709 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.268770 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.268774 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:37.270183 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:48:37.270197 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.271379 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.271385 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:48:37.271529 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:37.271557 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 18:48:37.271637 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 18:48:37.271766 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":278,"threads_started":1}
I20260811 18:48:37.273154 12554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca12ec16a539484eb3426c476a300951" candidate_uuid: "9c01238ecaec4dfaabba6a24b767f97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a32a57a69694ebda80376b0b558236c" is_pre_election: true
I20260811 18:48:37.273356 12343 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca12ec16a539484eb3426c476a300951" candidate_uuid: "9c01238ecaec4dfaabba6a24b767f97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db0d68ca2fcf4233aabe95c5ad00bc50" is_pre_election: true
I20260811 18:48:37.273859 12554 raft_consensus.cc:2454] T ca12ec16a539484eb3426c476a300951 P 7a32a57a69694ebda80376b0b558236c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c01238ecaec4dfaabba6a24b767f97e in term 0.
I20260811 18:48:37.273859 12343 raft_consensus.cc:2454] T ca12ec16a539484eb3426c476a300951 P db0d68ca2fcf4233aabe95c5ad00bc50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c01238ecaec4dfaabba6a24b767f97e in term 0.
I20260811 18:48:37.274652 12016 leader_election.cc:302] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a32a57a69694ebda80376b0b558236c, 9c01238ecaec4dfaabba6a24b767f97e; no voters:
I20260811 18:48:37.275115 12678 raft_consensus.cc:2781] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:48:37.275290 12678 raft_consensus.cc:482] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:48:37.275449 12678 raft_consensus.cc:3037] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:48:37.277860 12678 raft_consensus.cc:504] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a32a57a69694ebda80376b0b558236c" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 41431 } } peers { permanent_uuid: "9c01238ecaec4dfaabba6a24b767f97e" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45481 } } peers { permanent_uuid: "db0d68ca2fcf4233aabe95c5ad00bc50" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 42163 } }
I20260811 18:48:37.278592 12678 leader_election.cc:288] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e [CANDIDATE]: Term 1 election: Requested vote from peers 7a32a57a69694ebda80376b0b558236c (127.25.25.3:41431), db0d68ca2fcf4233aabe95c5ad00bc50 (127.25.25.2:42163)
I20260811 18:48:37.279304 12554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca12ec16a539484eb3426c476a300951" candidate_uuid: "9c01238ecaec4dfaabba6a24b767f97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a32a57a69694ebda80376b0b558236c"
I20260811 18:48:37.279343 12343 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca12ec16a539484eb3426c476a300951" candidate_uuid: "9c01238ecaec4dfaabba6a24b767f97e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db0d68ca2fcf4233aabe95c5ad00bc50"
I20260811 18:48:37.279559 12554 raft_consensus.cc:3037] T ca12ec16a539484eb3426c476a300951 P 7a32a57a69694ebda80376b0b558236c [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:48:37.279574 12343 raft_consensus.cc:3037] T ca12ec16a539484eb3426c476a300951 P db0d68ca2fcf4233aabe95c5ad00bc50 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:48:37.282289 12343 raft_consensus.cc:2454] T ca12ec16a539484eb3426c476a300951 P db0d68ca2fcf4233aabe95c5ad00bc50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c01238ecaec4dfaabba6a24b767f97e in term 1.
I20260811 18:48:37.282342 12554 raft_consensus.cc:2454] T ca12ec16a539484eb3426c476a300951 P 7a32a57a69694ebda80376b0b558236c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c01238ecaec4dfaabba6a24b767f97e in term 1.
I20260811 18:48:37.282804 12016 leader_election.cc:302] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c01238ecaec4dfaabba6a24b767f97e, db0d68ca2fcf4233aabe95c5ad00bc50; no voters:
I20260811 18:48:37.283174 12678 raft_consensus.cc:2781] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:48:37.283649 12678 raft_consensus.cc:686] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e [term 1 LEADER]: Becoming Leader. State: Replica: 9c01238ecaec4dfaabba6a24b767f97e, State: Running, Role: LEADER
I20260811 18:48:37.284291 12678 consensus_queue.cc:237] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a32a57a69694ebda80376b0b558236c" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 41431 } } peers { permanent_uuid: "9c01238ecaec4dfaabba6a24b767f97e" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45481 } } peers { permanent_uuid: "db0d68ca2fcf4233aabe95c5ad00bc50" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 42163 } }
I20260811 18:48:37.289930 11886 catalog_manager.cc:5495] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c01238ecaec4dfaabba6a24b767f97e (127.25.25.1). New cstate: current_term: 1 leader_uuid: "9c01238ecaec4dfaabba6a24b767f97e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a32a57a69694ebda80376b0b558236c" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 41431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c01238ecaec4dfaabba6a24b767f97e" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db0d68ca2fcf4233aabe95c5ad00bc50" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 42163 } health_report { overall_health: UNKNOWN } } }
W20260811 18:48:37.290652 12635 tablet.cc:2369] T ca12ec16a539484eb3426c476a300951 P 7a32a57a69694ebda80376b0b558236c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:48:37.333377 12662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:37.327907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53756 (local address 127.25.25.1:45481)
0811 18:48:37.328166 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:37.328173 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:37.328195 (+ 22us) server_negotiation.cc:407] Connection header received
0811 18:48:37.328335 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:37.328339 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:37.328452 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:37.328591 (+ 139us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:48:37.328992 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.329763 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.331109 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.331541 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.331653 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:37.332187 (+ 534us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:48:37.332760 (+ 573us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:48:37.332901 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:37.333014 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 18:48:37.333104 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 18:48:37.342748 12554 raft_consensus.cc:1261] T ca12ec16a539484eb3426c476a300951 P 7a32a57a69694ebda80376b0b558236c [term 1 FOLLOWER]: Refusing update from remote peer 9c01238ecaec4dfaabba6a24b767f97e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:48:37.342748 12343 raft_consensus.cc:1261] T ca12ec16a539484eb3426c476a300951 P db0d68ca2fcf4233aabe95c5ad00bc50 [term 1 FOLLOWER]: Refusing update from remote peer 9c01238ecaec4dfaabba6a24b767f97e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:48:37.344023 12678 consensus_queue.cc:1035] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "db0d68ca2fcf4233aabe95c5ad00bc50" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 42163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:48:37.344477 12689 consensus_queue.cc:1035] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a32a57a69694ebda80376b0b558236c" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:48:37.357303 12693 mvcc.cc:205] Tried to move back new op lower bound from 7317397984623693824 to 7317397984401375232. Current Snapshot: MvccSnapshot[applied={T|T < 7317397984623693824}]
I20260811 18:48:37.357982 12695 mvcc.cc:205] Tried to move back new op lower bound from 7317397984623693824 to 7317397984401375232. Current Snapshot: MvccSnapshot[applied={T|T < 7317397984623693824}]
I20260811 18:48:37.372481 11886 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36198:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:48:37.372938 11886 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36198:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:48:37.378116 11886 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 658b8a4c854b413fb8c58bb886dec79f: Sending DeleteTablet for 3 replicas of tablet ca12ec16a539484eb3426c476a300951
I20260811 18:48:37.379460 12522 tablet_service.cc:1514] Processing DeleteTablet for tablet ca12ec16a539484eb3426c476a300951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:48:37 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:59172
I20260811 18:48:37.379631 12315 tablet_service.cc:1514] Processing DeleteTablet for tablet ca12ec16a539484eb3426c476a300951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:48:37 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:60216
I20260811 18:48:37.379611 12089 tablet_service.cc:1514] Processing DeleteTablet for tablet ca12ec16a539484eb3426c476a300951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:48:37 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:53748
I20260811 18:48:37.381135 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 11992
I20260811 18:48:37.387495 12711 tablet_replica.cc:330] T ca12ec16a539484eb3426c476a300951 P db0d68ca2fcf4233aabe95c5ad00bc50: stopping tablet replica
I20260811 18:48:37.388511 12711 raft_consensus.cc:2229] T ca12ec16a539484eb3426c476a300951 P db0d68ca2fcf4233aabe95c5ad00bc50 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:48:37.389273 12711 raft_consensus.cc:2258] T ca12ec16a539484eb3426c476a300951 P db0d68ca2fcf4233aabe95c5ad00bc50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:48:37.390317 12708 tablet_replica.cc:330] T ca12ec16a539484eb3426c476a300951 P 7a32a57a69694ebda80376b0b558236c: stopping tablet replica
I20260811 18:48:37.392344 12711 ts_tablet_manager.cc:1905] T ca12ec16a539484eb3426c476a300951 P db0d68ca2fcf4233aabe95c5ad00bc50: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:48:37.393042 12708 raft_consensus.cc:2229] T ca12ec16a539484eb3426c476a300951 P 7a32a57a69694ebda80376b0b558236c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:48:37.393738 12708 raft_consensus.cc:2258] T ca12ec16a539484eb3426c476a300951 P 7a32a57a69694ebda80376b0b558236c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:48:37.396715 12712 tablet_replica.cc:330] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e: stopping tablet replica
I20260811 18:48:37.397378 12712 raft_consensus.cc:2229] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:48:37.398279 12712 raft_consensus.cc:2258] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:48:37.400807 12712 ts_tablet_manager.cc:1905] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 11 18:48:37 dist-test-slave-lgr5 krb5kdc[11813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474114, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.1@KRBTEST.COM
I20260811 18:48:37.401755 12708 ts_tablet_manager.cc:1905] T ca12ec16a539484eb3426c476a300951 P 7a32a57a69694ebda80376b0b558236c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:48:37.403364 12711 ts_tablet_manager.cc:1918] T ca12ec16a539484eb3426c476a300951 P db0d68ca2fcf4233aabe95c5ad00bc50: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:48:37.403661 12711 log.cc:1196] T ca12ec16a539484eb3426c476a300951 P db0d68ca2fcf4233aabe95c5ad00bc50: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-1/wal/wals/ca12ec16a539484eb3426c476a300951
I20260811 18:48:37.404423 12711 ts_tablet_manager.cc:1939] T ca12ec16a539484eb3426c476a300951 P db0d68ca2fcf4233aabe95c5ad00bc50: Deleting consensus metadata
I20260811 18:48:37.406922 11869 catalog_manager.cc:4841] TS db0d68ca2fcf4233aabe95c5ad00bc50 (127.25.25.2:42163): tablet ca12ec16a539484eb3426c476a300951 (table test-table [id=b278298603754d28b2e96f1dc6f854c1]) successfully deleted
I20260811 18:48:37.409117 12712 ts_tablet_manager.cc:1918] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:48:37.409107 12708 ts_tablet_manager.cc:1918] T ca12ec16a539484eb3426c476a300951 P 7a32a57a69694ebda80376b0b558236c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:48:37.409308 12708 log.cc:1196] T ca12ec16a539484eb3426c476a300951 P 7a32a57a69694ebda80376b0b558236c: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-2/wal/wals/ca12ec16a539484eb3426c476a300951
I20260811 18:48:37.409528 12712 log.cc:1196] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474012733352-25700-0/minicluster-data/ts-0/wal/wals/ca12ec16a539484eb3426c476a300951
I20260811 18:48:37.409930 12708 ts_tablet_manager.cc:1939] T ca12ec16a539484eb3426c476a300951 P 7a32a57a69694ebda80376b0b558236c: Deleting consensus metadata
I20260811 18:48:37.410512 12712 ts_tablet_manager.cc:1939] T ca12ec16a539484eb3426c476a300951 P 9c01238ecaec4dfaabba6a24b767f97e: Deleting consensus metadata
I20260811 18:48:37.412267 11869 catalog_manager.cc:4841] TS 7a32a57a69694ebda80376b0b558236c (127.25.25.3:41431): tablet ca12ec16a539484eb3426c476a300951 (table test-table [id=b278298603754d28b2e96f1dc6f854c1]) successfully deleted
I20260811 18:48:37.412843 11869 catalog_manager.cc:4841] TS 9c01238ecaec4dfaabba6a24b767f97e (127.25.25.1:45481): tablet ca12ec16a539484eb3426c476a300951 (table test-table [id=b278298603754d28b2e96f1dc6f854c1]) successfully deleted
I20260811 18:48:37.417501 12662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:37.387036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53762 (local address 127.25.25.1:45481)
0811 18:48:37.387609 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:37.387616 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:37.387640 (+ 24us) server_negotiation.cc:407] Connection header received
0811 18:48:37.387723 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:37.387730 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:37.387834 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:37.387962 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:37.390317 (+ 2355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.391720 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.393964 (+ 2244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.394799 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.394928 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:37.409078 (+ 14150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:37.409104 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:37.409126 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:37.409186 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:37.413708 (+ 4522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:37.414611 (+ 903us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:37.414624 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:37.414628 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:37.414838 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:37.415337 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:37.415343 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:37.415347 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:37.415993 (+ 646us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:37.416413 (+ 420us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:37.416732 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 18:48:37.417065 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418}
I20260811 18:48:37.418397 12194 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:48:37.535386 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 11992
I20260811 18:48:37.565696 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 12210
Aug 11 18:48:37 dist-test-slave-lgr5 krb5kdc[11813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474114, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.2@KRBTEST.COM
I20260811 18:48:37.581202 12664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:37.566512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60224 (local address 127.25.25.2:42163)
0811 18:48:37.566732 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:37.566739 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:37.566760 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:48:37.566969 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:37.566975 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:37.567066 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:37.567158 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:37.568532 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.569286 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.570551 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.570965 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.571085 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:37.575339 (+ 4254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:37.575355 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:37.575372 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:37.575419 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:37.578292 (+ 2873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:37.578999 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:37.579007 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:37.579009 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:37.579144 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:37.579528 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:37.579532 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:37.579534 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:37.579962 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:37.580279 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:37.580604 (+ 325us) server_negotiation.cc:299] Negotiation successful
0811 18:48:37.580842 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 18:48:37.581864 12399 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:48:37.674825 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 12210
I20260811 18:48:37.702948 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 12420
Aug 11 18:48:37 dist-test-slave-lgr5 krb5kdc[11813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474114, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.3@KRBTEST.COM
I20260811 18:48:37.720456 12656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:48:37.703859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59176 (local address 127.25.25.3:41431)
0811 18:48:37.704109 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0811 18:48:37.704116 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:48:37.704156 (+ 40us) server_negotiation.cc:407] Connection header received
0811 18:48:37.704224 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:48:37.704229 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:48:37.704311 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:48:37.704396 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:48:37.705787 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.706544 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.707815 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:48:37.708365 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:48:37.708496 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:48:37.713293 (+ 4797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:48:37.713313 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:48:37.713332 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:48:37.713382 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:48:37.717029 (+ 3647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:37.717937 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:37.717946 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:37.717949 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:37.718137 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:48:37.718668 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:48:37.718673 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:48:37.718675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:48:37.719131 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:48:37.719422 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0811 18:48:37.719847 (+ 425us) server_negotiation.cc:299] Negotiation successful
0811 18:48:37.720051 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 18:48:37.721192 12616 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:48:37.813017 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 12420
I20260811 18:48:37.839685 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 11834
I20260811 18:48:37.841063 11938 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:48:37.959314 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 11834
2026-08-11T18:48:37Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4867 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:48:38 dist-test-slave-lgr5 krb5kdc[12721](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:48:38 dist-test-slave-lgr5 krb5kdc[12721](info): set up 2 sockets
Aug 11 18:48:38 dist-test-slave-lgr5 krb5kdc[12721](info): commencing operation
krb5kdc: starting...
W20260811 18:48:39.270044 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.254s user 0.000s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:48:39 dist-test-slave-lgr5 krb5kdc[12721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474119, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:48:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:48:39Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.25.25.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.25.25.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.25.25.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/rangeradmin_127.25.25.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.25.25.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/rangeradmin_127.25.25.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.25.25.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.25.25.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.25.25.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/rangerlookup_127.25.25.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.25.25.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/rangerlookup_127.25.25.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.25.25.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.25.25.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.25.25.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/HTTP_127.25.25.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.25.25.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/HTTP_127.25.25.20@KRBTEST.COM.keytab.
I20260811 18:48:39.719738 25700 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskse5jrw/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/postgres -l logfile start
2026-08-11 18:48:42.724 UTC [12767] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 18:48:42.724 UTC [12767] LOG: listening on IPv4 address "127.25.25.20", port 38679
2026-08-11 18:48:42.729 UTC [12767] LOG: listening on Unix socket "/tmp/.s.PGSQL.38679"
2026-08-11 18:48:42.753 UTC [12769] LOG: database system was shut down at 2026-08-11 18:48:40 UTC
2026-08-11 18:48:42.758 UTC [12767] LOG: database system is ready to accept connections
I20260811 18:48:43.901010 25700 mini_postgres.cc:96] Postgres bound to 38679
2026-08-11 18:48:43.928 UTC [12787] FATAL: database "slave" does not exist
127.25.25.20:38679 - accepting connections
I20260811 18:48:43.929813 25700 mini_ranger.cc:161] Starting Ranger...
I20260811 18:48:43.967018 25700 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 18:48:44.579874 25700 mini_ranger.cc:87] Created ranger Postgres database
I20260811 18:48:44.579995 25700 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ranger-admin
2026-08-11 18:48:45,048 [I] DB FLAVOR :POSTGRES
2026-08-11 18:48:45,049 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 18:48:45,049 [I] Checking connection..
2026-08-11 18:48:45,049 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:38679/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 18:48:45,357 [I] Checking connection passed.
2026-08-11 18:48:45,357 [I] --------- Verifying version history table ---------
2026-08-11 18:48:45,357 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:38679/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 18:48:45,638 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 18:48:45,638 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:38679/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 18:48:45,905 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 18:48:45,906 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 18:48:45,906 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:38679/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 18:48:46.162 UTC [12879] WARNING: there is no transaction in progress
2026-08-11 18:48:46,172 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 18:48:46,172 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:38679/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 18:48:46,450 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 18:48:46,451 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 18:48:46,451 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:38679/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 18:48:46,714 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:38679/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 18:48:46,966 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:38679/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-lgr5.c.gcp-upstream.internal','N') ;"
2026-08-11 18:48:47,247 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:38679/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 18:48:47,512 [I] Table x_portal_user does not exist in database ranger
2026-08-11 18:48:47,512 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:38679/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 18:48:47,783 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 18:48:47,783 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:38679/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 18:48:48,047 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:38679/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 18:48:48,309 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 18:48:48,310 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:38679/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 18:48:49.392 UTC [13041] WARNING: there is no transaction in progress
2026-08-11 18:48:49.410 UTC [13041] WARNING: there is no transaction in progress
2026-08-11 18:48:49.431 UTC [13041] WARNING: there is no transaction in progress
2026-08-11 18:48:49.451 UTC [13041] WARNING: there is no transaction in progress
2026-08-11 18:48:49.474 UTC [13041] WARNING: there is no transaction in progress
2026-08-11 18:48:49.494 UTC [13041] WARNING: there is no transaction in progress
2026-08-11 18:48:49.563 UTC [13041] WARNING: there is no transaction in progress
2026-08-11 18:48:49.573 UTC [13041] WARNING: there is no transaction in progress
2026-08-11 18:48:49.592 UTC [13041] WARNING: there is no transaction in progress
2026-08-11 18:48:49.605 UTC [13041] WARNING: there is no transaction in progress
2026-08-11 18:48:49.617 UTC [13041] WARNING: there is no transaction in progress
2026-08-11 18:48:49.634 UTC [13041] WARNING: there is no transaction in progress
2026-08-11 18:48:49.645 UTC [13041] WARNING: there is no transaction in progress
2026-08-11 18:48:49.653 UTC [13041] WARNING: there is no transaction in progress
2026-08-11 18:48:49.662 UTC [13041] WARNING: there is no transaction in progress
2026-08-11 18:48:49.671 UTC [13041] WARNING: there is no transaction in progress
2026-08-11 18:48:50,477 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 18:48:50,478 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:38679/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 18:48:50,751 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 18:48:50,751 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:38679/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 18:48:51,021 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 18:48:51,022 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:38679/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 18:48:51,305 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 18:48:51,305 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:38679/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 18:48:51,583 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:38679/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 18:48:51,859 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:38679/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-lgr5.c.gcp-upstream.internal';"
2026-08-11 18:48:52,112 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 18:48:52,113 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:38679/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 18:48:52,372 [I] DB_PATCHES have already been applied
I20260811 18:48:52.378994 25700 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ranger-admin:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskse5jrw/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 18:48:52.379101 25700 mini_ranger.cc:193] Using host: 127.25.25.20
I20260811 18:48:52.401661 25700 mini_ranger.cc:227] Ranger admin URL: http://127.25.25.20:51495
Aug 11, 2026 6:48:52 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 6:48:52 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 6:48:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 6:48:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 6:48:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 6:48:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 6:48:53 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 18:48:53.800169 25700 mini_ranger.cc:160] Time spent starting Ranger: real 9.870s user 0.005s sys 0.071s
Aug 11, 2026 6:49:17 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 6:49:17 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 6:49:17 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 6:49:17 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 6:49:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 6:49:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 6:49:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 6:49:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 6:49:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 6:49:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 6:49:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 6:49:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 6:49:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 6:49:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 6:49:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 6:49:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 6:49:17 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 6:49:18 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 18:49:19.328790 25700 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.25.25.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.25.25.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.25.25.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/rangerkms_127.25.25.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.25.25.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/rangerkms_127.25.25.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.25.25.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.25.25.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.25.25.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/HTTP_127.25.25.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.25.25.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/HTTP_127.25.25.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 18:49:19 dist-test-slave-lgr5 krb5kdc[12721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474159, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 18:49:19.565609 25700 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 18:49:19.599663 25700 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 18:49:20.743033 25700 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 18:49:20.743204 25700 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ranger-kms
I20260811 18:49:20.743343 25700 mini_ranger_kms.cc:227] Using postgres at 127.25.25.20:38679
2026-08-11 18:49:21,349 [I] DB FLAVOR :POSTGRES
2026-08-11 18:49:21,349 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 18:49:21,349 [I] Checking connection
2026-08-11 18:49:21,349 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:38679/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 18:49:21,618 [I] connection success
2026-08-11 18:49:21,619 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 18:49:21,619 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 18:49:21,619 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:38679/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 18:49:21,915 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 18:49:21,916 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 18:49:21,916 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 18:49:21,916 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:38679/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 18:49:22,213 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 18:49:22.758842 25700 mini_ranger_kms.cc:310] Created kms service
I20260811 18:49:22.969617 25700 mini_ranger_kms.cc:326] Created kudu user
I20260811 18:49:23.026410 25700 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 18:49:23 dist-test-slave-lgr5 krb5kdc[12721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474159, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.25.25.20@KRBTEST.COM
I20260811 18:49:23.485688 25700 mini_ranger_kms.cc:384] Added ranger policy
I20260811 18:49:23.487323 25700 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ranger-kms:/tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 18:49:23.487402 25700 mini_ranger_kms.cc:240] Using host: 127.25.25.20
I20260811 18:49:23.515460 25700 mini_ranger_kms.cc:276] Ranger KMS PID: 13365
I20260811 18:49:23.515679 25700 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.25.25.20:35885
Aug 11, 2026 6:49:24 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 6:49:24 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 6:49:24 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 6:49:24 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 6:49:24 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 6:49:24 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 18:49:25 dist-test-slave-lgr5 krb5kdc[12721](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786474165, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.25.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:49:26.317350 25700 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.752s user 0.135s sys 0.514s
I20260811 18:49:26.317735 25700 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 18:49:26.317973 25700 mini_ranger_kms.cc:401] 127.25.25.20:35885/kms/v1/keys
Aug 11 18:49:26 dist-test-slave-lgr5 krb5kdc[12721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474165, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.25.20@KRBTEST.COM for HTTP/127.25.25.20@KRBTEST.COM
Aug 11 18:49:26 dist-test-slave-lgr5 krb5kdc[12721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474165, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.25.20@KRBTEST.COM for HTTP/127.25.25.20@KRBTEST.COM
Aug 11 18:49:29 dist-test-slave-lgr5 krb5kdc[12721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:49:29.913901 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:41909
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:40997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:41909
--ranger_config_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.25.20:35885/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:49:30.514943 13442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:49:30.515421 13442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:49:30.515683 13442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:49:30.525627 13442 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:49:30.525879 13442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:49:30.525988 13442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:49:30.526118 13442 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:49:30.526276 13442 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:49:30.538208 13442 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/master-0/wal
--ranger_kms_url=127.25.25.20:35885/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:41909
--ranger_config_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:41909
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:49:30.539806 13442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:49:30.541376 13442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:49:30.558980 13449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:49:30.559072 13456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:49:30.559091 13450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:49:30.560015 13442 server_base.cc:1034] running on GCE node
I20260811 18:49:30.561048 13442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:49:30.562827 13442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:49:30.564201 13442 hybrid_clock.cc:648] HybridClock initialized: now 1786474170564104 us; error 61 us; skew 500 ppm
I20260811 18:49:30.564682 13442 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:49:30 dist-test-slave-lgr5 krb5kdc[12721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474170, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:49:30.572947 13442 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:49:30.575160 13442 webserver.cc:460] Webserver started at http://127.25.25.62:36901/ using document root <none> and password file <none>
I20260811 18:49:30.576027 13442 fs_manager.cc:359] Metadata directory not provided
I20260811 18:49:30.576195 13442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:49:30.576555 13442 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:49:30 dist-test-slave-lgr5 krb5kdc[12721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474170, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for HTTP/127.25.25.20@KRBTEST.COM
I20260811 18:49:30.643754 13442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "5f602ee55a9d45499671cdfd53735a42"
format_stamp: "Formatted at 2026-08-11 18:49:30 on dist-test-slave-lgr5"
server_key: "4fcf60e486ee9ce7325ef86dbd606fab"
server_key_iv: "3247ae51895b0f249d7d02b0eee9dbf4"
server_key_version: "kuduclusterkey@0"
I20260811 18:49:30.645095 13442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "5f602ee55a9d45499671cdfd53735a42"
format_stamp: "Formatted at 2026-08-11 18:49:30 on dist-test-slave-lgr5"
server_key: "4fcf60e486ee9ce7325ef86dbd606fab"
server_key_iv: "3247ae51895b0f249d7d02b0eee9dbf4"
server_key_version: "kuduclusterkey@0"
I20260811 18:49:30.656392 13442 fs_manager.cc:691] Time spent creating directory manager: real 0.011s user 0.009s sys 0.002s
I20260811 18:49:30.679113 13470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:49:30.681169 13442 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260811 18:49:30.681629 13442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "5f602ee55a9d45499671cdfd53735a42"
format_stamp: "Formatted at 2026-08-11 18:49:30 on dist-test-slave-lgr5"
server_key: "4fcf60e486ee9ce7325ef86dbd606fab"
server_key_iv: "3247ae51895b0f249d7d02b0eee9dbf4"
server_key_version: "kuduclusterkey@0"
I20260811 18:49:30.682053 13442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:49:30.703756 13442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:49:30.711743 13442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:49:30.712450 13442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:49:30.752588 13442 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:41909
I20260811 18:49:30.752707 13563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:41909 every 8 connection(s)
I20260811 18:49:30.754570 13442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:49:30.760577 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 13442
I20260811 18:49:30.760859 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:49:30.761197 13565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:49:30.762018 25700 external_mini_cluster.cc:1428] Setting key 65e54aceacc4b6cd1874d247974a4581
Aug 11 18:49:30 dist-test-slave-lgr5 krb5kdc[12721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:49:30.787259 13565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f602ee55a9d45499671cdfd53735a42: Bootstrap starting.
I20260811 18:49:30.793637 13565 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f602ee55a9d45499671cdfd53735a42: Neither blocks nor log segments found. Creating new log.
I20260811 18:49:30.795640 13565 log.cc:824] T 00000000000000000000000000000000 P 5f602ee55a9d45499671cdfd53735a42: Log is configured to *not* fsync() on all Append() calls
I20260811 18:49:30.799583 13565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f602ee55a9d45499671cdfd53735a42: No bootstrap required, opened a new log
I20260811 18:49:30.800356 13570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:49:30.764866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45304 (local address 127.25.25.62:41909)
0811 18:49:30.766686 (+ 1820us) server_negotiation.cc:206] Beginning negotiation
0811 18:49:30.766702 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 18:49:30.766758 (+ 56us) server_negotiation.cc:407] Connection header received
0811 18:49:30.773227 (+ 6469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:49:30.773272 (+ 45us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:49:30.773858 (+ 586us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:49:30.774381 (+ 523us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:49:30.776649 (+ 2268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:30.779547 (+ 2898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:30.781461 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:30.782933 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:30.783191 (+ 258us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:49:30.787824 (+ 4633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:49:30.787837 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:49:30.787856 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:49:30.787921 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:49:30.793846 (+ 5925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:49:30.795043 (+ 1197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:49:30.795053 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:49:30.795062 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:49:30.795265 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:49:30.796050 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:49:30.796056 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:49:30.796059 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:49:30.797048 (+ 989us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:49:30.797460 (+ 412us) server_negotiation.cc:1035] Waiting for connection context
0811 18:49:30.798177 (+ 717us) server_negotiation.cc:299] Negotiation successful
0811 18:49:30.798980 (+ 803us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1520,"thread_start_us":1039,"threads_started":1}
I20260811 18:49:30.816807 13565 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f602ee55a9d45499671cdfd53735a42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f602ee55a9d45499671cdfd53735a42" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41909 } }
I20260811 18:49:30.817306 13565 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5f602ee55a9d45499671cdfd53735a42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:49:30.817417 13565 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f602ee55a9d45499671cdfd53735a42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f602ee55a9d45499671cdfd53735a42, State: Initialized, Role: FOLLOWER
I20260811 18:49:30.818152 13565 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f602ee55a9d45499671cdfd53735a42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f602ee55a9d45499671cdfd53735a42" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41909 } }
I20260811 18:49:30.818542 13565 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f602ee55a9d45499671cdfd53735a42 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:49:30.818810 13565 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f602ee55a9d45499671cdfd53735a42 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:49:30.819018 13565 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f602ee55a9d45499671cdfd53735a42 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:49:30.823778 13565 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f602ee55a9d45499671cdfd53735a42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f602ee55a9d45499671cdfd53735a42" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41909 } }
I20260811 18:49:30.824679 13565 leader_election.cc:302] T 00000000000000000000000000000000 P 5f602ee55a9d45499671cdfd53735a42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f602ee55a9d45499671cdfd53735a42; no voters:
I20260811 18:49:30.828290 13572 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f602ee55a9d45499671cdfd53735a42 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:49:30.828804 13565 leader_election.cc:288] T 00000000000000000000000000000000 P 5f602ee55a9d45499671cdfd53735a42 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:49:30.829625 13572 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f602ee55a9d45499671cdfd53735a42 [term 1 LEADER]: Becoming Leader. State: Replica: 5f602ee55a9d45499671cdfd53735a42, State: Running, Role: LEADER
I20260811 18:49:30.830590 13572 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f602ee55a9d45499671cdfd53735a42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f602ee55a9d45499671cdfd53735a42" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41909 } }
I20260811 18:49:30.832739 13565 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f602ee55a9d45499671cdfd53735a42 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:49:30.834405 13573 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f602ee55a9d45499671cdfd53735a42 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f602ee55a9d45499671cdfd53735a42. Latest consensus state: current_term: 1 leader_uuid: "5f602ee55a9d45499671cdfd53735a42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f602ee55a9d45499671cdfd53735a42" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41909 } } }
I20260811 18:49:30.834896 13573 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f602ee55a9d45499671cdfd53735a42 [sys.catalog]: This master's current role is: LEADER
I20260811 18:49:30.836056 13576 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f602ee55a9d45499671cdfd53735a42 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f602ee55a9d45499671cdfd53735a42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f602ee55a9d45499671cdfd53735a42" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41909 } } }
I20260811 18:49:30.836692 13576 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f602ee55a9d45499671cdfd53735a42 [sys.catalog]: This master's current role is: LEADER
I20260811 18:49:30.839192 13581 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:49:30.851079 13581 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:49:30.853703 13565 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 18:49:30.878749 13581 catalog_manager.cc:1347] Generated new cluster ID: df0bf421b7554aa8ad82ebc6711e1a96
I20260811 18:49:30.879000 13581 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:49:30.901432 13581 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:49:30.903971 13581 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:49:30.913177 13581 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5f602ee55a9d45499671cdfd53735a42: Generated new TSK 0
I20260811 18:49:30.914451 13581 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.25.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
I20260811 18:49:31.877278 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.25.20:35885/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:0
--local_ip_for_outbound_sockets=127.25.25.1
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:41909
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:40997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:49:32 dist-test-slave-lgr5 krb5kdc[12721](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786474172, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 18:49:32.630173 13634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:49:32.630807 13634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:49:32.631093 13634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:49:32.646868 13634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:49:32.647137 13634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:49:32.647387 13634 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:49:32.662518 13634 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.25.25.20:35885/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:41909
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:49:32.664026 13634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:49:32.665910 13634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:49:32.699455 13654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:49:32.700750 13655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:49:32.701644 13660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:49:32.703787 13634 server_base.cc:1034] running on GCE node
I20260811 18:49:32.705006 13634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:49:32.707192 13634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:49:32.708712 13634 hybrid_clock.cc:648] HybridClock initialized: now 1786474172708503 us; error 133 us; skew 500 ppm
I20260811 18:49:32.709302 13634 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:49:32 dist-test-slave-lgr5 krb5kdc[12721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474172, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:49:32.716305 13634 init.cc:377] Logged in from keytab as kudu/127.25.25.1@KRBTEST.COM (short username kudu)
I20260811 18:49:32.730027 13634 webserver.cc:460] Webserver started at http://127.25.25.1:40555/ using document root <none> and password file <none>
I20260811 18:49:32.731720 13634 fs_manager.cc:359] Metadata directory not provided
I20260811 18:49:32.732044 13634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:49:32.732662 13634 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:49:32 dist-test-slave-lgr5 krb5kdc[12721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474172, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for HTTP/127.25.25.20@KRBTEST.COM
I20260811 18:49:32.772403 13634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-0/data/instance:
uuid: "8d05e55ddc3841da800aaebc2210f850"
format_stamp: "Formatted at 2026-08-11 18:49:32 on dist-test-slave-lgr5"
server_key: "cbe0f448e04934394b1348373d4dc940"
server_key_iv: "e543ecbae6074641b5d5e183199232e2"
server_key_version: "kuduclusterkey@0"
I20260811 18:49:32.774415 13634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance:
uuid: "8d05e55ddc3841da800aaebc2210f850"
format_stamp: "Formatted at 2026-08-11 18:49:32 on dist-test-slave-lgr5"
server_key: "cbe0f448e04934394b1348373d4dc940"
server_key_iv: "e543ecbae6074641b5d5e183199232e2"
server_key_version: "kuduclusterkey@0"
I20260811 18:49:32.787407 13634 fs_manager.cc:691] Time spent creating directory manager: real 0.012s user 0.003s sys 0.007s
I20260811 18:49:32.834601 13669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:49:32.836997 13634 fs_manager.cc:725] Time spent opening block manager: real 0.018s user 0.009s sys 0.004s
I20260811 18:49:32.837487 13634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "8d05e55ddc3841da800aaebc2210f850"
format_stamp: "Formatted at 2026-08-11 18:49:32 on dist-test-slave-lgr5"
server_key: "cbe0f448e04934394b1348373d4dc940"
server_key_iv: "e543ecbae6074641b5d5e183199232e2"
server_key_version: "kuduclusterkey@0"
I20260811 18:49:32.838008 13634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:49:32.891175 13634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:49:32.898617 13634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:49:32.899230 13634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:49:32.902101 13634 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
Aug 11 18:49:32 dist-test-slave-lgr5 krb5kdc[12721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474172, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for HTTP/127.25.25.20@KRBTEST.COM
I20260811 18:49:32.914937 13634 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:49:32.915163 13634 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:49:32.915417 13634 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:49:32.915727 13634 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260811 18:49:33.159579 13634 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:38215
I20260811 18:49:33.159701 13856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:38215 every 8 connection(s)
I20260811 18:49:33.161693 13634 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:49:33.171593 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 13634
I20260811 18:49:33.171903 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance
I20260811 18:49:33.173223 25700 external_mini_cluster.cc:1428] Setting key e1cade62ca631e136139621d1767e36a
Aug 11 18:49:33 dist-test-slave-lgr5 krb5kdc[12721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474172, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:49:33.223032 13864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:49:33.166371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:37497 (local address 127.25.25.62:41909)
0811 18:49:33.187128 (+ 20757us) server_negotiation.cc:206] Beginning negotiation
0811 18:49:33.187136 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:49:33.187170 (+ 34us) server_negotiation.cc:407] Connection header received
0811 18:49:33.188887 (+ 1717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:49:33.188893 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:49:33.188984 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:49:33.189098 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:49:33.195794 (+ 6696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:33.197224 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:33.201224 (+ 4000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:33.201965 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:33.202114 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:49:33.209021 (+ 6907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:49:33.209034 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:49:33.209039 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:49:33.209127 (+ 88us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:49:33.215207 (+ 6080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:49:33.216878 (+ 1671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:49:33.216884 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:49:33.216887 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:49:33.217126 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:49:33.217932 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:49:33.217937 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:49:33.217940 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:49:33.218526 (+ 586us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:49:33.218717 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0811 18:49:33.222173 (+ 3456us) server_negotiation.cc:299] Negotiation successful
0811 18:49:33.222464 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20539,"thread_start_us":20780,"threads_started":1}
I20260811 18:49:33.224313 13865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:49:33.167574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:41909 (local address 127.25.25.1:37497)
0811 18:49:33.182000 (+ 14426us) negotiation.cc:107] Waiting for socket to connect
0811 18:49:33.182093 (+ 93us) client_negotiation.cc:174] Beginning negotiation
0811 18:49:33.188217 (+ 6124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:49:33.192863 (+ 4646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:49:33.192883 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:49:33.193942 (+ 1059us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:49:33.195408 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:49:33.195456 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:49:33.197833 (+ 2377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:49:33.197840 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:49:33.200866 (+ 3026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:49:33.200931 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:49:33.202677 (+ 1746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:49:33.202690 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:49:33.203142 (+ 452us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:49:33.204253 (+ 1111us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:49:33.204293 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:49:33.208455 (+ 4162us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:49:33.215525 (+ 7070us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:49:33.215537 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:49:33.215560 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:49:33.216663 (+ 1103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:49:33.217296 (+ 633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:49:33.217302 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:49:33.217306 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:49:33.217772 (+ 466us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:49:33.218852 (+ 1080us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:49:33.218861 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:49:33.219343 (+ 482us) client_negotiation.cc:769] Sending connection context
0811 18:49:33.219788 (+ 445us) client_negotiation.cc:240] Negotiation successful
0811 18:49:33.220602 (+ 814us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13644,"thread_start_us":16381,"threads_started":1}
I20260811 18:49:33.226715 13857 heartbeater.cc:347] Connected to a master server at 127.25.25.62:41909
I20260811 18:49:33.227142 13857 heartbeater.cc:464] Registering TS with master...
I20260811 18:49:33.228533 13857 heartbeater.cc:511] Master 127.25.25.62:41909 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.25.25.2@KRBTEST.COM; defaulting to no policy
I20260811 18:49:33.232455 13502 ts_manager.cc:194] Registered new tserver with Master: 8d05e55ddc3841da800aaebc2210f850 (127.25.25.1:38215)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.2@KRBTEST.COM" created.
I20260811 18:49:33.235956 13502 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.1@KRBTEST.COM'} at 127.25.25.1:37497
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
I20260811 18:49:33.286497 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.25.20:35885/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:0
--local_ip_for_outbound_sockets=127.25.25.2
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:41909
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:40997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:49:33 dist-test-slave-lgr5 krb5kdc[12721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474172, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for HTTP/127.25.25.20@KRBTEST.COM
W20260811 18:49:34.088182 13869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:49:34.088706 13869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:49:34.088912 13869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:49:34.101414 13869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:49:34.101855 13869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:49:34.102185 13869 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:49:34.119244 13869 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.25.25.20:35885/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:41909
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:49:34.121136 13869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:49:34.122862 13869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:49:34.146448 13893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:49:34.146886 13894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:49:34.147085 13898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:49:34.150569 13869 server_base.cc:1034] running on GCE node
I20260811 18:49:34.152112 13869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:49:34.154737 13869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:49:34.156153 13869 hybrid_clock.cc:648] HybridClock initialized: now 1786474174155966 us; error 66 us; skew 500 ppm
I20260811 18:49:34.156739 13869 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:49:34 dist-test-slave-lgr5 krb5kdc[12721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474174, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:49:34.162552 13869 init.cc:377] Logged in from keytab as kudu/127.25.25.2@KRBTEST.COM (short username kudu)
I20260811 18:49:34.165460 13869 webserver.cc:460] Webserver started at http://127.25.25.2:41195/ using document root <none> and password file <none>
I20260811 18:49:34.166639 13869 fs_manager.cc:359] Metadata directory not provided
I20260811 18:49:34.166882 13869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:49:34.167364 13869 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:49:34 dist-test-slave-lgr5 krb5kdc[12721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474174, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for HTTP/127.25.25.20@KRBTEST.COM
I20260811 18:49:34.188797 13869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-1/data/instance:
uuid: "94bf051f2ff44c6a9695716424ee90e7"
format_stamp: "Formatted at 2026-08-11 18:49:34 on dist-test-slave-lgr5"
server_key: "fdbe1f8f380f749519c5178095a9eb2f"
server_key_iv: "2663e00c3ba322870794ce6ee3db6eb0"
server_key_version: "kuduclusterkey@0"
I20260811 18:49:34.190155 13869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance:
uuid: "94bf051f2ff44c6a9695716424ee90e7"
format_stamp: "Formatted at 2026-08-11 18:49:34 on dist-test-slave-lgr5"
server_key: "fdbe1f8f380f749519c5178095a9eb2f"
server_key_iv: "2663e00c3ba322870794ce6ee3db6eb0"
server_key_version: "kuduclusterkey@0"
I20260811 18:49:34.200132 13869 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.001s sys 0.009s
I20260811 18:49:34.224565 13910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:49:34.227420 13869 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.000s sys 0.003s
I20260811 18:49:34.227813 13869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "94bf051f2ff44c6a9695716424ee90e7"
format_stamp: "Formatted at 2026-08-11 18:49:34 on dist-test-slave-lgr5"
server_key: "fdbe1f8f380f749519c5178095a9eb2f"
server_key_iv: "2663e00c3ba322870794ce6ee3db6eb0"
server_key_version: "kuduclusterkey@0"
I20260811 18:49:34.228283 13869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:49:34.241900 13857 heartbeater.cc:503] Master 127.25.25.62:41909 was elected leader, sending a full tablet report...
I20260811 18:49:34.263481 13869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:49:34.272701 13869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:49:34.273396 13869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:49:34.275848 13869 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:49:34.279488 13869 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:49:34.279726 13869 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:49:34.280042 13869 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:49:34.280225 13869 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.002s sys 0.000s
I20260811 18:49:34.380115 13869 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:38437
I20260811 18:49:34.380201 14108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:38437 every 8 connection(s)
I20260811 18:49:34.382470 13869 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:49:34.386392 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 13869
I20260811 18:49:34.386612 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance
I20260811 18:49:34.387372 25700 external_mini_cluster.cc:1428] Setting key d79435a512255ebf33ef3daabf83c105
Aug 11 18:49:34 dist-test-slave-lgr5 krb5kdc[12721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474174, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:49:34.428257 14113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:49:34.387881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:36573 (local address 127.25.25.62:41909)
0811 18:49:34.399074 (+ 11193us) server_negotiation.cc:206] Beginning negotiation
0811 18:49:34.399082 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:49:34.404210 (+ 5128us) server_negotiation.cc:407] Connection header received
0811 18:49:34.405810 (+ 1600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:49:34.405817 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:49:34.405936 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:49:34.406077 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:49:34.409274 (+ 3197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:34.410578 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:34.413204 (+ 2626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:34.413868 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:34.414015 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:49:34.419368 (+ 5353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:49:34.419375 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:49:34.419379 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:49:34.419472 (+ 93us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:49:34.423583 (+ 4111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:49:34.424940 (+ 1357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:49:34.424945 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:49:34.424947 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:49:34.425203 (+ 256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:49:34.425856 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:49:34.425861 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:49:34.425863 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:49:34.426234 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:49:34.426385 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 18:49:34.427310 (+ 925us) server_negotiation.cc:299] Negotiation successful
0811 18:49:34.427577 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10933,"thread_start_us":11203,"threads_started":1}
I20260811 18:49:34.429486 14114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:49:34.388698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:41909 (local address 127.25.25.2:36573)
0811 18:49:34.401531 (+ 12833us) negotiation.cc:107] Waiting for socket to connect
0811 18:49:34.401662 (+ 131us) client_negotiation.cc:174] Beginning negotiation
0811 18:49:34.405359 (+ 3697us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:49:34.406506 (+ 1147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:49:34.406521 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:49:34.407688 (+ 1167us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:49:34.409013 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:49:34.409043 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:49:34.410855 (+ 1812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:49:34.410860 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:49:34.412983 (+ 2123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:49:34.413004 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:49:34.414272 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:49:34.414283 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:49:34.414678 (+ 395us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:49:34.415668 (+ 990us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:49:34.415696 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:49:34.419016 (+ 3320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:49:34.423940 (+ 4924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:49:34.423951 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:49:34.423969 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:49:34.424765 (+ 796us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:49:34.425351 (+ 586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:49:34.425355 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:49:34.425357 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:49:34.425705 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:49:34.426385 (+ 680us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:49:34.426395 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:49:34.426768 (+ 373us) client_negotiation.cc:769] Sending connection context
0811 18:49:34.427081 (+ 313us) client_negotiation.cc:240] Negotiation successful
0811 18:49:34.427797 (+ 716us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12350,"thread_start_us":11965,"threads_started":1}
WARNING: no policy specified for kudu/127.25.25.3@KRBTEST.COM; defaulting to no policy
I20260811 18:49:34.432156 14109 heartbeater.cc:347] Connected to a master server at 127.25.25.62:41909
I20260811 18:49:34.432848 14109 heartbeater.cc:464] Registering TS with master...
I20260811 18:49:34.434449 14109 heartbeater.cc:511] Master 127.25.25.62:41909 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.3@KRBTEST.COM" created.
I20260811 18:49:34.436928 13502 ts_manager.cc:194] Registered new tserver with Master: 94bf051f2ff44c6a9695716424ee90e7 (127.25.25.2:38437)
I20260811 18:49:34.438197 13502 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.2@KRBTEST.COM'} at 127.25.25.2:36573
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
I20260811 18:49:34.482102 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.25.20:35885/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:0
--local_ip_for_outbound_sockets=127.25.25.3
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:41909
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:40997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:49:35.121332 14119 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:49:35.121780 14119 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:49:35.122076 14119 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:49:35.133524 14119 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:49:35.133811 14119 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:49:35.134073 14119 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:49:35.149317 14119 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.25.25.20:35885/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:41909
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:49:35.150938 14119 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:49:35.152683 14119 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:49:35.173513 14126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:49:35.173900 14127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:49:35.174510 14132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:49:35.176363 14119 server_base.cc:1034] running on GCE node
I20260811 18:49:35.177266 14119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:49:35.178563 14119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:49:35.179872 14119 hybrid_clock.cc:648] HybridClock initialized: now 1786474175179759 us; error 43 us; skew 500 ppm
I20260811 18:49:35.180464 14119 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:49:35 dist-test-slave-lgr5 krb5kdc[12721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474175, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:49:35.185323 14119 init.cc:377] Logged in from keytab as kudu/127.25.25.3@KRBTEST.COM (short username kudu)
I20260811 18:49:35.187852 14119 webserver.cc:460] Webserver started at http://127.25.25.3:33931/ using document root <none> and password file <none>
I20260811 18:49:35.188902 14119 fs_manager.cc:359] Metadata directory not provided
I20260811 18:49:35.189159 14119 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:49:35.189615 14119 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:49:35 dist-test-slave-lgr5 krb5kdc[12721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474175, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for HTTP/127.25.25.20@KRBTEST.COM
I20260811 18:49:35.209803 14119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-2/data/instance:
uuid: "a711558ee3084947b8b3f95a4fe9a08a"
format_stamp: "Formatted at 2026-08-11 18:49:35 on dist-test-slave-lgr5"
server_key: "cabf325fe53983a343ec95d8df8c85cb"
server_key_iv: "f5233ce1f8b6b2f316e0d54d329f9f99"
server_key_version: "kuduclusterkey@0"
I20260811 18:49:35.211000 14119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance:
uuid: "a711558ee3084947b8b3f95a4fe9a08a"
format_stamp: "Formatted at 2026-08-11 18:49:35 on dist-test-slave-lgr5"
server_key: "cabf325fe53983a343ec95d8df8c85cb"
server_key_iv: "f5233ce1f8b6b2f316e0d54d329f9f99"
server_key_version: "kuduclusterkey@0"
I20260811 18:49:35.218036 14119 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.004s
I20260811 18:49:35.240278 14140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:49:35.242694 14119 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260811 18:49:35.243070 14119 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "a711558ee3084947b8b3f95a4fe9a08a"
format_stamp: "Formatted at 2026-08-11 18:49:35 on dist-test-slave-lgr5"
server_key: "cabf325fe53983a343ec95d8df8c85cb"
server_key_iv: "f5233ce1f8b6b2f316e0d54d329f9f99"
server_key_version: "kuduclusterkey@0"
I20260811 18:49:35.243520 14119 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:49:35.299526 14119 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:49:35.305912 14119 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:49:35.306447 14119 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:49:35.308194 14119 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:49:35.310487 14119 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:49:35.310622 14119 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:49:35.310842 14119 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:49:35.310946 14119 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:49:35.394551 14119 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:42247
I20260811 18:49:35.394659 14331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:42247 every 8 connection(s)
I20260811 18:49:35.396433 14119 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:49:35.401285 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 14119
I20260811 18:49:35.401571 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance
I20260811 18:49:35.402187 25700 external_mini_cluster.cc:1428] Setting key e0951875cf13a98969c6bff2f5a6afe1
Aug 11 18:49:35 dist-test-slave-lgr5 krb5kdc[12721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474175, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:49:35.430797 14336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:49:35.400399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:33381 (local address 127.25.25.62:41909)
0811 18:49:35.401374 (+ 975us) server_negotiation.cc:206] Beginning negotiation
0811 18:49:35.401379 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:49:35.403403 (+ 2024us) server_negotiation.cc:407] Connection header received
0811 18:49:35.407300 (+ 3897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:49:35.407312 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:49:35.407485 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:49:35.407611 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:49:35.410353 (+ 2742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.411667 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.414500 (+ 2833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.415291 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.415439 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:49:35.421299 (+ 5860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:49:35.421312 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:49:35.421316 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:49:35.421385 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:49:35.426190 (+ 4805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:49:35.427388 (+ 1198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:49:35.427394 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:49:35.427398 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:49:35.427605 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:49:35.428297 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:49:35.428303 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:49:35.428306 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:49:35.428718 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:49:35.428940 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0811 18:49:35.429957 (+ 1017us) server_negotiation.cc:299] Negotiation successful
0811 18:49:35.430267 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":857,"thread_start_us":739,"threads_started":1}
I20260811 18:49:35.432562 14337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:49:35.401460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:41909 (local address 127.25.25.3:33381)
0811 18:49:35.403200 (+ 1740us) negotiation.cc:107] Waiting for socket to connect
0811 18:49:35.403270 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0811 18:49:35.406873 (+ 3603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:49:35.408021 (+ 1148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:49:35.408032 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:49:35.408971 (+ 939us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:49:35.410058 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:49:35.410089 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.411944 (+ 1855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.411949 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:49:35.414120 (+ 2171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:49:35.414216 (+ 96us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.415707 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.415720 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:49:35.416188 (+ 468us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:49:35.417179 (+ 991us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:49:35.417208 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:49:35.420950 (+ 3742us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:49:35.426440 (+ 5490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:49:35.426451 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:49:35.426468 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:49:35.427178 (+ 710us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:49:35.427756 (+ 578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:49:35.427762 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:49:35.427766 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:49:35.428147 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:49:35.428935 (+ 788us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:49:35.428944 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:49:35.429400 (+ 456us) client_negotiation.cc:769] Sending connection context
0811 18:49:35.429855 (+ 455us) client_negotiation.cc:240] Negotiation successful
0811 18:49:35.430714 (+ 859us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1276,"thread_start_us":984,"threads_started":1}
I20260811 18:49:35.434594 14332 heartbeater.cc:347] Connected to a master server at 127.25.25.62:41909
I20260811 18:49:35.435009 14332 heartbeater.cc:464] Registering TS with master...
I20260811 18:49:35.436017 14332 heartbeater.cc:511] Master 127.25.25.62:41909 requested a full tablet report, sending...
I20260811 18:49:35.438222 13502 ts_manager.cc:194] Registered new tserver with Master: a711558ee3084947b8b3f95a4fe9a08a (127.25.25.3:42247)
I20260811 18:49:35.439301 13502 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.3@KRBTEST.COM'} at 127.25.25.3:33381
I20260811 18:49:35.442634 14109 heartbeater.cc:503] Master 127.25.25.62:41909 was elected leader, sending a full tablet report...
I20260811 18:49:35.446221 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:49:35.474303 14336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:49:35.453215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45312 (local address 127.25.25.62:41909)
0811 18:49:35.453542 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0811 18:49:35.453550 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:49:35.454491 (+ 941us) server_negotiation.cc:407] Connection header received
0811 18:49:35.454724 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:49:35.454729 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:49:35.454899 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:49:35.454992 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:49:35.457806 (+ 2814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.458901 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.461348 (+ 2447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.462216 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.462389 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:49:35.465874 (+ 3485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:49:35.465881 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:49:35.465885 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:49:35.465933 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:49:35.470265 (+ 4332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:49:35.471444 (+ 1179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:49:35.471449 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:49:35.471452 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:49:35.471729 (+ 277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:49:35.472362 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:49:35.472368 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:49:35.472372 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:49:35.472727 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:49:35.473020 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0811 18:49:35.473619 (+ 599us) server_negotiation.cc:299] Negotiation successful
0811 18:49:35.473878 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 18:49:35.480705 13502 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45312:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:49:35.494354 13502 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:49:35.536314 14357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:49:35.517882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45502 (local address 127.25.25.1:38215)
0811 18:49:35.521230 (+ 3348us) server_negotiation.cc:206] Beginning negotiation
0811 18:49:35.521238 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:49:35.521517 (+ 279us) server_negotiation.cc:407] Connection header received
0811 18:49:35.522623 (+ 1106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:49:35.522635 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:49:35.522938 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:49:35.523181 (+ 243us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:49:35.525042 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.527149 (+ 2107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.531323 (+ 4174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.533756 (+ 2433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.533910 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:49:35.534308 (+ 398us) server_negotiation.cc:1035] Waiting for connection context
0811 18:49:35.535344 (+ 1036us) server_negotiation.cc:299] Negotiation successful
0811 18:49:35.535629 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3151,"thread_start_us":2885,"threads_started":1}
I20260811 18:49:35.536568 14360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:49:35.521577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:38437 (local address 127.0.0.1:33344)
0811 18:49:35.523488 (+ 1911us) negotiation.cc:107] Waiting for socket to connect
0811 18:49:35.523510 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:49:35.523659 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:49:35.525241 (+ 1582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:49:35.525245 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:49:35.525270 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:49:35.526071 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:49:35.526083 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.528466 (+ 2383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.528471 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:49:35.532058 (+ 3587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:49:35.532112 (+ 54us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.535000 (+ 2888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.535008 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:49:35.535298 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:49:35.535330 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 18:49:35.535424 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 18:49:35.535553 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1747,"mutex_wait_us":1,"thread_start_us":715,"threads_started":1}
I20260811 18:49:35.537156 14356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:49:35.516953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53998 (local address 127.25.25.3:42247)
0811 18:49:35.518551 (+ 1598us) server_negotiation.cc:206] Beginning negotiation
0811 18:49:35.518562 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:49:35.520218 (+ 1656us) server_negotiation.cc:407] Connection header received
0811 18:49:35.521781 (+ 1563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:49:35.521792 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:49:35.522174 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:49:35.522444 (+ 270us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:49:35.524462 (+ 2018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.526773 (+ 2311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.531905 (+ 5132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.533722 (+ 1817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.535700 (+ 1978us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:49:35.536152 (+ 452us) server_negotiation.cc:1035] Waiting for connection context
0811 18:49:35.536256 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 18:49:35.536506 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1241,"thread_start_us":1205,"threads_started":1}
I20260811 18:49:35.537492 14358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:49:35.516325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:42247 (local address 127.0.0.1:53998)
0811 18:49:35.519983 (+ 3658us) negotiation.cc:107] Waiting for socket to connect
0811 18:49:35.520034 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 18:49:35.520685 (+ 651us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:49:35.522468 (+ 1783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:49:35.522477 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:49:35.522514 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:49:35.523577 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:49:35.523627 (+ 50us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.526962 (+ 3335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.526968 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:49:35.531618 (+ 4650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:49:35.531636 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.534062 (+ 2426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.534071 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:49:35.534498 (+ 427us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:49:35.534572 (+ 74us) client_negotiation.cc:769] Sending connection context
0811 18:49:35.534769 (+ 197us) client_negotiation.cc:240] Negotiation successful
0811 18:49:35.535022 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3246,"mutex_wait_us":108,"thread_start_us":4555,"threads_started":1}
I20260811 18:49:35.537787 14361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:49:35.522255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33344 (local address 127.25.25.2:38437)
0811 18:49:35.524614 (+ 2359us) server_negotiation.cc:206] Beginning negotiation
0811 18:49:35.524625 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:49:35.524663 (+ 38us) server_negotiation.cc:407] Connection header received
0811 18:49:35.524770 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:49:35.524777 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:49:35.525055 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:49:35.525231 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:49:35.526250 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.528276 (+ 2026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.532311 (+ 4035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.534569 (+ 2258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.536362 (+ 1793us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:49:35.536750 (+ 388us) server_negotiation.cc:1035] Waiting for connection context
0811 18:49:35.536842 (+ 92us) server_negotiation.cc:299] Negotiation successful
0811 18:49:35.537075 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2063,"thread_start_us":1765,"threads_started":1}
I20260811 18:49:35.538208 14355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:49:35.517729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:38215 (local address 127.0.0.1:45502)
0811 18:49:35.521381 (+ 3652us) negotiation.cc:107] Waiting for socket to connect
0811 18:49:35.521400 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:49:35.521584 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:49:35.523644 (+ 2060us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:49:35.523649 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:49:35.523675 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:49:35.524687 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:49:35.524704 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.527317 (+ 2613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.527323 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:49:35.531042 (+ 3719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:49:35.531069 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.534709 (+ 3640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.534718 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:49:35.535043 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:49:35.535079 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 18:49:35.535224 (+ 145us) client_negotiation.cc:240] Negotiation successful
0811 18:49:35.535388 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3463,"mutex_wait_us":87,"thread_start_us":1465,"threads_started":1}
I20260811 18:49:35.542907 14219 tablet_service.cc:1467] Processing CreateTablet for tablet a3871a6e0eda45ada61086b425338ba2 (DEFAULT_TABLE table=test-table [id=e10ab7d00e164af08692e93af0263487]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:49:35.542940 13991 tablet_service.cc:1467] Processing CreateTablet for tablet a3871a6e0eda45ada61086b425338ba2 (DEFAULT_TABLE table=test-table [id=e10ab7d00e164af08692e93af0263487]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:49:35.543900 13750 tablet_service.cc:1467] Processing CreateTablet for tablet a3871a6e0eda45ada61086b425338ba2 (DEFAULT_TABLE table=test-table [id=e10ab7d00e164af08692e93af0263487]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:49:35.545004 14219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3871a6e0eda45ada61086b425338ba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:49:35.545047 13991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3871a6e0eda45ada61086b425338ba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:49:35.546012 13750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3871a6e0eda45ada61086b425338ba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:49:35.566222 14362 tablet_bootstrap.cc:492] T a3871a6e0eda45ada61086b425338ba2 P a711558ee3084947b8b3f95a4fe9a08a: Bootstrap starting.
I20260811 18:49:35.569284 14363 tablet_bootstrap.cc:492] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7: Bootstrap starting.
I20260811 18:49:35.571177 14364 tablet_bootstrap.cc:492] T a3871a6e0eda45ada61086b425338ba2 P 8d05e55ddc3841da800aaebc2210f850: Bootstrap starting.
I20260811 18:49:35.576356 14364 tablet_bootstrap.cc:654] T a3871a6e0eda45ada61086b425338ba2 P 8d05e55ddc3841da800aaebc2210f850: Neither blocks nor log segments found. Creating new log.
I20260811 18:49:35.576531 14363 tablet_bootstrap.cc:654] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7: Neither blocks nor log segments found. Creating new log.
I20260811 18:49:35.576689 14362 tablet_bootstrap.cc:654] T a3871a6e0eda45ada61086b425338ba2 P a711558ee3084947b8b3f95a4fe9a08a: Neither blocks nor log segments found. Creating new log.
I20260811 18:49:35.578457 14362 log.cc:824] T a3871a6e0eda45ada61086b425338ba2 P a711558ee3084947b8b3f95a4fe9a08a: Log is configured to *not* fsync() on all Append() calls
I20260811 18:49:35.578456 14363 log.cc:824] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7: Log is configured to *not* fsync() on all Append() calls
I20260811 18:49:35.578693 14364 log.cc:824] T a3871a6e0eda45ada61086b425338ba2 P 8d05e55ddc3841da800aaebc2210f850: Log is configured to *not* fsync() on all Append() calls
I20260811 18:49:35.583215 14363 tablet_bootstrap.cc:492] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7: No bootstrap required, opened a new log
I20260811 18:49:35.583637 14362 tablet_bootstrap.cc:492] T a3871a6e0eda45ada61086b425338ba2 P a711558ee3084947b8b3f95a4fe9a08a: No bootstrap required, opened a new log
I20260811 18:49:35.583729 14363 ts_tablet_manager.cc:1397] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.007s
I20260811 18:49:35.584349 14362 ts_tablet_manager.cc:1397] T a3871a6e0eda45ada61086b425338ba2 P a711558ee3084947b8b3f95a4fe9a08a: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.006s
I20260811 18:49:35.586728 14364 tablet_bootstrap.cc:492] T a3871a6e0eda45ada61086b425338ba2 P 8d05e55ddc3841da800aaebc2210f850: No bootstrap required, opened a new log
I20260811 18:49:35.587234 14364 ts_tablet_manager.cc:1397] T a3871a6e0eda45ada61086b425338ba2 P 8d05e55ddc3841da800aaebc2210f850: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.008s
I20260811 18:49:35.593755 14362 raft_consensus.cc:348] T a3871a6e0eda45ada61086b425338ba2 P a711558ee3084947b8b3f95a4fe9a08a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a711558ee3084947b8b3f95a4fe9a08a" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 42247 } } peers { permanent_uuid: "94bf051f2ff44c6a9695716424ee90e7" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 38437 } } peers { permanent_uuid: "8d05e55ddc3841da800aaebc2210f850" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 38215 } }
I20260811 18:49:35.594274 14362 raft_consensus.cc:374] T a3871a6e0eda45ada61086b425338ba2 P a711558ee3084947b8b3f95a4fe9a08a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:49:35.594405 14362 raft_consensus.cc:729] T a3871a6e0eda45ada61086b425338ba2 P a711558ee3084947b8b3f95a4fe9a08a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a711558ee3084947b8b3f95a4fe9a08a, State: Initialized, Role: FOLLOWER
I20260811 18:49:35.595122 14362 consensus_queue.cc:260] T a3871a6e0eda45ada61086b425338ba2 P a711558ee3084947b8b3f95a4fe9a08a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a711558ee3084947b8b3f95a4fe9a08a" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 42247 } } peers { permanent_uuid: "94bf051f2ff44c6a9695716424ee90e7" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 38437 } } peers { permanent_uuid: "8d05e55ddc3841da800aaebc2210f850" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 38215 } }
I20260811 18:49:35.596470 14332 heartbeater.cc:503] Master 127.25.25.62:41909 was elected leader, sending a full tablet report...
I20260811 18:49:35.596226 14363 raft_consensus.cc:348] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a711558ee3084947b8b3f95a4fe9a08a" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 42247 } } peers { permanent_uuid: "94bf051f2ff44c6a9695716424ee90e7" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 38437 } } peers { permanent_uuid: "8d05e55ddc3841da800aaebc2210f850" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 38215 } }
I20260811 18:49:35.596762 14363 raft_consensus.cc:374] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:49:35.596863 14363 raft_consensus.cc:729] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94bf051f2ff44c6a9695716424ee90e7, State: Initialized, Role: FOLLOWER
I20260811 18:49:35.597690 14362 ts_tablet_manager.cc:1428] T a3871a6e0eda45ada61086b425338ba2 P a711558ee3084947b8b3f95a4fe9a08a: Time spent starting tablet: real 0.013s user 0.008s sys 0.005s
I20260811 18:49:35.597707 14363 consensus_queue.cc:260] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a711558ee3084947b8b3f95a4fe9a08a" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 42247 } } peers { permanent_uuid: "94bf051f2ff44c6a9695716424ee90e7" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 38437 } } peers { permanent_uuid: "8d05e55ddc3841da800aaebc2210f850" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 38215 } }
I20260811 18:49:35.599207 14364 raft_consensus.cc:348] T a3871a6e0eda45ada61086b425338ba2 P 8d05e55ddc3841da800aaebc2210f850 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a711558ee3084947b8b3f95a4fe9a08a" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 42247 } } peers { permanent_uuid: "94bf051f2ff44c6a9695716424ee90e7" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 38437 } } peers { permanent_uuid: "8d05e55ddc3841da800aaebc2210f850" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 38215 } }
I20260811 18:49:35.599859 14364 raft_consensus.cc:374] T a3871a6e0eda45ada61086b425338ba2 P 8d05e55ddc3841da800aaebc2210f850 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:49:35.600030 14364 raft_consensus.cc:729] T a3871a6e0eda45ada61086b425338ba2 P 8d05e55ddc3841da800aaebc2210f850 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d05e55ddc3841da800aaebc2210f850, State: Initialized, Role: FOLLOWER
I20260811 18:49:35.600299 14363 ts_tablet_manager.cc:1428] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7: Time spent starting tablet: real 0.016s user 0.018s sys 0.001s
I20260811 18:49:35.600896 14364 consensus_queue.cc:260] T a3871a6e0eda45ada61086b425338ba2 P 8d05e55ddc3841da800aaebc2210f850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a711558ee3084947b8b3f95a4fe9a08a" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 42247 } } peers { permanent_uuid: "94bf051f2ff44c6a9695716424ee90e7" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 38437 } } peers { permanent_uuid: "8d05e55ddc3841da800aaebc2210f850" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 38215 } }
I20260811 18:49:35.604681 14364 ts_tablet_manager.cc:1428] T a3871a6e0eda45ada61086b425338ba2 P 8d05e55ddc3841da800aaebc2210f850: Time spent starting tablet: real 0.017s user 0.017s sys 0.002s
W20260811 18:49:35.637135 14111 tablet.cc:2369] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:49:35.649559 14333 tablet.cc:2369] T a3871a6e0eda45ada61086b425338ba2 P a711558ee3084947b8b3f95a4fe9a08a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:49:35.688341 13859 tablet.cc:2369] T a3871a6e0eda45ada61086b425338ba2 P 8d05e55ddc3841da800aaebc2210f850: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:49:35.691741 14373 raft_consensus.cc:482] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:49:35.692363 14373 raft_consensus.cc:504] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a711558ee3084947b8b3f95a4fe9a08a" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 42247 } } peers { permanent_uuid: "94bf051f2ff44c6a9695716424ee90e7" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 38437 } } peers { permanent_uuid: "8d05e55ddc3841da800aaebc2210f850" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 38215 } }
I20260811 18:49:35.694729 14373 leader_election.cc:288] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a711558ee3084947b8b3f95a4fe9a08a (127.25.25.3:42247), 8d05e55ddc3841da800aaebc2210f850 (127.25.25.1:38215)
I20260811 18:49:35.704222 14356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:49:35.695334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:48071 (local address 127.25.25.3:42247)
0811 18:49:35.695624 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0811 18:49:35.695632 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:49:35.697990 (+ 2358us) server_negotiation.cc:407] Connection header received
0811 18:49:35.698176 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:49:35.698180 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:49:35.698244 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:49:35.698320 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:49:35.699335 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.700062 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.702261 (+ 2199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.703133 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.703266 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:49:35.703386 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 18:49:35.703746 (+ 360us) server_negotiation.cc:299] Negotiation successful
0811 18:49:35.703892 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 18:49:35.704347 14357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:49:35.695306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:60491 (local address 127.25.25.1:38215)
0811 18:49:35.695574 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0811 18:49:35.695581 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:49:35.697538 (+ 1957us) server_negotiation.cc:407] Connection header received
0811 18:49:35.697755 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:49:35.697759 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:49:35.697826 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:49:35.697939 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:49:35.698961 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.699902 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.702157 (+ 2255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.703167 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.703307 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:49:35.703421 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 18:49:35.703903 (+ 482us) server_negotiation.cc:299] Negotiation successful
0811 18:49:35.704060 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 18:49:35.704478 14377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:49:35.695286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:38215 (local address 127.25.25.2:60491)
0811 18:49:35.697399 (+ 2113us) negotiation.cc:107] Waiting for socket to connect
0811 18:49:35.697422 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:49:35.697604 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:49:35.697978 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:49:35.697983 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:49:35.698060 (+ 77us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:49:35.698798 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:49:35.698810 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.700035 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.700042 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:49:35.701959 (+ 1917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:49:35.701976 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.703525 (+ 1549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.703533 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:49:35.703706 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:49:35.703731 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 18:49:35.703828 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 18:49:35.703987 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1964,"spinlock_wait_cycles":54656,"thread_start_us":1093,"threads_started":1}
I20260811 18:49:35.704597 14378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:49:35.696145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:42247 (local address 127.25.25.2:48071)
0811 18:49:35.697872 (+ 1727us) negotiation.cc:107] Waiting for socket to connect
0811 18:49:35.697890 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:49:35.698035 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:49:35.698358 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:49:35.698362 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:49:35.698387 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:49:35.699156 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:49:35.699167 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.700241 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.700246 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:49:35.702089 (+ 1843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:49:35.702104 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.703391 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.703399 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:49:35.703565 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:49:35.703599 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 18:49:35.703695 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 18:49:35.703856 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1580,"mutex_wait_us":1,"thread_start_us":1306,"threads_started":1}
I20260811 18:49:35.705909 13784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3871a6e0eda45ada61086b425338ba2" candidate_uuid: "94bf051f2ff44c6a9695716424ee90e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d05e55ddc3841da800aaebc2210f850" is_pre_election: true
I20260811 18:49:35.705910 14259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3871a6e0eda45ada61086b425338ba2" candidate_uuid: "94bf051f2ff44c6a9695716424ee90e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a711558ee3084947b8b3f95a4fe9a08a" is_pre_election: true
I20260811 18:49:35.706707 14259 raft_consensus.cc:2454] T a3871a6e0eda45ada61086b425338ba2 P a711558ee3084947b8b3f95a4fe9a08a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94bf051f2ff44c6a9695716424ee90e7 in term 0.
I20260811 18:49:35.706661 13784 raft_consensus.cc:2454] T a3871a6e0eda45ada61086b425338ba2 P 8d05e55ddc3841da800aaebc2210f850 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94bf051f2ff44c6a9695716424ee90e7 in term 0.
I20260811 18:49:35.707621 13914 leader_election.cc:302] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94bf051f2ff44c6a9695716424ee90e7, a711558ee3084947b8b3f95a4fe9a08a; no voters:
I20260811 18:49:35.708192 14373 raft_consensus.cc:2781] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:49:35.708357 14373 raft_consensus.cc:482] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:49:35.708462 14373 raft_consensus.cc:3037] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:49:35.711068 14373 raft_consensus.cc:504] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a711558ee3084947b8b3f95a4fe9a08a" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 42247 } } peers { permanent_uuid: "94bf051f2ff44c6a9695716424ee90e7" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 38437 } } peers { permanent_uuid: "8d05e55ddc3841da800aaebc2210f850" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 38215 } }
I20260811 18:49:35.711836 14373 leader_election.cc:288] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7 [CANDIDATE]: Term 1 election: Requested vote from peers a711558ee3084947b8b3f95a4fe9a08a (127.25.25.3:42247), 8d05e55ddc3841da800aaebc2210f850 (127.25.25.1:38215)
I20260811 18:49:35.712750 13784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3871a6e0eda45ada61086b425338ba2" candidate_uuid: "94bf051f2ff44c6a9695716424ee90e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d05e55ddc3841da800aaebc2210f850"
I20260811 18:49:35.712733 14259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3871a6e0eda45ada61086b425338ba2" candidate_uuid: "94bf051f2ff44c6a9695716424ee90e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a711558ee3084947b8b3f95a4fe9a08a"
I20260811 18:49:35.713016 14259 raft_consensus.cc:3037] T a3871a6e0eda45ada61086b425338ba2 P a711558ee3084947b8b3f95a4fe9a08a [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:49:35.713047 13784 raft_consensus.cc:3037] T a3871a6e0eda45ada61086b425338ba2 P 8d05e55ddc3841da800aaebc2210f850 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:49:35.717037 14259 raft_consensus.cc:2454] T a3871a6e0eda45ada61086b425338ba2 P a711558ee3084947b8b3f95a4fe9a08a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94bf051f2ff44c6a9695716424ee90e7 in term 1.
I20260811 18:49:35.717406 13784 raft_consensus.cc:2454] T a3871a6e0eda45ada61086b425338ba2 P 8d05e55ddc3841da800aaebc2210f850 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94bf051f2ff44c6a9695716424ee90e7 in term 1.
I20260811 18:49:35.717810 13914 leader_election.cc:302] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94bf051f2ff44c6a9695716424ee90e7, a711558ee3084947b8b3f95a4fe9a08a; no voters:
I20260811 18:49:35.718318 14373 raft_consensus.cc:2781] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:49:35.719003 14373 raft_consensus.cc:686] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7 [term 1 LEADER]: Becoming Leader. State: Replica: 94bf051f2ff44c6a9695716424ee90e7, State: Running, Role: LEADER
I20260811 18:49:35.719695 14373 consensus_queue.cc:237] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a711558ee3084947b8b3f95a4fe9a08a" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 42247 } } peers { permanent_uuid: "94bf051f2ff44c6a9695716424ee90e7" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 38437 } } peers { permanent_uuid: "8d05e55ddc3841da800aaebc2210f850" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 38215 } }
I20260811 18:49:35.725665 13501 catalog_manager.cc:5495] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 94bf051f2ff44c6a9695716424ee90e7 (127.25.25.2). New cstate: current_term: 1 leader_uuid: "94bf051f2ff44c6a9695716424ee90e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a711558ee3084947b8b3f95a4fe9a08a" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 42247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94bf051f2ff44c6a9695716424ee90e7" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 38437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d05e55ddc3841da800aaebc2210f850" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 38215 } health_report { overall_health: UNKNOWN } } }
I20260811 18:49:35.780544 14361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:49:35.772363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33356 (local address 127.25.25.2:38437)
0811 18:49:35.772617 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 18:49:35.772622 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:49:35.772644 (+ 22us) server_negotiation.cc:407] Connection header received
0811 18:49:35.772767 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:49:35.772771 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:49:35.772992 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:49:35.773165 (+ 173us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:49:35.773758 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.774637 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.776764 (+ 2127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.777552 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.777724 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:49:35.778826 (+ 1102us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:49:35.779537 (+ 711us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:49:35.779689 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 18:49:35.779993 (+ 304us) server_negotiation.cc:299] Negotiation successful
0811 18:49:35.780143 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 18:49:35.791162 13784 raft_consensus.cc:1261] T a3871a6e0eda45ada61086b425338ba2 P 8d05e55ddc3841da800aaebc2210f850 [term 1 FOLLOWER]: Refusing update from remote peer 94bf051f2ff44c6a9695716424ee90e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:49:35.791162 14259 raft_consensus.cc:1261] T a3871a6e0eda45ada61086b425338ba2 P a711558ee3084947b8b3f95a4fe9a08a [term 1 FOLLOWER]: Refusing update from remote peer 94bf051f2ff44c6a9695716424ee90e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:49:35.792353 14379 consensus_queue.cc:1035] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d05e55ddc3841da800aaebc2210f850" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 38215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:49:35.792936 14373 consensus_queue.cc:1035] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a711558ee3084947b8b3f95a4fe9a08a" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 42247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:49:35.806061 14382 mvcc.cc:205] Tried to move back new op lower bound from 7317398224028549120 to 7317398223752474624. Current Snapshot: MvccSnapshot[applied={T|T < 7317398224028549120}]
I20260811 18:49:35.808982 14384 mvcc.cc:205] Tried to move back new op lower bound from 7317398224028549120 to 7317398223752474624. Current Snapshot: MvccSnapshot[applied={T|T < 7317398224028549120}]
I20260811 18:49:35.809563 14389 mvcc.cc:205] Tried to move back new op lower bound from 7317398224028549120 to 7317398223752474624. Current Snapshot: MvccSnapshot[applied={T|T < 7317398224028549120}]
I20260811 18:49:35.827172 13497 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45312:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:49:35.827522 13497 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45312:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:49:35.832351 13497 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5f602ee55a9d45499671cdfd53735a42: Sending DeleteTablet for 3 replicas of tablet a3871a6e0eda45ada61086b425338ba2
I20260811 18:49:35.833909 13991 tablet_service.cc:1514] Processing DeleteTablet for tablet a3871a6e0eda45ada61086b425338ba2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:49:35 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:33344
I20260811 18:49:35.833907 14219 tablet_service.cc:1514] Processing DeleteTablet for tablet a3871a6e0eda45ada61086b425338ba2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:49:35 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:53998
I20260811 18:49:35.833973 13750 tablet_service.cc:1514] Processing DeleteTablet for tablet a3871a6e0eda45ada61086b425338ba2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:49:35 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:45502
I20260811 18:49:35.836841 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 13634
I20260811 18:49:35.852665 14408 tablet_replica.cc:330] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7: stopping tablet replica
I20260811 18:49:35.852931 14406 tablet_replica.cc:330] T a3871a6e0eda45ada61086b425338ba2 P a711558ee3084947b8b3f95a4fe9a08a: stopping tablet replica
I20260811 18:49:35.853235 14407 tablet_replica.cc:330] T a3871a6e0eda45ada61086b425338ba2 P 8d05e55ddc3841da800aaebc2210f850: stopping tablet replica
I20260811 18:49:35.853446 14406 raft_consensus.cc:2229] T a3871a6e0eda45ada61086b425338ba2 P a711558ee3084947b8b3f95a4fe9a08a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:49:35.853513 14408 raft_consensus.cc:2229] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:49:35.853768 14407 raft_consensus.cc:2229] T a3871a6e0eda45ada61086b425338ba2 P 8d05e55ddc3841da800aaebc2210f850 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:49:35.854424 14408 raft_consensus.cc:2258] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:49:35.854703 14407 raft_consensus.cc:2258] T a3871a6e0eda45ada61086b425338ba2 P 8d05e55ddc3841da800aaebc2210f850 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:49:35.856261 14406 raft_consensus.cc:2258] T a3871a6e0eda45ada61086b425338ba2 P a711558ee3084947b8b3f95a4fe9a08a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:49:35.857293 14407 ts_tablet_manager.cc:1905] T a3871a6e0eda45ada61086b425338ba2 P 8d05e55ddc3841da800aaebc2210f850: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:49:35.857409 14408 ts_tablet_manager.cc:1905] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:49:35.858753 14406 ts_tablet_manager.cc:1905] T a3871a6e0eda45ada61086b425338ba2 P a711558ee3084947b8b3f95a4fe9a08a: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 11 18:49:35 dist-test-slave-lgr5 krb5kdc[12721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.1@KRBTEST.COM
I20260811 18:49:35.865605 14408 ts_tablet_manager.cc:1918] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:49:35.865655 14407 ts_tablet_manager.cc:1918] T a3871a6e0eda45ada61086b425338ba2 P 8d05e55ddc3841da800aaebc2210f850: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:49:35.865864 14407 log.cc:1196] T a3871a6e0eda45ada61086b425338ba2 P 8d05e55ddc3841da800aaebc2210f850: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-0/wal/wals/a3871a6e0eda45ada61086b425338ba2
I20260811 18:49:35.865967 14408 log.cc:1196] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-1/wal/wals/a3871a6e0eda45ada61086b425338ba2
I20260811 18:49:35.866613 14407 ts_tablet_manager.cc:1939] T a3871a6e0eda45ada61086b425338ba2 P 8d05e55ddc3841da800aaebc2210f850: Deleting consensus metadata
I20260811 18:49:35.866781 14408 ts_tablet_manager.cc:1939] T a3871a6e0eda45ada61086b425338ba2 P 94bf051f2ff44c6a9695716424ee90e7: Deleting consensus metadata
I20260811 18:49:35.868940 13476 catalog_manager.cc:4841] TS 8d05e55ddc3841da800aaebc2210f850 (127.25.25.1:38215): tablet a3871a6e0eda45ada61086b425338ba2 (table test-table [id=e10ab7d00e164af08692e93af0263487]) successfully deleted
I20260811 18:49:35.869371 13475 catalog_manager.cc:4841] TS 94bf051f2ff44c6a9695716424ee90e7 (127.25.25.2:38437): tablet a3871a6e0eda45ada61086b425338ba2 (table test-table [id=e10ab7d00e164af08692e93af0263487]) successfully deleted
I20260811 18:49:35.873765 14406 ts_tablet_manager.cc:1918] T a3871a6e0eda45ada61086b425338ba2 P a711558ee3084947b8b3f95a4fe9a08a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:49:35.874106 14406 log.cc:1196] T a3871a6e0eda45ada61086b425338ba2 P a711558ee3084947b8b3f95a4fe9a08a: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474012733352-25700-0/minicluster-data/ts-2/wal/wals/a3871a6e0eda45ada61086b425338ba2
I20260811 18:49:35.874745 14406 ts_tablet_manager.cc:1939] T a3871a6e0eda45ada61086b425338ba2 P a711558ee3084947b8b3f95a4fe9a08a: Deleting consensus metadata
I20260811 18:49:35.874872 14357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:49:35.838374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45510 (local address 127.25.25.1:38215)
0811 18:49:35.838598 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 18:49:35.838605 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:49:35.842520 (+ 3915us) server_negotiation.cc:407] Connection header received
0811 18:49:35.843540 (+ 1020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:49:35.843548 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:49:35.843688 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:49:35.843773 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:49:35.848638 (+ 4865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.850089 (+ 1451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.853727 (+ 3638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:35.854496 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:35.854612 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:49:35.866583 (+ 11971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:49:35.866607 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:49:35.866628 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:49:35.866683 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:49:35.870773 (+ 4090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:49:35.871950 (+ 1177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:49:35.871962 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:49:35.871965 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:49:35.872166 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:49:35.872678 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:49:35.872683 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:49:35.872687 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:49:35.873186 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:49:35.873513 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0811 18:49:35.873963 (+ 450us) server_negotiation.cc:299] Negotiation successful
0811 18:49:35.874391 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 18:49:35.875645 13851 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:49:35.876864 13475 catalog_manager.cc:4841] TS a711558ee3084947b8b3f95a4fe9a08a (127.25.25.3:42247): tablet a3871a6e0eda45ada61086b425338ba2 (table test-table [id=e10ab7d00e164af08692e93af0263487]) successfully deleted
I20260811 18:49:35.969159 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 13634
I20260811 18:49:36.007720 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 13869
Aug 11 18:49:36 dist-test-slave-lgr5 krb5kdc[12721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.2@KRBTEST.COM
I20260811 18:49:36.026572 14361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:49:36.008737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33364 (local address 127.25.25.2:38437)
0811 18:49:36.009004 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0811 18:49:36.009011 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:49:36.009043 (+ 32us) server_negotiation.cc:407] Connection header received
0811 18:49:36.009119 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:49:36.009124 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:49:36.009190 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:49:36.009276 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:49:36.010641 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:36.011505 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:36.012930 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:36.013414 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:36.013544 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:49:36.018887 (+ 5343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:49:36.018907 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:49:36.018929 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:49:36.018992 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:49:36.023207 (+ 4215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:49:36.024236 (+ 1029us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:49:36.024245 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:49:36.024248 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:49:36.024452 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:49:36.024904 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:49:36.024908 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:49:36.024910 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:49:36.025311 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:49:36.025624 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0811 18:49:36.025957 (+ 333us) server_negotiation.cc:299] Negotiation successful
0811 18:49:36.026219 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 18:49:36.027264 14100 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:49:36.146761 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 13869
I20260811 18:49:36.178768 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 14119
Aug 11 18:49:36 dist-test-slave-lgr5 krb5kdc[12721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.3@KRBTEST.COM
I20260811 18:49:36.198581 14356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:49:36.179878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54006 (local address 127.25.25.3:42247)
0811 18:49:36.180140 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0811 18:49:36.180146 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:49:36.180172 (+ 26us) server_negotiation.cc:407] Connection header received
0811 18:49:36.180321 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:49:36.180326 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:49:36.180400 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:49:36.180493 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:49:36.181928 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:36.182987 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:36.184597 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:49:36.185029 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:49:36.185159 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:49:36.190962 (+ 5803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:49:36.190987 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:49:36.191009 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:49:36.191061 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:49:36.194482 (+ 3421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:49:36.195687 (+ 1205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:49:36.195699 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:49:36.195702 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:49:36.195947 (+ 245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:49:36.196692 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:49:36.196697 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:49:36.196699 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:49:36.197201 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:49:36.197501 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0811 18:49:36.197980 (+ 479us) server_negotiation.cc:299] Negotiation successful
0811 18:49:36.198217 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 18:49:36.199452 14326 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:49:36.294240 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 14119
I20260811 18:49:36.319880 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 13442
I20260811 18:49:36.321581 13558 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:49:36.441598 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 13442
I20260811 18:49:36.483469 25700 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 18:49:36.831048 25700 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 18:49:36.831388 25700 mini_ranger.cc:66] Stopping Ranger...
I20260811 18:49:37.188269 25700 mini_ranger.cc:68] Stopped Ranger
2026-08-11 18:49:37.188 UTC [12767] LOG: received smart shutdown request
2026-08-11 18:49:37.193 UTC [12767] LOG: background worker "logical replication launcher" (PID 12783) exited with exit code 1
2026-08-11 18:49:37.193 UTC [12774] LOG: shutting down
2026-08-11 18:49:37.409 UTC [12767] LOG: database system is shut down
2026-08-11T18:49:37Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (59546 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:49:37 dist-test-slave-lgr5 krb5kdc[14432](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:49:37 dist-test-slave-lgr5 krb5kdc[14432](info): set up 2 sockets
Aug 11 18:49:37 dist-test-slave-lgr5 krb5kdc[14432](info): commencing operation
krb5kdc: starting...
W20260811 18:49:38.830399 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.268s user 0.000s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:49:39 dist-test-slave-lgr5 krb5kdc[14432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474179, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:49:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:49:39Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.25.25.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.25.25.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.25.25.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/rangeradmin_127.25.25.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.25.25.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/rangeradmin_127.25.25.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.25.25.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.25.25.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.25.25.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/rangerlookup_127.25.25.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.25.25.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/rangerlookup_127.25.25.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.25.25.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.25.25.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.25.25.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/HTTP_127.25.25.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.25.25.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/HTTP_127.25.25.20@KRBTEST.COM.keytab.
I20260811 18:49:39.276126 25700 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskse5jrw/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/postgres -l logfile start
2026-08-11 18:49:42.197 UTC [14490] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 18:49:42.197 UTC [14490] LOG: listening on IPv4 address "127.25.25.20", port 42711
2026-08-11 18:49:42.201 UTC [14490] LOG: listening on Unix socket "/tmp/.s.PGSQL.42711"
2026-08-11 18:49:42.226 UTC [14492] LOG: database system was shut down at 2026-08-11 18:49:40 UTC
2026-08-11 18:49:42.231 UTC [14490] LOG: database system is ready to accept connections
I20260811 18:49:43.384235 25700 mini_postgres.cc:96] Postgres bound to 42711
2026-08-11 18:49:43.408 UTC [14504] FATAL: database "slave" does not exist
127.25.25.20:42711 - accepting connections
I20260811 18:49:43.409596 25700 mini_ranger.cc:161] Starting Ranger...
I20260811 18:49:43.442953 25700 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 18:49:44.026417 25700 mini_ranger.cc:87] Created ranger Postgres database
I20260811 18:49:44.026587 25700 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ranger-admin
2026-08-11 18:49:44,370 [I] DB FLAVOR :POSTGRES
2026-08-11 18:49:44,370 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 18:49:44,370 [I] Checking connection..
2026-08-11 18:49:44,371 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:42711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 18:49:44,660 [I] Checking connection passed.
2026-08-11 18:49:44,660 [I] --------- Verifying version history table ---------
2026-08-11 18:49:44,660 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:42711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 18:49:44,962 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 18:49:44,962 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:42711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 18:49:45,276 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 18:49:45,276 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 18:49:45,276 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:42711/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 18:49:45.531 UTC [14613] WARNING: there is no transaction in progress
2026-08-11 18:49:45,542 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 18:49:45,542 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:42711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 18:49:45,831 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 18:49:45,832 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 18:49:45,832 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:42711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 18:49:46,109 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:42711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 18:49:46,394 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:42711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-lgr5.c.gcp-upstream.internal','N') ;"
2026-08-11 18:49:46,660 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:42711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 18:49:46,945 [I] Table x_portal_user does not exist in database ranger
2026-08-11 18:49:46,945 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:42711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 18:49:47,216 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 18:49:47,217 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:42711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 18:49:47,491 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:42711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 18:49:47,755 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 18:49:47,755 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:42711/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 18:49:48.926 UTC [14803] WARNING: there is no transaction in progress
2026-08-11 18:49:48.947 UTC [14803] WARNING: there is no transaction in progress
2026-08-11 18:49:48.969 UTC [14803] WARNING: there is no transaction in progress
2026-08-11 18:49:48.989 UTC [14803] WARNING: there is no transaction in progress
2026-08-11 18:49:49.008 UTC [14803] WARNING: there is no transaction in progress
2026-08-11 18:49:49.031 UTC [14803] WARNING: there is no transaction in progress
2026-08-11 18:49:49.106 UTC [14803] WARNING: there is no transaction in progress
2026-08-11 18:49:49.115 UTC [14803] WARNING: there is no transaction in progress
2026-08-11 18:49:49.136 UTC [14803] WARNING: there is no transaction in progress
2026-08-11 18:49:49.147 UTC [14803] WARNING: there is no transaction in progress
2026-08-11 18:49:49.160 UTC [14803] WARNING: there is no transaction in progress
2026-08-11 18:49:49.177 UTC [14803] WARNING: there is no transaction in progress
2026-08-11 18:49:49.189 UTC [14803] WARNING: there is no transaction in progress
2026-08-11 18:49:49.197 UTC [14803] WARNING: there is no transaction in progress
2026-08-11 18:49:49.208 UTC [14803] WARNING: there is no transaction in progress
2026-08-11 18:49:49.218 UTC [14803] WARNING: there is no transaction in progress
2026-08-11 18:49:50,161 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 18:49:50,161 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:42711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 18:49:50,445 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 18:49:50,445 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:42711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 18:49:50,733 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 18:49:50,734 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:42711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 18:49:51,027 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 18:49:51,027 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:42711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 18:49:51,300 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:42711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 18:49:51,572 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:42711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-lgr5.c.gcp-upstream.internal';"
2026-08-11 18:49:51,832 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 18:49:51,832 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:42711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 18:49:52,124 [I] DB_PATCHES have already been applied
I20260811 18:49:52.131969 25700 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ranger-admin:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskse5jrw/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 18:49:52.132197 25700 mini_ranger.cc:193] Using host: 127.25.25.20
I20260811 18:49:52.155350 25700 mini_ranger.cc:227] Ranger admin URL: http://127.25.25.20:52171
Aug 11, 2026 6:49:52 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 6:49:52 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 6:49:52 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 6:49:52 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 6:49:52 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 6:49:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 6:49:53 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 18:49:53.542681 25700 mini_ranger.cc:160] Time spent starting Ranger: real 10.133s user 0.004s sys 0.067s
Aug 11, 2026 6:50:17 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 6:50:17 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 6:50:17 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 6:50:17 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 6:50:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 6:50:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 6:50:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 6:50:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 6:50:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 6:50:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 6:50:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 6:50:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 6:50:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 6:50:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 6:50:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 6:50:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 6:50:17 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 6:50:18 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 18:50:19.573915 25700 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.25.25.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.25.25.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.25.25.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/rangerkms_127.25.25.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.25.25.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/rangerkms_127.25.25.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.25.25.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.25.25.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.25.25.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/HTTP_127.25.25.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.25.25.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/HTTP_127.25.25.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 18:50:19 dist-test-slave-lgr5 krb5kdc[14432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474219, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 18:50:19.798398 25700 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 18:50:19.828846 25700 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 18:50:20.973127 25700 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 18:50:20.973238 25700 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ranger-kms
I20260811 18:50:20.973289 25700 mini_ranger_kms.cc:227] Using postgres at 127.25.25.20:42711
2026-08-11 18:50:21,355 [I] DB FLAVOR :POSTGRES
2026-08-11 18:50:21,356 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 18:50:21,356 [I] Checking connection
2026-08-11 18:50:21,356 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:42711/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 18:50:21,621 [I] connection success
2026-08-11 18:50:21,621 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 18:50:21,622 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 18:50:21,622 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:42711/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 18:50:21,884 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 18:50:21,885 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 18:50:21,885 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 18:50:21,885 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.25.20:42711/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 18:50:22,200 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 18:50:22.736505 25700 mini_ranger_kms.cc:310] Created kms service
I20260811 18:50:22.970755 25700 mini_ranger_kms.cc:326] Created kudu user
I20260811 18:50:23.025843 25700 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 18:50:23 dist-test-slave-lgr5 krb5kdc[14432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474219, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.25.25.20@KRBTEST.COM
I20260811 18:50:23.558272 25700 mini_ranger_kms.cc:384] Added ranger policy
I20260811 18:50:23.558940 25700 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ranger-kms:/tmp/dist-test-taskse5jrw/build/asan/bin/postgresql.jar:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskse5jrw/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 18:50:23.559001 25700 mini_ranger_kms.cc:240] Using host: 127.25.25.20
I20260811 18:50:23.585060 25700 mini_ranger_kms.cc:276] Ranger KMS PID: 15124
I20260811 18:50:23.585214 25700 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.25.25.20:44057
Aug 11, 2026 6:50:24 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 6:50:24 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 6:50:24 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 6:50:24 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 6:50:25 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 6:50:25 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 18:50:25 dist-test-slave-lgr5 krb5kdc[14432](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786474225, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.25.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 11 18:50:26 dist-test-slave-lgr5 krb5kdc[14432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474225, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.25.20@KRBTEST.COM for HTTP/127.25.25.20@KRBTEST.COM
I20260811 18:50:26.355500 25700 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.557s user 0.079s sys 0.352s
I20260811 18:50:26.355758 25700 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 18:50:26.355928 25700 mini_ranger_kms.cc:401] 127.25.25.20:44057/kms/v1/keys
Aug 11 18:50:26 dist-test-slave-lgr5 krb5kdc[14432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474225, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.25.20@KRBTEST.COM for HTTP/127.25.25.20@KRBTEST.COM
Aug 11 18:50:29 dist-test-slave-lgr5 krb5kdc[14432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474229, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:50:29.365141 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:46531
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:40155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:46531
--ranger_config_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.25.20:44057/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:50:29.763103 15218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:50:29.763490 15218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:50:29.763641 15218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:50:29.771884 15218 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:50:29.772107 15218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:50:29.772202 15218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:50:29.772287 15218 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:50:29.772362 15218 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:50:29.783622 15218 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/wal
--ranger_kms_url=127.25.25.20:44057/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:46531
--ranger_config_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:46531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:50:29.785213 15218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:50:29.786824 15218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:50:29.802582 15229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:29.803212 15232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:29.803395 15227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:50:29.803896 15218 server_base.cc:1034] running on GCE node
I20260811 18:50:29.804879 15218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:50:29.806916 15218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:50:29.808244 15218 hybrid_clock.cc:648] HybridClock initialized: now 1786474229808191 us; error 59 us; skew 500 ppm
I20260811 18:50:29.808712 15218 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:50:29 dist-test-slave-lgr5 krb5kdc[14432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474229, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:50:29.813221 15218 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:50:29.815306 15218 webserver.cc:460] Webserver started at http://127.25.25.62:46765/ using document root <none> and password file <none>
I20260811 18:50:29.816143 15218 fs_manager.cc:359] Metadata directory not provided
I20260811 18:50:29.816298 15218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:50:29.816680 15218 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:50:29 dist-test-slave-lgr5 krb5kdc[14432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474229, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for HTTP/127.25.25.20@KRBTEST.COM
I20260811 18:50:29.874774 15218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "8712ec57105f4de5bbd800599c9b5237"
format_stamp: "Formatted at 2026-08-11 18:50:29 on dist-test-slave-lgr5"
server_key: "2fcd5cd7fc9fab9b74acb8f4c1516e57"
server_key_iv: "50a5a052f0d87da1625c34bb577d3683"
server_key_version: "kuduclusterkey@0"
I20260811 18:50:29.875841 15218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "8712ec57105f4de5bbd800599c9b5237"
format_stamp: "Formatted at 2026-08-11 18:50:29 on dist-test-slave-lgr5"
server_key: "2fcd5cd7fc9fab9b74acb8f4c1516e57"
server_key_iv: "50a5a052f0d87da1625c34bb577d3683"
server_key_version: "kuduclusterkey@0"
I20260811 18:50:29.882390 15218 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 18:50:29.901261 15242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:29.902995 15218 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 18:50:29.903199 15218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "8712ec57105f4de5bbd800599c9b5237"
format_stamp: "Formatted at 2026-08-11 18:50:29 on dist-test-slave-lgr5"
server_key: "2fcd5cd7fc9fab9b74acb8f4c1516e57"
server_key_iv: "50a5a052f0d87da1625c34bb577d3683"
server_key_version: "kuduclusterkey@0"
I20260811 18:50:29.903451 15218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:50:29.927211 15218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:50:29.931990 15218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:50:29.932358 15218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:50:29.952659 15218 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:46531
I20260811 18:50:29.952694 15327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:46531 every 8 connection(s)
I20260811 18:50:29.954377 15218 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:50:29.959034 15331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:50:29.961396 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 15218
I20260811 18:50:29.961638 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:50:29.962330 25700 external_mini_cluster.cc:1428] Setting key 05e776fdd6b581b15e8692deeb7b447d
I20260811 18:50:29.972615 15331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237: Bootstrap starting.
I20260811 18:50:29.977264 15331 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237: Neither blocks nor log segments found. Creating new log.
I20260811 18:50:29.978830 15331 log.cc:824] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237: Log is configured to *not* fsync() on all Append() calls
Aug 11 18:50:29 dist-test-slave-lgr5 krb5kdc[14432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474229, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:50:29.982542 15331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237: No bootstrap required, opened a new log
I20260811 18:50:29.989704 15340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:29.964662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46752 (local address 127.25.25.62:46531)
0811 18:50:29.965559 (+ 897us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:29.965573 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:29.965621 (+ 48us) server_negotiation.cc:407] Connection header received
0811 18:50:29.967449 (+ 1828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:29.967480 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:29.967980 (+ 500us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:29.968481 (+ 501us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:29.970339 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:29.972407 (+ 2068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:29.974489 (+ 2082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:29.976165 (+ 1676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:29.976426 (+ 261us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:29.981727 (+ 5301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:29.981736 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:29.981754 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:29.981800 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:29.985005 (+ 3205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:29.985864 (+ 859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:29.985872 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:29.985880 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:29.986074 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:29.986520 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:29.986524 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:29.986526 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:29.987164 (+ 638us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:29.987507 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:29.988016 (+ 509us) server_negotiation.cc:299] Negotiation successful
0811 18:50:29.988518 (+ 502us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":666,"thread_start_us":426,"threads_started":1}
I20260811 18:50:29.990887 15331 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8712ec57105f4de5bbd800599c9b5237" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46531 } }
I20260811 18:50:29.991321 15331 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:50:29.991438 15331 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8712ec57105f4de5bbd800599c9b5237, State: Initialized, Role: FOLLOWER
I20260811 18:50:29.992067 15331 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8712ec57105f4de5bbd800599c9b5237" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46531 } }
I20260811 18:50:29.992431 15331 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:50:29.992575 15331 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:50:29.992767 15331 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:50:29.995388 15331 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8712ec57105f4de5bbd800599c9b5237" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46531 } }
I20260811 18:50:29.996145 15331 leader_election.cc:302] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8712ec57105f4de5bbd800599c9b5237; no voters:
I20260811 18:50:29.996904 15331 leader_election.cc:288] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:50:29.997031 15342 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:50:29.997738 15342 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [term 1 LEADER]: Becoming Leader. State: Replica: 8712ec57105f4de5bbd800599c9b5237, State: Running, Role: LEADER
I20260811 18:50:29.998373 15342 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8712ec57105f4de5bbd800599c9b5237" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46531 } }
I20260811 18:50:29.999471 15331 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:50:30.001704 15345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8712ec57105f4de5bbd800599c9b5237. Latest consensus state: current_term: 1 leader_uuid: "8712ec57105f4de5bbd800599c9b5237" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8712ec57105f4de5bbd800599c9b5237" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46531 } } }
I20260811 18:50:30.001765 15343 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8712ec57105f4de5bbd800599c9b5237" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8712ec57105f4de5bbd800599c9b5237" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46531 } } }
I20260811 18:50:30.002310 15343 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [sys.catalog]: This master's current role is: LEADER
I20260811 18:50:30.004288 15345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [sys.catalog]: This master's current role is: LEADER
I20260811 18:50:30.009382 15351 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:50:30.015568 15351 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:50:30.016502 15331 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 18:50:30.036515 15351 catalog_manager.cc:1347] Generated new cluster ID: 4562f8956e884a498faccdd1e108c41f
I20260811 18:50:30.036696 15351 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:50:30.058656 15351 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:50:30.060421 15351 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:50:30.068874 15351 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237: Generated new TSK 0
I20260811 18:50:30.069950 15351 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.25.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
I20260811 18:50:30.971302 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.25.20:44057/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:0
--local_ip_for_outbound_sockets=127.25.25.1
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:46531
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:40155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:50:31 dist-test-slave-lgr5 krb5kdc[14432](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786474231, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 18:50:31.445432 15399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:50:31.445951 15399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:50:31.446201 15399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:50:31.459381 15399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:50:31.459648 15399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:50:31.459905 15399 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:50:31.478880 15399 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.25.25.20:44057/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:46531
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:50:31.481782 15399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:50:31.484519 15399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:50:31.507567 15414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:31.507714 15412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:31.515565 15420 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:50:31.517634 15399 server_base.cc:1034] running on GCE node
I20260811 18:50:31.518762 15399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:50:31.525736 15399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:50:31.527443 15399 hybrid_clock.cc:648] HybridClock initialized: now 1786474231527296 us; error 150 us; skew 500 ppm
I20260811 18:50:31.527979 15399 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:50:31 dist-test-slave-lgr5 krb5kdc[14432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474231, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:50:31.536206 15399 init.cc:377] Logged in from keytab as kudu/127.25.25.1@KRBTEST.COM (short username kudu)
I20260811 18:50:31.541152 15399 webserver.cc:460] Webserver started at http://127.25.25.1:40097/ using document root <none> and password file <none>
I20260811 18:50:31.542474 15399 fs_manager.cc:359] Metadata directory not provided
I20260811 18:50:31.542743 15399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:50:31.548619 15399 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:50:31 dist-test-slave-lgr5 krb5kdc[14432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474231, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for HTTP/127.25.25.20@KRBTEST.COM
I20260811 18:50:31.569998 15399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/data/instance:
uuid: "6f6181c0ff4d45f69ca8d04f8216e26c"
format_stamp: "Formatted at 2026-08-11 18:50:31 on dist-test-slave-lgr5"
server_key: "e08cd24da7536883fc9413702a791383"
server_key_iv: "639390e3ab0e3e5db959d99311ea95d8"
server_key_version: "kuduclusterkey@0"
I20260811 18:50:31.571511 15399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance:
uuid: "6f6181c0ff4d45f69ca8d04f8216e26c"
format_stamp: "Formatted at 2026-08-11 18:50:31 on dist-test-slave-lgr5"
server_key: "e08cd24da7536883fc9413702a791383"
server_key_iv: "639390e3ab0e3e5db959d99311ea95d8"
server_key_version: "kuduclusterkey@0"
I20260811 18:50:31.588506 15399 fs_manager.cc:691] Time spent creating directory manager: real 0.016s user 0.013s sys 0.005s
I20260811 18:50:31.613651 15432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:31.616043 15399 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260811 18:50:31.616400 15399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "6f6181c0ff4d45f69ca8d04f8216e26c"
format_stamp: "Formatted at 2026-08-11 18:50:31 on dist-test-slave-lgr5"
server_key: "e08cd24da7536883fc9413702a791383"
server_key_iv: "639390e3ab0e3e5db959d99311ea95d8"
server_key_version: "kuduclusterkey@0"
I20260811 18:50:31.616792 15399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:50:31.674113 15399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:50:31.683776 15399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:50:31.684338 15399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:50:31.696662 15399 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:50:31.709481 15399 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:50:31.709630 15399 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:31.709795 15399 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:50:31.709870 15399 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:50:31 dist-test-slave-lgr5 krb5kdc[14432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474231, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for HTTP/127.25.25.20@KRBTEST.COM
I20260811 18:50:32.015745 15399 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:33115
I20260811 18:50:32.015769 15611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:33115 every 8 connection(s)
I20260811 18:50:32.017711 15399 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:50:32.021023 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 15399
I20260811 18:50:32.021271 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance
I20260811 18:50:32.022209 25700 external_mini_cluster.cc:1428] Setting key caa6f8678d7942a9d6be395a005339a9
Aug 11 18:50:32 dist-test-slave-lgr5 krb5kdc[14432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474231, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.25.2@KRBTEST.COM; defaulting to no policy
I20260811 18:50:32.066372 15627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:32.023283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:53479 (local address 127.25.25.62:46531)
0811 18:50:32.031170 (+ 7887us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:32.031178 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:32.033459 (+ 2281us) server_negotiation.cc:407] Connection header received
0811 18:50:32.036272 (+ 2813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:32.036279 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:32.036380 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:32.036500 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:32.038991 (+ 2491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:32.040062 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:32.042788 (+ 2726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:32.043452 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:32.043594 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:32.048603 (+ 5009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:32.048611 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:32.048616 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:32.048665 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:32.052327 (+ 3662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:32.053571 (+ 1244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:32.053578 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:32.053581 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:32.053762 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:32.054388 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:32.054394 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:32.054397 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:32.054813 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:32.054940 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:32.065634 (+ 10694us) server_negotiation.cc:299] Negotiation successful
0811 18:50:32.065945 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7743,"thread_start_us":7613,"threads_started":1}
I20260811 18:50:32.069890 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:32.021723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:46531 (local address 127.25.25.1:53479)
0811 18:50:32.032402 (+ 10679us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:32.032476 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:32.035500 (+ 3024us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:32.037058 (+ 1558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:32.037072 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:32.037792 (+ 720us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:50:32.038692 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:32.038722 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:32.040340 (+ 1618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:32.040346 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:32.042490 (+ 2144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:32.042528 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:32.044130 (+ 1602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:32.044146 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:32.044510 (+ 364us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:32.045348 (+ 838us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:50:32.045390 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:50:32.048202 (+ 2812us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:50:32.052571 (+ 4369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:32.052583 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:32.052607 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:32.053370 (+ 763us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:32.053903 (+ 533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:32.053908 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:32.053911 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:32.054235 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:32.064302 (+ 10067us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:50:32.064314 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:50:32.064981 (+ 667us) client_negotiation.cc:769] Sending connection context
0811 18:50:32.067068 (+ 2087us) client_negotiation.cc:240] Negotiation successful
0811 18:50:32.067817 (+ 749us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8741,"thread_start_us":9325,"threads_started":1}
I20260811 18:50:32.072763 15612 heartbeater.cc:347] Connected to a master server at 127.25.25.62:46531
I20260811 18:50:32.073174 15612 heartbeater.cc:464] Registering TS with master...
I20260811 18:50:32.074308 15612 heartbeater.cc:511] Master 127.25.25.62:46531 requested a full tablet report, sending...
I20260811 18:50:32.078485 15269 ts_manager.cc:194] Registered new tserver with Master: 6f6181c0ff4d45f69ca8d04f8216e26c (127.25.25.1:33115)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.2@KRBTEST.COM" created.
I20260811 18:50:32.081393 15269 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.1@KRBTEST.COM'} at 127.25.25.1:53479
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
W20260811 18:50:32.127808 25700 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.25.25.2: real 0.101s user 0.000s sys 0.028s
I20260811 18:50:32.128859 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.25.20:44057/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:0
--local_ip_for_outbound_sockets=127.25.25.2
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:46531
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:40155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:50:32 dist-test-slave-lgr5 krb5kdc[14432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474231, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for HTTP/127.25.25.20@KRBTEST.COM
W20260811 18:50:32.673349 15631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:50:32.673923 15631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:50:32.674069 15631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:50:32.682062 15631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:50:32.682260 15631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:50:32.682410 15631 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:50:32.693652 15631 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.25.25.20:44057/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:46531
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:50:32.695168 15631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:50:32.697043 15631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:50:32.713318 15661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:32.713454 15665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:32.713284 15657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:50:32.714551 15631 server_base.cc:1034] running on GCE node
I20260811 18:50:32.715297 15631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:50:32.716609 15631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:50:32.717859 15631 hybrid_clock.cc:648] HybridClock initialized: now 1786474232717803 us; error 58 us; skew 500 ppm
I20260811 18:50:32.718276 15631 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:50:32 dist-test-slave-lgr5 krb5kdc[14432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474232, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:50:32.722013 15631 init.cc:377] Logged in from keytab as kudu/127.25.25.2@KRBTEST.COM (short username kudu)
I20260811 18:50:32.723927 15631 webserver.cc:460] Webserver started at http://127.25.25.2:40673/ using document root <none> and password file <none>
I20260811 18:50:32.724807 15631 fs_manager.cc:359] Metadata directory not provided
I20260811 18:50:32.724944 15631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:50:32.725289 15631 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:50:32 dist-test-slave-lgr5 krb5kdc[14432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474232, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for HTTP/127.25.25.20@KRBTEST.COM
I20260811 18:50:32.743125 15631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/data/instance:
uuid: "2d4dac6c8b07464a8f4fa6246b82d86d"
format_stamp: "Formatted at 2026-08-11 18:50:32 on dist-test-slave-lgr5"
server_key: "0d8dd87b84e1d2786b54954cf806a1d8"
server_key_iv: "050ba472f0e9f123997438da3e7f314b"
server_key_version: "kuduclusterkey@0"
I20260811 18:50:32.744447 15631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance:
uuid: "2d4dac6c8b07464a8f4fa6246b82d86d"
format_stamp: "Formatted at 2026-08-11 18:50:32 on dist-test-slave-lgr5"
server_key: "0d8dd87b84e1d2786b54954cf806a1d8"
server_key_iv: "050ba472f0e9f123997438da3e7f314b"
server_key_version: "kuduclusterkey@0"
I20260811 18:50:32.752609 15631 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.007s sys 0.001s
I20260811 18:50:32.772344 15676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:32.774643 15631 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 18:50:32.774897 15631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "2d4dac6c8b07464a8f4fa6246b82d86d"
format_stamp: "Formatted at 2026-08-11 18:50:32 on dist-test-slave-lgr5"
server_key: "0d8dd87b84e1d2786b54954cf806a1d8"
server_key_iv: "050ba472f0e9f123997438da3e7f314b"
server_key_version: "kuduclusterkey@0"
I20260811 18:50:32.775225 15631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:50:32.800278 15631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:50:32.806272 15631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:50:32.806672 15631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:50:32.808036 15631 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:50:32.810184 15631 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:50:32.810298 15631 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:32.810433 15631 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:50:32.810501 15631 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:32.849819 15631 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:39353
I20260811 18:50:32.849895 15884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:39353 every 8 connection(s)
I20260811 18:50:32.851186 15631 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:50:32.856041 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 15631
I20260811 18:50:32.856237 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance
I20260811 18:50:32.856668 25700 external_mini_cluster.cc:1428] Setting key 27a7f251aecbf852417ebf66d22c8bf2
Aug 11 18:50:32 dist-test-slave-lgr5 krb5kdc[14432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474232, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:50:32.873364 15892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:32.853917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:55823 (local address 127.25.25.62:46531)
0811 18:50:32.854462 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:32.854467 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:32.855579 (+ 1112us) server_negotiation.cc:407] Connection header received
0811 18:50:32.857709 (+ 2130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:32.857715 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:32.857802 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:32.857899 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:32.859740 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:32.860570 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:32.862342 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:32.862770 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:32.862893 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:32.866703 (+ 3810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:32.866709 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:32.866712 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:32.866758 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:32.869569 (+ 2811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:32.870579 (+ 1010us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:32.870584 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:32.870586 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:32.870745 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:32.871275 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:32.871280 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:32.871282 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:32.871619 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:32.871774 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:32.872679 (+ 905us) server_negotiation.cc:299] Negotiation successful
0811 18:50:32.872962 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":255,"threads_started":1}
I20260811 18:50:32.874482 15895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:32.854522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:46531 (local address 127.25.25.2:55823)
0811 18:50:32.855360 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:32.855419 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:32.857374 (+ 1955us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:32.858205 (+ 831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:32.858226 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:32.858893 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:50:32.859548 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:32.859567 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:32.860742 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:32.860746 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:32.862170 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:32.862195 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:32.863038 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:32.863047 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:32.863304 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:32.864057 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:50:32.864106 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:50:32.866395 (+ 2289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:50:32.869811 (+ 3416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:32.869823 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:32.869840 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:32.870404 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:32.870894 (+ 490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:32.870897 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:32.870900 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:32.871135 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:32.871786 (+ 651us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:50:32.871796 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:50:32.872236 (+ 440us) client_negotiation.cc:769] Sending connection context
0811 18:50:32.872530 (+ 294us) client_negotiation.cc:240] Negotiation successful
0811 18:50:32.873155 (+ 625us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":386,"threads_started":1}
I20260811 18:50:32.876287 15885 heartbeater.cc:347] Connected to a master server at 127.25.25.62:46531
I20260811 18:50:32.876665 15885 heartbeater.cc:464] Registering TS with master...
I20260811 18:50:32.877506 15885 heartbeater.cc:511] Master 127.25.25.62:46531 requested a full tablet report, sending...
I20260811 18:50:32.879227 15269 ts_manager.cc:194] Registered new tserver with Master: 2d4dac6c8b07464a8f4fa6246b82d86d (127.25.25.2:39353)
I20260811 18:50:32.880383 15269 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.2@KRBTEST.COM'} at 127.25.25.2:55823
WARNING: no policy specified for kudu/127.25.25.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
I20260811 18:50:32.924976 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.25.20:44057/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:0
--local_ip_for_outbound_sockets=127.25.25.3
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:46531
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:40155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:50:33.086704 15612 heartbeater.cc:503] Master 127.25.25.62:46531 was elected leader, sending a full tablet report...
W20260811 18:50:33.316119 15903 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:50:33.316500 15903 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:50:33.316654 15903 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:50:33.324601 15903 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:50:33.324757 15903 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:50:33.324921 15903 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:50:33.335647 15903 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.25.25.20:44057/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:46531
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:50:33.337308 15903 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:50:33.338835 15903 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:50:33.355486 15912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:33.355552 15913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:33.355533 15920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:50:33.356665 15903 server_base.cc:1034] running on GCE node
I20260811 18:50:33.357471 15903 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:50:33.358757 15903 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:50:33.360051 15903 hybrid_clock.cc:648] HybridClock initialized: now 1786474233360018 us; error 116 us; skew 500 ppm
I20260811 18:50:33.360497 15903 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:50:33 dist-test-slave-lgr5 krb5kdc[14432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474233, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:50:33.364176 15903 init.cc:377] Logged in from keytab as kudu/127.25.25.3@KRBTEST.COM (short username kudu)
I20260811 18:50:33.366082 15903 webserver.cc:460] Webserver started at http://127.25.25.3:33509/ using document root <none> and password file <none>
I20260811 18:50:33.366900 15903 fs_manager.cc:359] Metadata directory not provided
I20260811 18:50:33.367046 15903 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:50:33.367439 15903 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:50:33 dist-test-slave-lgr5 krb5kdc[14432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474233, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for HTTP/127.25.25.20@KRBTEST.COM
I20260811 18:50:33.388208 15903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/data/instance:
uuid: "dba3ef7612ae47b28879b4b722fc710f"
format_stamp: "Formatted at 2026-08-11 18:50:33 on dist-test-slave-lgr5"
server_key: "6f17e13cdd72dd72b97d8e2e43200828"
server_key_iv: "55c5fc0bf83f3259be5ccbec28606aba"
server_key_version: "kuduclusterkey@0"
I20260811 18:50:33.389667 15903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance:
uuid: "dba3ef7612ae47b28879b4b722fc710f"
format_stamp: "Formatted at 2026-08-11 18:50:33 on dist-test-slave-lgr5"
server_key: "6f17e13cdd72dd72b97d8e2e43200828"
server_key_iv: "55c5fc0bf83f3259be5ccbec28606aba"
server_key_version: "kuduclusterkey@0"
I20260811 18:50:33.398789 15903 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.009s sys 0.000s
I20260811 18:50:33.420521 15930 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:33.422597 15903 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260811 18:50:33.422838 15903 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "dba3ef7612ae47b28879b4b722fc710f"
format_stamp: "Formatted at 2026-08-11 18:50:33 on dist-test-slave-lgr5"
server_key: "6f17e13cdd72dd72b97d8e2e43200828"
server_key_iv: "55c5fc0bf83f3259be5ccbec28606aba"
server_key_version: "kuduclusterkey@0"
I20260811 18:50:33.423172 15903 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:50:33.442576 15903 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:50:33.448629 15903 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:50:33.448979 15903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:50:33.450260 15903 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:50:33.451915 15903 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:50:33.452013 15903 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:33.452142 15903 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:50:33.452208 15903 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:33.489091 15903 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:43465
I20260811 18:50:33.489135 16127 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:43465 every 8 connection(s)
I20260811 18:50:33.490684 15903 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:50:33.499259 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 15903
I20260811 18:50:33.499476 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance
I20260811 18:50:33.500119 25700 external_mini_cluster.cc:1428] Setting key 453dcb16f758f7589357a404690a2202
Aug 11 18:50:33 dist-test-slave-lgr5 krb5kdc[14432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474233, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:50:33.516973 16131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:33.494189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:54387 (local address 127.25.25.62:46531)
0811 18:50:33.494755 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:33.494760 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:33.495975 (+ 1215us) server_negotiation.cc:407] Connection header received
0811 18:50:33.498023 (+ 2048us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:33.498029 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:33.498150 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:33.498259 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:33.500644 (+ 2385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:33.501790 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:33.504174 (+ 2384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:33.504741 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:33.504858 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:33.509697 (+ 4839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:33.509719 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:33.509726 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:33.509793 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:33.512973 (+ 3180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:33.513995 (+ 1022us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:33.514000 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:33.514003 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:33.514174 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:33.514769 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:33.514774 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:33.514776 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:33.515152 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:33.515390 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:33.516343 (+ 953us) server_negotiation.cc:299] Negotiation successful
0811 18:50:33.516623 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":306,"threads_started":1}
I20260811 18:50:33.518189 16134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:33.494806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:46531 (local address 127.25.25.3:54387)
0811 18:50:33.495768 (+ 962us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:33.495809 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:33.497652 (+ 1843us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:33.498584 (+ 932us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:33.498594 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:33.499239 (+ 645us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:50:33.500342 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:33.500379 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:33.502054 (+ 1675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:33.502058 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:33.503915 (+ 1857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:33.503940 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:33.505019 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:33.505025 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:33.505396 (+ 371us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:33.506228 (+ 832us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:50:33.506256 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:50:33.509091 (+ 2835us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:50:33.513208 (+ 4117us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:33.513221 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:33.513239 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:33.513815 (+ 576us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:33.514325 (+ 510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:33.514329 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:33.514332 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:33.514596 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:33.515311 (+ 715us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:50:33.515319 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:50:33.515830 (+ 511us) client_negotiation.cc:769] Sending connection context
0811 18:50:33.516210 (+ 380us) client_negotiation.cc:240] Negotiation successful
0811 18:50:33.516802 (+ 592us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":677,"thread_start_us":394,"threads_started":1}
I20260811 18:50:33.519932 16128 heartbeater.cc:347] Connected to a master server at 127.25.25.62:46531
I20260811 18:50:33.520651 16128 heartbeater.cc:464] Registering TS with master...
I20260811 18:50:33.521595 16128 heartbeater.cc:511] Master 127.25.25.62:46531 requested a full tablet report, sending...
I20260811 18:50:33.523854 15269 ts_manager.cc:194] Registered new tserver with Master: dba3ef7612ae47b28879b4b722fc710f (127.25.25.3:43465)
I20260811 18:50:33.524892 15269 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.3@KRBTEST.COM'} at 127.25.25.3:54387
I20260811 18:50:33.531665 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:50:33.533676 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 15399
Aug 11 18:50:33 dist-test-slave-lgr5 krb5kdc[14432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474229, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.1@KRBTEST.COM
I20260811 18:50:33.553995 16136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:33.534908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49200 (local address 127.25.25.1:33115)
0811 18:50:33.535602 (+ 694us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:33.535610 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:33.535641 (+ 31us) server_negotiation.cc:407] Connection header received
0811 18:50:33.535707 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:33.535713 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:33.535949 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:33.536134 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:33.538012 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:33.539125 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:33.540982 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:33.541651 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:33.541784 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:33.547443 (+ 5659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:33.547463 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:33.547485 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:33.547540 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:33.550682 (+ 3142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:33.551652 (+ 970us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:33.551661 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:33.551663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:33.551872 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:33.552429 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:33.552434 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:33.552436 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:33.552841 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:33.553124 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:33.553441 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 18:50:33.553685 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":522,"thread_start_us":319,"threads_started":1}
I20260811 18:50:33.555397 15602 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:50:33.642076 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 15399
I20260811 18:50:33.659942 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 15631
Aug 11 18:50:33 dist-test-slave-lgr5 krb5kdc[14432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474229, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.2@KRBTEST.COM
I20260811 18:50:33.683504 16141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:33.660974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41022 (local address 127.25.25.2:39353)
0811 18:50:33.661572 (+ 598us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:33.661579 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:33.661606 (+ 27us) server_negotiation.cc:407] Connection header received
0811 18:50:33.661673 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:33.661680 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:33.661941 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:33.662093 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:33.663511 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:33.664647 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:33.666129 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:33.666769 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:33.666899 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:33.676492 (+ 9593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:33.676512 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:33.676530 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:33.676595 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:33.679861 (+ 3266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:33.680871 (+ 1010us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:33.680881 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:33.680883 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:33.681067 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:33.681554 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:33.681558 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:33.681561 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:33.682058 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:33.682431 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:33.682777 (+ 346us) server_negotiation.cc:299] Negotiation successful
0811 18:50:33.683100 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":272,"threads_started":1}
I20260811 18:50:33.685117 15876 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:50:33.772447 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 15631
I20260811 18:50:33.804559 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 15903
Aug 11 18:50:33 dist-test-slave-lgr5 krb5kdc[14432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474229, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.3@KRBTEST.COM
I20260811 18:50:33.822427 16144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:33.805546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33598 (local address 127.25.25.3:43465)
0811 18:50:33.806178 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:33.806186 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:33.806217 (+ 31us) server_negotiation.cc:407] Connection header received
0811 18:50:33.806281 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:33.806288 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:33.806510 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:33.806664 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:33.807996 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:33.809215 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:33.810662 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:33.811261 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:33.811370 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:33.816127 (+ 4757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:33.816148 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:33.816169 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:33.816213 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:33.819214 (+ 3001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:33.820204 (+ 990us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:33.820212 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:33.820214 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:33.820426 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:33.820894 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:33.820900 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:33.820902 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:33.821312 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:33.821600 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:33.821890 (+ 290us) server_negotiation.cc:299] Negotiation successful
0811 18:50:33.822126 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":298,"threads_started":1}
I20260811 18:50:33.823936 16121 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:50:33.909683 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 15903
I20260811 18:50:33.941121 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 15218
I20260811 18:50:33.942785 15322 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:50:34.057940 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 15218
I20260811 18:50:34.095955 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:46531
--webserver_interface=127.25.25.62
--webserver_port=46765
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:40155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:46531
--ranger_config_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.25.20:44057/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.25.25.20:44057/kms with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:50:34.485358 16148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:50:34.485716 16148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:50:34.485841 16148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:50:34.494931 16148 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:50:34.495308 16148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:50:34.495412 16148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:50:34.495594 16148 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:50:34.495703 16148 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:50:34.507750 16148 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.25.25.20:44057/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:46531
--ranger_config_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:46531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=46765
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:50:34.509716 16148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:50:34.511497 16148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:50:34.526162 16158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:34.526212 16159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:34.526233 16162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:50:34.527200 16148 server_base.cc:1034] running on GCE node
I20260811 18:50:34.528307 16148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:50:34.530371 16148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:50:34.531644 16148 hybrid_clock.cc:648] HybridClock initialized: now 1786474234531521 us; error 113 us; skew 500 ppm
I20260811 18:50:34.532050 16148 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:50:34 dist-test-slave-lgr5 krb5kdc[14432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474234, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:50:34.535800 16148 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:50:34.537683 16148 webserver.cc:460] Webserver started at http://127.25.25.62:46765/ using document root <none> and password file <none>
I20260811 18:50:34.538425 16148 fs_manager.cc:359] Metadata directory not provided
I20260811 18:50:34.538561 16148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 18:50:34 dist-test-slave-lgr5 krb5kdc[14432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474234, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for HTTP/127.25.25.20@KRBTEST.COM
I20260811 18:50:34.590785 16148 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 18:50:34.594839 16173 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:34.596611 16148 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 18:50:34.596848 16148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "8712ec57105f4de5bbd800599c9b5237"
format_stamp: "Formatted at 2026-08-11 18:50:29 on dist-test-slave-lgr5"
server_key: "2fcd5cd7fc9fab9b74acb8f4c1516e57"
server_key_iv: "50a5a052f0d87da1625c34bb577d3683"
server_key_version: "kuduclusterkey@0"
I20260811 18:50:34.597941 16148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:50:34.622175 16148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:50:34.627029 16148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:50:34.627377 16148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:50:34.647825 16148 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:46531
I20260811 18:50:34.647861 16266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:46531 every 8 connection(s)
I20260811 18:50:34.649467 16148 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:50:34.650161 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 16148
I20260811 18:50:34.651178 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.25.20:44057/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:33115
--local_ip_for_outbound_sockets=127.25.25.1
--tserver_master_addrs=127.25.25.62:46531
--webserver_port=40097
--webserver_interface=127.25.25.1
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:40155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.25.25.20:44057/kms with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:50:34.657298 16268 sys_catalog.cc:263] Verifying existing consensus state
I20260811 18:50:34.661090 16268 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237: Bootstrap starting.
I20260811 18:50:34.683354 16268 log.cc:824] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237: Log is configured to *not* fsync() on all Append() calls
I20260811 18:50:34.694386 16268 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:50:34.695013 16268 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237: Bootstrap complete.
I20260811 18:50:34.705862 16268 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8712ec57105f4de5bbd800599c9b5237" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46531 } }
I20260811 18:50:34.706881 16268 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8712ec57105f4de5bbd800599c9b5237, State: Initialized, Role: FOLLOWER
I20260811 18:50:34.707633 16268 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8712ec57105f4de5bbd800599c9b5237" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46531 } }
I20260811 18:50:34.707894 16268 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:50:34.708029 16268 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:50:34.708237 16268 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [term 1 FOLLOWER]: Advancing to term 2
I20260811 18:50:34.712932 16268 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8712ec57105f4de5bbd800599c9b5237" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46531 } }
I20260811 18:50:34.713581 16268 leader_election.cc:302] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8712ec57105f4de5bbd800599c9b5237; no voters:
I20260811 18:50:34.714299 16268 leader_election.cc:288] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 18:50:34.714475 16273 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 18:50:34.715708 16273 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [term 2 LEADER]: Becoming Leader. State: Replica: 8712ec57105f4de5bbd800599c9b5237, State: Running, Role: LEADER
I20260811 18:50:34.716490 16273 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8712ec57105f4de5bbd800599c9b5237" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46531 } }
I20260811 18:50:34.716954 16268 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:50:34.719198 16278 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8712ec57105f4de5bbd800599c9b5237. Latest consensus state: current_term: 2 leader_uuid: "8712ec57105f4de5bbd800599c9b5237" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8712ec57105f4de5bbd800599c9b5237" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46531 } } }
I20260811 18:50:34.719642 16278 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [sys.catalog]: This master's current role is: LEADER
I20260811 18:50:34.719941 16276 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "8712ec57105f4de5bbd800599c9b5237" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8712ec57105f4de5bbd800599c9b5237" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 46531 } } }
I20260811 18:50:34.720335 16276 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237 [sys.catalog]: This master's current role is: LEADER
I20260811 18:50:34.727229 16283 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:50:34.735194 16283 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:50:34.737313 16283 catalog_manager.cc:1259] Loaded cluster ID: 4562f8956e884a498faccdd1e108c41f
I20260811 18:50:34.737560 16283 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:50:34.742816 16283 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:50:34.745218 16283 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237: Loaded TSK: 0
I20260811 18:50:34.747520 16283 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:50:34.750430 16268 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260811 18:50:35.196667 16270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:50:35.197217 16270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:50:35.197445 16270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:50:35.210214 16270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:50:35.210472 16270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:50:35.210705 16270 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:50:35.228947 16270 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.25.25.20:44057/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:33115
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=40097
--tserver_master_addrs=127.25.25.62:46531
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:50:35.231537 16270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:50:35.233822 16270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:50:35.267166 16326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:35.268198 16328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:35.280611 16332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:50:35.299252 16270 server_base.cc:1034] running on GCE node
I20260811 18:50:35.300303 16270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:50:35.308468 16270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:50:35.310041 16270 hybrid_clock.cc:648] HybridClock initialized: now 1786474235309960 us; error 107 us; skew 500 ppm
I20260811 18:50:35.310644 16270 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:50:35 dist-test-slave-lgr5 krb5kdc[14432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474235, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:50:35.315750 16270 init.cc:377] Logged in from keytab as kudu/127.25.25.1@KRBTEST.COM (short username kudu)
I20260811 18:50:35.337258 16270 webserver.cc:460] Webserver started at http://127.25.25.1:40097/ using document root <none> and password file <none>
I20260811 18:50:35.338549 16270 fs_manager.cc:359] Metadata directory not provided
I20260811 18:50:35.338869 16270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 18:50:35 dist-test-slave-lgr5 krb5kdc[14432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474235, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for HTTP/127.25.25.20@KRBTEST.COM
I20260811 18:50:35.375049 16270 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.005s sys 0.000s
I20260811 18:50:35.381341 16347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:35.383864 16270 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.003s sys 0.000s
I20260811 18:50:35.384200 16270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "6f6181c0ff4d45f69ca8d04f8216e26c"
format_stamp: "Formatted at 2026-08-11 18:50:31 on dist-test-slave-lgr5"
server_key: "e08cd24da7536883fc9413702a791383"
server_key_iv: "639390e3ab0e3e5db959d99311ea95d8"
server_key_version: "kuduclusterkey@0"
I20260811 18:50:35.385885 16270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:50:35.408627 16270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:50:35.414556 16270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:50:35.414921 16270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:50:35.416370 16270 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:50:35.418362 16270 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:50:35.418553 16270 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260811 18:50:35.418692 16270 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:50:35.418782 16270 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:35.482548 16270 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:33115
I20260811 18:50:35.482622 16544 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:33115 every 8 connection(s)
I20260811 18:50:35.484826 16270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:50:35.489132 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 16270
I20260811 18:50:35.490105 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.25.20:44057/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:39353
--local_ip_for_outbound_sockets=127.25.25.2
--tserver_master_addrs=127.25.25.62:46531
--webserver_port=40673
--webserver_interface=127.25.25.2
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:40155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.25.25.20:44057/kms with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:50:35 dist-test-slave-lgr5 krb5kdc[14432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474235, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:50:35.551222 16551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:35.489054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:46531 (local address 127.25.25.1:60783)
0811 18:50:35.501615 (+ 12561us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:35.501689 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:35.506001 (+ 4312us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:35.511609 (+ 5608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:35.511622 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:35.512578 (+ 956us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:50:35.513481 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:35.513515 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:35.516539 (+ 3024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:35.516547 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:35.520343 (+ 3796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:35.520369 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:35.522577 (+ 2208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:35.522587 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:35.523253 (+ 666us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:35.529113 (+ 5860us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:50:35.529161 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:50:35.532311 (+ 3150us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:50:35.538413 (+ 6102us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:35.538425 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:35.538444 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:35.539198 (+ 754us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:35.544284 (+ 5086us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:35.544291 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:35.544296 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:35.544682 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:35.548115 (+ 3433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:50:35.548128 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:50:35.548696 (+ 568us) client_negotiation.cc:769] Sending connection context
0811 18:50:35.549092 (+ 396us) client_negotiation.cc:240] Negotiation successful
0811 18:50:35.549754 (+ 662us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12140,"thread_start_us":28479,"threads_started":1}
I20260811 18:50:35.553946 16550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:35.489031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:60783 (local address 127.25.25.62:46531)
0811 18:50:35.508728 (+ 19697us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:35.508752 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:35.508813 (+ 61us) server_negotiation.cc:407] Connection header received
0811 18:50:35.509338 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:35.509363 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:35.509966 (+ 603us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:35.510460 (+ 494us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:35.513817 (+ 3357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:35.516019 (+ 2202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:35.520589 (+ 4570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:35.521815 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:35.522068 (+ 253us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:35.532776 (+ 10708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:35.532791 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:35.532816 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:35.532881 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:35.538088 (+ 5207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:35.539407 (+ 1319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:35.539418 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:35.539426 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:35.539663 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:35.544896 (+ 5233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:35.544903 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:35.544906 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:35.545760 (+ 854us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:35.546037 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:35.552098 (+ 6061us) server_negotiation.cc:299] Negotiation successful
0811 18:50:35.552628 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19355,"thread_start_us":21794,"threads_started":1}
I20260811 18:50:35.557864 16546 heartbeater.cc:347] Connected to a master server at 127.25.25.62:46531
I20260811 18:50:35.558243 16546 heartbeater.cc:464] Registering TS with master...
I20260811 18:50:35.559203 16546 heartbeater.cc:511] Master 127.25.25.62:46531 requested a full tablet report, sending...
W20260811 18:50:35.563004 16546 heartbeater.cc:644] Failed to heartbeat to 127.25.25.62:46531 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 18:50:35.563283 16546 heartbeater.cc:464] Registering TS with master...
I20260811 18:50:35.563619 16546 heartbeater.cc:511] Master 127.25.25.62:46531 requested a full tablet report, sending...
I20260811 18:50:35.565157 16546 heartbeater.cc:464] Registering TS with master...
I20260811 18:50:35.565490 16546 heartbeater.cc:511] Master 127.25.25.62:46531 requested a full tablet report, sending...
W20260811 18:50:35.566866 16546 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 18:50:35.939982 16552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:50:35.940354 16552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:50:35.940503 16552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:50:35.948689 16552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:50:35.948827 16552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:50:35.948993 16552 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:50:35.963785 16552 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.25.25.20:44057/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:39353
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=40673
--tserver_master_addrs=127.25.25.62:46531
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:50:35.965768 16552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:50:35.967744 16552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:50:36.010294 16584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:36.011091 16581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:36.019383 16589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:50:36.020509 16552 server_base.cc:1034] running on GCE node
I20260811 18:50:36.021782 16552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:50:36.023303 16552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:50:36.024605 16552 hybrid_clock.cc:648] HybridClock initialized: now 1786474236024531 us; error 63 us; skew 500 ppm
I20260811 18:50:36.025079 16552 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:50:36 dist-test-slave-lgr5 krb5kdc[14432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474236, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:50:36.034709 16552 init.cc:377] Logged in from keytab as kudu/127.25.25.2@KRBTEST.COM (short username kudu)
I20260811 18:50:36.037920 16552 webserver.cc:460] Webserver started at http://127.25.25.2:40673/ using document root <none> and password file <none>
I20260811 18:50:36.039109 16552 fs_manager.cc:359] Metadata directory not provided
I20260811 18:50:36.039304 16552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 18:50:36 dist-test-slave-lgr5 krb5kdc[14432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474236, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for HTTP/127.25.25.20@KRBTEST.COM
I20260811 18:50:36.081013 16552 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.005s sys 0.000s
Aug 11 18:50:36 dist-test-slave-lgr5 krb5kdc[14432](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786474236, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:50:36.085350 16600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:36.087570 16552 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 18:50:36.087893 16552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "2d4dac6c8b07464a8f4fa6246b82d86d"
format_stamp: "Formatted at 2026-08-11 18:50:32 on dist-test-slave-lgr5"
server_key: "0d8dd87b84e1d2786b54954cf806a1d8"
server_key_iv: "050ba472f0e9f123997438da3e7f314b"
server_key_version: "kuduclusterkey@0"
I20260811 18:50:36.089529 16552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:50:36.158126 16552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:50:36.163020 16552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:50:36.163333 16552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:50:36.164463 16552 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:50:36.166024 16552 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:50:36.166127 16552 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:36.166240 16552 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:50:36.166311 16552 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:36.223295 16552 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:39353
I20260811 18:50:36.223344 16795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:39353 every 8 connection(s)
I20260811 18:50:36.225003 16552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:50:36.232977 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 16552
I20260811 18:50:36.233713 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.25.20:44057/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:43465
--local_ip_for_outbound_sockets=127.25.25.3
--tserver_master_addrs=127.25.25.62:46531
--webserver_port=33509
--webserver_interface=127.25.25.3
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:40155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.25.25.20:44057/kms with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:50:36 dist-test-slave-lgr5 krb5kdc[14432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474236, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:50:36.282223 16799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:36.230128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:49445 (local address 127.25.25.62:46531)
0811 18:50:36.259290 (+ 29162us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:36.259298 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:36.259326 (+ 28us) server_negotiation.cc:407] Connection header received
0811 18:50:36.259405 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:36.259411 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:36.259522 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:36.259677 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:36.262600 (+ 2923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:36.263831 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:36.266595 (+ 2764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:36.267318 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:36.267459 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:36.274576 (+ 7117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:36.274586 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:36.274592 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:36.274647 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:36.277889 (+ 3242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:36.279008 (+ 1119us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:36.279015 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:36.279019 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:36.279190 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:36.279825 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:36.279830 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:36.279833 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:36.280271 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:36.280432 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:36.281581 (+ 1149us) server_negotiation.cc:299] Negotiation successful
0811 18:50:36.281835 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28980,"thread_start_us":29686,"threads_started":1}
I20260811 18:50:36.285228 16798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:36.229213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:46531 (local address 127.25.25.2:49445)
0811 18:50:36.254571 (+ 25358us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:36.254643 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:36.257392 (+ 2749us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:36.260460 (+ 3068us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:36.260475 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:36.261226 (+ 751us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:50:36.262267 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:36.262315 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:36.264153 (+ 1838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:36.264160 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:36.266344 (+ 2184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:36.266367 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:36.267943 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:36.267952 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:36.268383 (+ 431us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:36.269321 (+ 938us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:50:36.269360 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:50:36.274190 (+ 4830us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:50:36.278085 (+ 3895us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:36.278096 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:36.278118 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:36.278826 (+ 708us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:36.279365 (+ 539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:36.279371 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:36.279387 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:36.279670 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:36.280543 (+ 873us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:50:36.280552 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:50:36.281054 (+ 502us) client_negotiation.cc:769] Sending connection context
0811 18:50:36.282849 (+ 1795us) client_negotiation.cc:240] Negotiation successful
0811 18:50:36.283528 (+ 679us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24924,"thread_start_us":28541,"threads_started":1}
I20260811 18:50:36.287791 16796 heartbeater.cc:347] Connected to a master server at 127.25.25.62:46531
I20260811 18:50:36.288203 16796 heartbeater.cc:464] Registering TS with master...
I20260811 18:50:36.289260 16796 heartbeater.cc:511] Master 127.25.25.62:46531 requested a full tablet report, sending...
I20260811 18:50:36.292006 16209 ts_manager.cc:194] Registered new tserver with Master: 2d4dac6c8b07464a8f4fa6246b82d86d (127.25.25.2:39353)
I20260811 18:50:36.294422 16209 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.2@KRBTEST.COM'} at 127.25.25.2:49445
Aug 11 18:50:36 dist-test-slave-lgr5 krb5kdc[14432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474236, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for HTTP/127.25.25.20@KRBTEST.COM
I20260811 18:50:36.567044 16546 heartbeater.cc:464] Registering TS with master...
I20260811 18:50:36.567512 16546 heartbeater.cc:511] Master 127.25.25.62:46531 requested a full tablet report, sending...
I20260811 18:50:36.569121 16209 ts_manager.cc:194] Registered new tserver with Master: 6f6181c0ff4d45f69ca8d04f8216e26c (127.25.25.1:33115)
I20260811 18:50:36.570122 16209 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.1@KRBTEST.COM'} at 127.25.25.1:60783
W20260811 18:50:36.747440 16803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:50:36.747892 16803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:50:36.748159 16803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:50:36.759871 16803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:50:36.760046 16803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:50:36.760336 16803 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:50:36.776588 16803 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.25.25.20:44057/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:43465
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=33509
--tserver_master_addrs=127.25.25.62:46531
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:50:36.778746 16803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:50:36.780848 16803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:50:36.801261 16811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:36.809334 16813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:36.809952 16818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:50:36.811102 16803 server_base.cc:1034] running on GCE node
I20260811 18:50:36.812047 16803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:50:36.813596 16803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:50:36.814906 16803 hybrid_clock.cc:648] HybridClock initialized: now 1786474236814854 us; error 62 us; skew 500 ppm
I20260811 18:50:36.815407 16803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:50:36 dist-test-slave-lgr5 krb5kdc[14432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474236, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:50:36.820380 16803 init.cc:377] Logged in from keytab as kudu/127.25.25.3@KRBTEST.COM (short username kudu)
I20260811 18:50:36.836398 16803 webserver.cc:460] Webserver started at http://127.25.25.3:33509/ using document root <none> and password file <none>
I20260811 18:50:36.837468 16803 fs_manager.cc:359] Metadata directory not provided
I20260811 18:50:36.837666 16803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 18:50:36 dist-test-slave-lgr5 krb5kdc[14432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474236, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for HTTP/127.25.25.20@KRBTEST.COM
Aug 11 18:50:36 dist-test-slave-lgr5 krb5kdc[14432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474236, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for HTTP/127.25.25.20@KRBTEST.COM
I20260811 18:50:36.903169 16803 fs_manager.cc:709] Time spent opening directory manager: real 0.028s user 0.015s sys 0.012s
I20260811 18:50:36.918581 16834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:36.921691 16803 fs_manager.cc:725] Time spent opening block manager: real 0.016s user 0.000s sys 0.014s
I20260811 18:50:36.921952 16803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "dba3ef7612ae47b28879b4b722fc710f"
format_stamp: "Formatted at 2026-08-11 18:50:33 on dist-test-slave-lgr5"
server_key: "6f17e13cdd72dd72b97d8e2e43200828"
server_key_iv: "55c5fc0bf83f3259be5ccbec28606aba"
server_key_version: "kuduclusterkey@0"
I20260811 18:50:36.923569 16803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:50:37.029644 16803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:50:37.035701 16803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:50:37.036127 16803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:50:37.048674 16803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:50:37.053170 16803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:50:37.053323 16803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:37.053506 16803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:50:37.053592 16803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:37.154019 16803 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:43465
I20260811 18:50:37.154073 17034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:43465 every 8 connection(s)
I20260811 18:50:37.155709 16803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:50:37.163331 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 16803
Aug 11 18:50:37 dist-test-slave-lgr5 krb5kdc[14432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474236, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:50:37.206951 17044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:37.160564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:45505 (local address 127.25.25.62:46531)
0811 18:50:37.174555 (+ 13991us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:37.174563 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:37.176166 (+ 1603us) server_negotiation.cc:407] Connection header received
0811 18:50:37.180944 (+ 4778us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:37.180951 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:37.181051 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:37.181146 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:37.184141 (+ 2995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.185311 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.189452 (+ 4141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.190184 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.190311 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:37.198085 (+ 7774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:37.198093 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:37.198099 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:37.198169 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:37.202048 (+ 3879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:37.203936 (+ 1888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:37.203942 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:37.203945 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:37.204121 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:37.204748 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:37.204755 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:37.204758 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:37.205181 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:37.205343 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:37.206276 (+ 933us) server_negotiation.cc:299] Negotiation successful
0811 18:50:37.206534 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13830,"thread_start_us":14141,"threads_started":1}
I20260811 18:50:37.208400 17039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:37.159749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:46531 (local address 127.25.25.3:45505)
0811 18:50:37.175751 (+ 16002us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:37.175835 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:37.178999 (+ 3164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:37.181921 (+ 2922us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:37.181935 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:37.182784 (+ 849us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:50:37.183820 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:37.183856 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.186384 (+ 2528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.186393 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:37.189166 (+ 2773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:37.189193 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.190767 (+ 1574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.190775 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:37.191149 (+ 374us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:37.193762 (+ 2613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:50:37.194568 (+ 806us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:50:37.197734 (+ 3166us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:50:37.202227 (+ 4493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:37.202492 (+ 265us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:37.202519 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:37.203331 (+ 812us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:37.204253 (+ 922us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:37.204259 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:37.204263 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:37.204579 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:37.205353 (+ 774us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:50:37.205359 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:50:37.205795 (+ 436us) client_negotiation.cc:769] Sending connection context
0811 18:50:37.206151 (+ 356us) client_negotiation.cc:240] Negotiation successful
0811 18:50:37.206795 (+ 644us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15608,"thread_start_us":15327,"threads_started":1}
I20260811 18:50:37.208501 17041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:37.164476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46758 (local address 127.25.25.62:46531)
0811 18:50:37.175002 (+ 10526us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:37.175010 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:37.179420 (+ 4410us) server_negotiation.cc:407] Connection header received
0811 18:50:37.179526 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:37.179532 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:37.179647 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:37.179785 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:37.185771 (+ 5986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.187186 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.193873 (+ 6687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.194600 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.194739 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:37.200145 (+ 5406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:37.200159 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:37.200165 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:37.200240 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:37.204004 (+ 3764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:37.205412 (+ 1408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:37.205417 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:37.205421 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:37.205573 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:37.206138 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:37.206143 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:37.206146 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:37.206509 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:37.206815 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:37.207795 (+ 980us) server_negotiation.cc:299] Negotiation successful
0811 18:50:37.208071 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10391,"thread_start_us":9796,"threads_started":1}
I20260811 18:50:37.210254 17035 heartbeater.cc:347] Connected to a master server at 127.25.25.62:46531
I20260811 18:50:37.210604 17035 heartbeater.cc:464] Registering TS with master...
I20260811 18:50:37.211427 17035 heartbeater.cc:511] Master 127.25.25.62:46531 requested a full tablet report, sending...
I20260811 18:50:37.213320 16206 ts_manager.cc:194] Registered new tserver with Master: dba3ef7612ae47b28879b4b722fc710f (127.25.25.3:43465)
I20260811 18:50:37.214387 16206 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.3@KRBTEST.COM'} at 127.25.25.3:45505
I20260811 18:50:37.226655 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:50:37.244867 17041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:37.230293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46762 (local address 127.25.25.62:46531)
0811 18:50:37.230511 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:37.230519 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:37.230969 (+ 450us) server_negotiation.cc:407] Connection header received
0811 18:50:37.231155 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:37.231159 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:37.231243 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:37.231338 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:37.233077 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.233861 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.235379 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.235846 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.235998 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:37.238899 (+ 2901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:37.238905 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:37.238909 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:37.238954 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:37.241774 (+ 2820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:37.242618 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:37.242624 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:37.242626 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:37.242793 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:37.243250 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:37.243255 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:37.243257 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:37.243564 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:37.243816 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:37.244238 (+ 422us) server_negotiation.cc:299] Negotiation successful
0811 18:50:37.244529 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 18:50:37.250861 16206 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46762:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:50:37.259012 16206 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:50:37.290434 17077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:37.276013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33614 (local address 127.25.25.3:43465)
0811 18:50:37.276990 (+ 977us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:37.277001 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:37.278146 (+ 1145us) server_negotiation.cc:407] Connection header received
0811 18:50:37.278601 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:37.278610 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:37.278891 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:37.279079 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:50:37.280453 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.282207 (+ 1754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.286783 (+ 4576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.288368 (+ 1585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.288564 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:37.288874 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:37.289874 (+ 1000us) server_negotiation.cc:299] Negotiation successful
0811 18:50:37.290077 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":781,"thread_start_us":869,"threads_started":1}
I20260811 18:50:37.290560 17078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:37.276038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:43465 (local address 127.0.0.1:33614)
0811 18:50:37.277946 (+ 1908us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:37.278021 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:37.278329 (+ 308us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:37.279499 (+ 1170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:37.279507 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:37.279542 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:50:37.280166 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:37.280182 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.282441 (+ 2259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.282448 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:37.286565 (+ 4117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:37.286581 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.289091 (+ 2510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.289099 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:37.289415 (+ 316us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:37.289591 (+ 176us) client_negotiation.cc:769] Sending connection context
0811 18:50:37.289744 (+ 153us) client_negotiation.cc:240] Negotiation successful
0811 18:50:37.289987 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1609,"mutex_wait_us":177,"spinlock_wait_cycles":4992,"thread_start_us":1438,"threads_started":1}
I20260811 18:50:37.290676 17081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:37.276758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41024 (local address 127.25.25.2:39353)
0811 18:50:37.277471 (+ 713us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:37.277480 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:37.278146 (+ 666us) server_negotiation.cc:407] Connection header received
0811 18:50:37.279005 (+ 859us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:37.279014 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:37.279252 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:37.279420 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:50:37.280454 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.282207 (+ 1753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.286897 (+ 4690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.288623 (+ 1726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.288738 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:37.289025 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:37.289949 (+ 924us) server_negotiation.cc:299] Negotiation successful
0811 18:50:37.290176 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":550,"thread_start_us":401,"threads_started":1}
I20260811 18:50:37.291821 17079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:37.276537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:39353 (local address 127.0.0.1:41024)
0811 18:50:37.277946 (+ 1409us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:37.278016 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:37.278329 (+ 313us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:37.279739 (+ 1410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:37.279747 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:37.279769 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:50:37.280166 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:37.280182 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.282441 (+ 2259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.282447 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:37.286473 (+ 4026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:37.286493 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.289342 (+ 2849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.289349 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:37.289664 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:37.289705 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 18:50:37.291109 (+ 1404us) client_negotiation.cc:240] Negotiation successful
0811 18:50:37.291381 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1295,"mutex_wait_us":153,"spinlock_wait_cycles":6400,"thread_start_us":1162,"threads_started":1}
I20260811 18:50:37.296536 17082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:37.278486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:33115 (local address 127.0.0.1:49204)
0811 18:50:37.283925 (+ 5439us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:37.283950 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:37.284150 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:37.285113 (+ 963us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:37.285119 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:37.285153 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:50:37.285824 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:37.285842 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.288594 (+ 2752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.288601 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:37.292895 (+ 4294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:37.292926 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.295401 (+ 2475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.295409 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:37.295624 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:37.295667 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 18:50:37.295795 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 18:50:37.295983 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5271,"mutex_wait_us":1,"thread_start_us":4878,"threads_started":1}
I20260811 18:50:37.296571 17085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:37.278754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49204 (local address 127.25.25.1:33115)
0811 18:50:37.283065 (+ 4311us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:37.283075 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:37.284324 (+ 1249us) server_negotiation.cc:407] Connection header received
0811 18:50:37.284470 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:37.284480 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:37.284875 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:37.285136 (+ 261us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:50:37.286252 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.288359 (+ 2107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.293213 (+ 4854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.295071 (+ 1858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.295259 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:37.295546 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:37.295874 (+ 328us) server_negotiation.cc:299] Negotiation successful
0811 18:50:37.296233 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4075,"thread_start_us":3913,"threads_started":1}
I20260811 18:50:37.296277 16924 tablet_service.cc:1467] Processing CreateTablet for tablet 08fb66aba4fb46f4bcabc0fca81a484c (DEFAULT_TABLE table=test-table [id=3cf673815656489a8f0a2dd413f14ed7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:50:37.296615 16683 tablet_service.cc:1467] Processing CreateTablet for tablet 08fb66aba4fb46f4bcabc0fca81a484c (DEFAULT_TABLE table=test-table [id=3cf673815656489a8f0a2dd413f14ed7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:50:37.298158 16924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08fb66aba4fb46f4bcabc0fca81a484c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:50:37.298233 16683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08fb66aba4fb46f4bcabc0fca81a484c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:50:37.300287 16796 heartbeater.cc:503] Master 127.25.25.62:46531 was elected leader, sending a full tablet report...
I20260811 18:50:37.301116 16438 tablet_service.cc:1467] Processing CreateTablet for tablet 08fb66aba4fb46f4bcabc0fca81a484c (DEFAULT_TABLE table=test-table [id=3cf673815656489a8f0a2dd413f14ed7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:50:37.302464 16438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08fb66aba4fb46f4bcabc0fca81a484c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:50:37.314927 17086 tablet_bootstrap.cc:492] T 08fb66aba4fb46f4bcabc0fca81a484c P dba3ef7612ae47b28879b4b722fc710f: Bootstrap starting.
I20260811 18:50:37.319636 17086 tablet_bootstrap.cc:654] T 08fb66aba4fb46f4bcabc0fca81a484c P dba3ef7612ae47b28879b4b722fc710f: Neither blocks nor log segments found. Creating new log.
I20260811 18:50:37.320789 17091 tablet_bootstrap.cc:492] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c: Bootstrap starting.
I20260811 18:50:37.321244 17086 log.cc:824] T 08fb66aba4fb46f4bcabc0fca81a484c P dba3ef7612ae47b28879b4b722fc710f: Log is configured to *not* fsync() on all Append() calls
I20260811 18:50:37.326113 17091 tablet_bootstrap.cc:654] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c: Neither blocks nor log segments found. Creating new log.
I20260811 18:50:37.328190 17091 log.cc:824] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c: Log is configured to *not* fsync() on all Append() calls
I20260811 18:50:37.329855 17092 tablet_bootstrap.cc:492] T 08fb66aba4fb46f4bcabc0fca81a484c P 2d4dac6c8b07464a8f4fa6246b82d86d: Bootstrap starting.
I20260811 18:50:37.332012 17091 tablet_bootstrap.cc:492] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c: No bootstrap required, opened a new log
I20260811 18:50:37.332010 17086 tablet_bootstrap.cc:492] T 08fb66aba4fb46f4bcabc0fca81a484c P dba3ef7612ae47b28879b4b722fc710f: No bootstrap required, opened a new log
I20260811 18:50:37.332383 17091 ts_tablet_manager.cc:1397] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.005s
I20260811 18:50:37.332393 17086 ts_tablet_manager.cc:1397] T 08fb66aba4fb46f4bcabc0fca81a484c P dba3ef7612ae47b28879b4b722fc710f: Time spent bootstrapping tablet: real 0.018s user 0.010s sys 0.006s
I20260811 18:50:37.333688 17092 tablet_bootstrap.cc:654] T 08fb66aba4fb46f4bcabc0fca81a484c P 2d4dac6c8b07464a8f4fa6246b82d86d: Neither blocks nor log segments found. Creating new log.
I20260811 18:50:37.335310 17092 log.cc:824] T 08fb66aba4fb46f4bcabc0fca81a484c P 2d4dac6c8b07464a8f4fa6246b82d86d: Log is configured to *not* fsync() on all Append() calls
I20260811 18:50:37.338877 17092 tablet_bootstrap.cc:492] T 08fb66aba4fb46f4bcabc0fca81a484c P 2d4dac6c8b07464a8f4fa6246b82d86d: No bootstrap required, opened a new log
I20260811 18:50:37.339232 17092 ts_tablet_manager.cc:1397] T 08fb66aba4fb46f4bcabc0fca81a484c P 2d4dac6c8b07464a8f4fa6246b82d86d: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20260811 18:50:37.344430 17086 raft_consensus.cc:348] T 08fb66aba4fb46f4bcabc0fca81a484c P dba3ef7612ae47b28879b4b722fc710f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba3ef7612ae47b28879b4b722fc710f" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43465 } } peers { permanent_uuid: "2d4dac6c8b07464a8f4fa6246b82d86d" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 39353 } } peers { permanent_uuid: "6f6181c0ff4d45f69ca8d04f8216e26c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33115 } }
I20260811 18:50:37.344430 17091 raft_consensus.cc:348] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba3ef7612ae47b28879b4b722fc710f" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43465 } } peers { permanent_uuid: "2d4dac6c8b07464a8f4fa6246b82d86d" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 39353 } } peers { permanent_uuid: "6f6181c0ff4d45f69ca8d04f8216e26c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33115 } }
I20260811 18:50:37.345003 17086 raft_consensus.cc:374] T 08fb66aba4fb46f4bcabc0fca81a484c P dba3ef7612ae47b28879b4b722fc710f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:50:37.345003 17091 raft_consensus.cc:374] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:50:37.345118 17091 raft_consensus.cc:729] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6181c0ff4d45f69ca8d04f8216e26c, State: Initialized, Role: FOLLOWER
I20260811 18:50:37.345180 17086 raft_consensus.cc:729] T 08fb66aba4fb46f4bcabc0fca81a484c P dba3ef7612ae47b28879b4b722fc710f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba3ef7612ae47b28879b4b722fc710f, State: Initialized, Role: FOLLOWER
I20260811 18:50:37.345917 17086 consensus_queue.cc:260] T 08fb66aba4fb46f4bcabc0fca81a484c P dba3ef7612ae47b28879b4b722fc710f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba3ef7612ae47b28879b4b722fc710f" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43465 } } peers { permanent_uuid: "2d4dac6c8b07464a8f4fa6246b82d86d" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 39353 } } peers { permanent_uuid: "6f6181c0ff4d45f69ca8d04f8216e26c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33115 } }
I20260811 18:50:37.345917 17091 consensus_queue.cc:260] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba3ef7612ae47b28879b4b722fc710f" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43465 } } peers { permanent_uuid: "2d4dac6c8b07464a8f4fa6246b82d86d" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 39353 } } peers { permanent_uuid: "6f6181c0ff4d45f69ca8d04f8216e26c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33115 } }
I20260811 18:50:37.347450 16546 heartbeater.cc:503] Master 127.25.25.62:46531 was elected leader, sending a full tablet report...
I20260811 18:50:37.347740 17092 raft_consensus.cc:348] T 08fb66aba4fb46f4bcabc0fca81a484c P 2d4dac6c8b07464a8f4fa6246b82d86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba3ef7612ae47b28879b4b722fc710f" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43465 } } peers { permanent_uuid: "2d4dac6c8b07464a8f4fa6246b82d86d" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 39353 } } peers { permanent_uuid: "6f6181c0ff4d45f69ca8d04f8216e26c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33115 } }
I20260811 18:50:37.348186 17092 raft_consensus.cc:374] T 08fb66aba4fb46f4bcabc0fca81a484c P 2d4dac6c8b07464a8f4fa6246b82d86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:50:37.348253 17091 ts_tablet_manager.cc:1428] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c: Time spent starting tablet: real 0.016s user 0.012s sys 0.003s
I20260811 18:50:37.348290 17092 raft_consensus.cc:729] T 08fb66aba4fb46f4bcabc0fca81a484c P 2d4dac6c8b07464a8f4fa6246b82d86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d4dac6c8b07464a8f4fa6246b82d86d, State: Initialized, Role: FOLLOWER
I20260811 18:50:37.348968 17092 consensus_queue.cc:260] T 08fb66aba4fb46f4bcabc0fca81a484c P 2d4dac6c8b07464a8f4fa6246b82d86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba3ef7612ae47b28879b4b722fc710f" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43465 } } peers { permanent_uuid: "2d4dac6c8b07464a8f4fa6246b82d86d" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 39353 } } peers { permanent_uuid: "6f6181c0ff4d45f69ca8d04f8216e26c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33115 } }
I20260811 18:50:37.351199 17086 ts_tablet_manager.cc:1428] T 08fb66aba4fb46f4bcabc0fca81a484c P dba3ef7612ae47b28879b4b722fc710f: Time spent starting tablet: real 0.019s user 0.013s sys 0.002s
I20260811 18:50:37.351672 17035 heartbeater.cc:503] Master 127.25.25.62:46531 was elected leader, sending a full tablet report...
I20260811 18:50:37.353701 17092 ts_tablet_manager.cc:1428] T 08fb66aba4fb46f4bcabc0fca81a484c P 2d4dac6c8b07464a8f4fa6246b82d86d: Time spent starting tablet: real 0.014s user 0.012s sys 0.003s
I20260811 18:50:37.401852 17099 raft_consensus.cc:482] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:50:37.402245 17099 raft_consensus.cc:504] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba3ef7612ae47b28879b4b722fc710f" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43465 } } peers { permanent_uuid: "2d4dac6c8b07464a8f4fa6246b82d86d" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 39353 } } peers { permanent_uuid: "6f6181c0ff4d45f69ca8d04f8216e26c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33115 } }
I20260811 18:50:37.404350 17099 leader_election.cc:288] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dba3ef7612ae47b28879b4b722fc710f (127.25.25.3:43465), 2d4dac6c8b07464a8f4fa6246b82d86d (127.25.25.2:39353)
I20260811 18:50:37.413420 17077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:37.405125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:60087 (local address 127.25.25.3:43465)
0811 18:50:37.405306 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:37.405310 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:37.406320 (+ 1010us) server_negotiation.cc:407] Connection header received
0811 18:50:37.406503 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:37.406509 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:37.406584 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:37.406687 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:50:37.407257 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.408304 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.410892 (+ 2588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.412133 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.412246 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:37.412339 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:37.412962 (+ 623us) server_negotiation.cc:299] Negotiation successful
0811 18:50:37.413118 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 18:50:37.413393 17081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:37.404965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:53809 (local address 127.25.25.2:39353)
0811 18:50:37.405188 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:37.405195 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:37.405883 (+ 688us) server_negotiation.cc:407] Connection header received
0811 18:50:37.406128 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:37.406134 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:37.406202 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:37.406276 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:50:37.406841 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.407849 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.410716 (+ 2867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.412025 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.412210 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:37.412330 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:37.412962 (+ 632us) server_negotiation.cc:299] Negotiation successful
0811 18:50:37.413118 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 18:50:37.413602 17102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:37.404726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:39353 (local address 127.25.25.1:53809)
0811 18:50:37.405747 (+ 1021us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:37.405765 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:37.405958 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:37.406330 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:37.406335 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:37.406362 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:50:37.406691 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:37.406705 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.408063 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.408067 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:37.410515 (+ 2448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:37.410538 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.412447 (+ 1909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.412460 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:37.412672 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:37.412766 (+ 94us) client_negotiation.cc:769] Sending connection context
0811 18:50:37.412882 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 18:50:37.413116 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":902,"mutex_wait_us":40,"thread_start_us":724,"threads_started":1}
I20260811 18:50:37.413964 17103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:37.404812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:43465 (local address 127.25.25.1:60087)
0811 18:50:37.406182 (+ 1370us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:37.406198 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:37.406340 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:37.406733 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:37.406738 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:37.406763 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:50:37.407090 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:37.407098 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.408486 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.408492 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:37.410719 (+ 2227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:37.410733 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.412479 (+ 1746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.412486 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:37.412677 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:37.412766 (+ 89us) client_negotiation.cc:769] Sending connection context
0811 18:50:37.412882 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 18:50:37.413116 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1272,"mutex_wait_us":101,"thread_start_us":1017,"threads_started":1}
I20260811 18:50:37.414960 16956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08fb66aba4fb46f4bcabc0fca81a484c" candidate_uuid: "6f6181c0ff4d45f69ca8d04f8216e26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba3ef7612ae47b28879b4b722fc710f" is_pre_election: true
I20260811 18:50:37.414958 16724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08fb66aba4fb46f4bcabc0fca81a484c" candidate_uuid: "6f6181c0ff4d45f69ca8d04f8216e26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d4dac6c8b07464a8f4fa6246b82d86d" is_pre_election: true
I20260811 18:50:37.415625 16956 raft_consensus.cc:2454] T 08fb66aba4fb46f4bcabc0fca81a484c P dba3ef7612ae47b28879b4b722fc710f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6181c0ff4d45f69ca8d04f8216e26c in term 0.
I20260811 18:50:37.415625 16724 raft_consensus.cc:2454] T 08fb66aba4fb46f4bcabc0fca81a484c P 2d4dac6c8b07464a8f4fa6246b82d86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6181c0ff4d45f69ca8d04f8216e26c in term 0.
I20260811 18:50:37.416425 16353 leader_election.cc:302] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d4dac6c8b07464a8f4fa6246b82d86d, 6f6181c0ff4d45f69ca8d04f8216e26c; no voters:
I20260811 18:50:37.416896 17099 raft_consensus.cc:2781] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:50:37.417061 17099 raft_consensus.cc:482] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:50:37.417171 17099 raft_consensus.cc:3037] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:50:37.419646 17099 raft_consensus.cc:504] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba3ef7612ae47b28879b4b722fc710f" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43465 } } peers { permanent_uuid: "2d4dac6c8b07464a8f4fa6246b82d86d" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 39353 } } peers { permanent_uuid: "6f6181c0ff4d45f69ca8d04f8216e26c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33115 } }
I20260811 18:50:37.420460 17099 leader_election.cc:288] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c [CANDIDATE]: Term 1 election: Requested vote from peers dba3ef7612ae47b28879b4b722fc710f (127.25.25.3:43465), 2d4dac6c8b07464a8f4fa6246b82d86d (127.25.25.2:39353)
I20260811 18:50:37.421181 16956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08fb66aba4fb46f4bcabc0fca81a484c" candidate_uuid: "6f6181c0ff4d45f69ca8d04f8216e26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba3ef7612ae47b28879b4b722fc710f"
I20260811 18:50:37.421185 16724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08fb66aba4fb46f4bcabc0fca81a484c" candidate_uuid: "6f6181c0ff4d45f69ca8d04f8216e26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d4dac6c8b07464a8f4fa6246b82d86d"
I20260811 18:50:37.421417 16956 raft_consensus.cc:3037] T 08fb66aba4fb46f4bcabc0fca81a484c P dba3ef7612ae47b28879b4b722fc710f [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:50:37.421428 16724 raft_consensus.cc:3037] T 08fb66aba4fb46f4bcabc0fca81a484c P 2d4dac6c8b07464a8f4fa6246b82d86d [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:50:37.423942 16956 raft_consensus.cc:2454] T 08fb66aba4fb46f4bcabc0fca81a484c P dba3ef7612ae47b28879b4b722fc710f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6181c0ff4d45f69ca8d04f8216e26c in term 1.
I20260811 18:50:37.423941 16724 raft_consensus.cc:2454] T 08fb66aba4fb46f4bcabc0fca81a484c P 2d4dac6c8b07464a8f4fa6246b82d86d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6181c0ff4d45f69ca8d04f8216e26c in term 1.
I20260811 18:50:37.424610 16353 leader_election.cc:302] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2d4dac6c8b07464a8f4fa6246b82d86d, 6f6181c0ff4d45f69ca8d04f8216e26c, dba3ef7612ae47b28879b4b722fc710f; no voters:
I20260811 18:50:37.425025 17099 raft_consensus.cc:2781] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:50:37.425595 17099 raft_consensus.cc:686] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c [term 1 LEADER]: Becoming Leader. State: Replica: 6f6181c0ff4d45f69ca8d04f8216e26c, State: Running, Role: LEADER
I20260811 18:50:37.426111 17099 consensus_queue.cc:237] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba3ef7612ae47b28879b4b722fc710f" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43465 } } peers { permanent_uuid: "2d4dac6c8b07464a8f4fa6246b82d86d" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 39353 } } peers { permanent_uuid: "6f6181c0ff4d45f69ca8d04f8216e26c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33115 } }
W20260811 18:50:37.431224 17037 tablet.cc:2369] T 08fb66aba4fb46f4bcabc0fca81a484c P dba3ef7612ae47b28879b4b722fc710f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:50:37.431983 16206 catalog_manager.cc:5495] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f6181c0ff4d45f69ca8d04f8216e26c (127.25.25.1). New cstate: current_term: 1 leader_uuid: "6f6181c0ff4d45f69ca8d04f8216e26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dba3ef7612ae47b28879b4b722fc710f" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d4dac6c8b07464a8f4fa6246b82d86d" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 39353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f6181c0ff4d45f69ca8d04f8216e26c" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33115 } health_report { overall_health: HEALTHY } } }
I20260811 18:50:37.455181 17085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:37.449188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49212 (local address 127.25.25.1:33115)
0811 18:50:37.449419 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:37.449424 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:37.449443 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:50:37.449553 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:37.449556 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:37.449651 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:37.449797 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:50:37.450297 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.451101 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.452805 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.453243 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.453370 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:37.453968 (+ 598us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:50:37.454603 (+ 635us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:50:37.454749 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:37.454846 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 18:50:37.454934 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 18:50:37.465739 16956 raft_consensus.cc:1261] T 08fb66aba4fb46f4bcabc0fca81a484c P dba3ef7612ae47b28879b4b722fc710f [term 1 FOLLOWER]: Refusing update from remote peer 6f6181c0ff4d45f69ca8d04f8216e26c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:50:37.465739 16724 raft_consensus.cc:1261] T 08fb66aba4fb46f4bcabc0fca81a484c P 2d4dac6c8b07464a8f4fa6246b82d86d [term 1 FOLLOWER]: Refusing update from remote peer 6f6181c0ff4d45f69ca8d04f8216e26c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:50:37.467097 17104 consensus_queue.cc:1035] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d4dac6c8b07464a8f4fa6246b82d86d" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 39353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:50:37.467540 17099 consensus_queue.cc:1035] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba3ef7612ae47b28879b4b722fc710f" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:50:37.481091 17109 mvcc.cc:205] Tried to move back new op lower bound from 7317398476646346752 to 7317398476501762048. Current Snapshot: MvccSnapshot[applied={T|T < 7317398476646346752}]
I20260811 18:50:37.511433 16206 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46762:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:50:37.511713 16206 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46762:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:50:37.515797 16206 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8712ec57105f4de5bbd800599c9b5237: Sending DeleteTablet for 3 replicas of tablet 08fb66aba4fb46f4bcabc0fca81a484c
I20260811 18:50:37.517174 16924 tablet_service.cc:1514] Processing DeleteTablet for tablet 08fb66aba4fb46f4bcabc0fca81a484c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:50:37 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:33614
I20260811 18:50:37.517409 16438 tablet_service.cc:1514] Processing DeleteTablet for tablet 08fb66aba4fb46f4bcabc0fca81a484c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:50:37 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:49204
I20260811 18:50:37.517570 16683 tablet_service.cc:1514] Processing DeleteTablet for tablet 08fb66aba4fb46f4bcabc0fca81a484c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:50:37 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:41024
I20260811 18:50:37.526077 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 16270
I20260811 18:50:37.529639 17122 tablet_replica.cc:330] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c: stopping tablet replica
I20260811 18:50:37.530234 17122 raft_consensus.cc:2229] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:50:37.531090 17122 raft_consensus.cc:2258] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:50:37.531917 17123 tablet_replica.cc:330] T 08fb66aba4fb46f4bcabc0fca81a484c P 2d4dac6c8b07464a8f4fa6246b82d86d: stopping tablet replica
I20260811 18:50:37.532254 17121 tablet_replica.cc:330] T 08fb66aba4fb46f4bcabc0fca81a484c P dba3ef7612ae47b28879b4b722fc710f: stopping tablet replica
I20260811 18:50:37.532573 17123 raft_consensus.cc:2229] T 08fb66aba4fb46f4bcabc0fca81a484c P 2d4dac6c8b07464a8f4fa6246b82d86d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:50:37.532774 17121 raft_consensus.cc:2229] T 08fb66aba4fb46f4bcabc0fca81a484c P dba3ef7612ae47b28879b4b722fc710f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:50:37.533182 17123 raft_consensus.cc:2258] T 08fb66aba4fb46f4bcabc0fca81a484c P 2d4dac6c8b07464a8f4fa6246b82d86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:50:37.533459 17121 raft_consensus.cc:2258] T 08fb66aba4fb46f4bcabc0fca81a484c P dba3ef7612ae47b28879b4b722fc710f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:50:37.535580 17123 ts_tablet_manager.cc:1905] T 08fb66aba4fb46f4bcabc0fca81a484c P 2d4dac6c8b07464a8f4fa6246b82d86d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:50:37.536027 17121 ts_tablet_manager.cc:1905] T 08fb66aba4fb46f4bcabc0fca81a484c P dba3ef7612ae47b28879b4b722fc710f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:50:37.537577 17122 ts_tablet_manager.cc:1905] T 08fb66aba4fb46f4bcabc0fca81a484c P 6f6181c0ff4d45f69ca8d04f8216e26c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:50:37.543783 17121 ts_tablet_manager.cc:1918] T 08fb66aba4fb46f4bcabc0fca81a484c P dba3ef7612ae47b28879b4b722fc710f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:50:37.544162 17121 log.cc:1196] T 08fb66aba4fb46f4bcabc0fca81a484c P dba3ef7612ae47b28879b4b722fc710f: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-2/wal/wals/08fb66aba4fb46f4bcabc0fca81a484c
I20260811 18:50:37.545045 17121 ts_tablet_manager.cc:1939] T 08fb66aba4fb46f4bcabc0fca81a484c P dba3ef7612ae47b28879b4b722fc710f: Deleting consensus metadata
I20260811 18:50:37.545449 17123 ts_tablet_manager.cc:1918] T 08fb66aba4fb46f4bcabc0fca81a484c P 2d4dac6c8b07464a8f4fa6246b82d86d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:50:37.547564 16179 catalog_manager.cc:4841] TS dba3ef7612ae47b28879b4b722fc710f (127.25.25.3:43465): tablet 08fb66aba4fb46f4bcabc0fca81a484c (table test-table [id=3cf673815656489a8f0a2dd413f14ed7]) successfully deleted
I20260811 18:50:37.548317 17123 log.cc:1196] T 08fb66aba4fb46f4bcabc0fca81a484c P 2d4dac6c8b07464a8f4fa6246b82d86d: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474012733352-25700-0/minicluster-data/ts-1/wal/wals/08fb66aba4fb46f4bcabc0fca81a484c
I20260811 18:50:37.549088 17123 ts_tablet_manager.cc:1939] T 08fb66aba4fb46f4bcabc0fca81a484c P 2d4dac6c8b07464a8f4fa6246b82d86d: Deleting consensus metadata
I20260811 18:50:37.549244 17085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:37.527216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49220 (local address 127.25.25.1:33115)
0811 18:50:37.528049 (+ 833us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:37.528056 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:37.528094 (+ 38us) server_negotiation.cc:407] Connection header received
0811 18:50:37.528171 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:37.528177 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:37.528269 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:37.528370 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:37.530481 (+ 2111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.531771 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.534195 (+ 2424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.534885 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.535060 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:37.539199 (+ 4139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:37.539218 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:37.539244 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:37.539320 (+ 76us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:37.543792 (+ 4472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:37.545097 (+ 1305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:37.545108 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:37.545113 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:37.545341 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:37.545929 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:37.545935 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:37.545939 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:37.546506 (+ 567us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:37.548323 (+ 1817us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:37.548545 (+ 222us) server_negotiation.cc:299] Negotiation successful
0811 18:50:37.548850 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":660}
I20260811 18:50:37.550485 16536 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:50:37.551330 16177 catalog_manager.cc:4841] TS 2d4dac6c8b07464a8f4fa6246b82d86d (127.25.25.2:39353): tablet 08fb66aba4fb46f4bcabc0fca81a484c (table test-table [id=3cf673815656489a8f0a2dd413f14ed7]) successfully deleted
I20260811 18:50:37.653141 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 16270
W20260811 18:50:37.686748 16177 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.25.1:33115 (error 108)
I20260811 18:50:37.687458 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 16552
I20260811 18:50:37.689013 17082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:37.688589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:33115 (local address 127.0.0.1:49228)
0811 18:50:37.688745 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:37.688860 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:33115: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 18:50:37.689357 16177 catalog_manager.cc:4584] TS 6f6181c0ff4d45f69ca8d04f8216e26c (127.25.25.1:33115): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 08fb66aba4fb46f4bcabc0fca81a484c: Network error: Client connection negotiation failed: client connection to 127.25.25.1:33115: connect: Connection refused (error 111)
I20260811 18:50:37.703905 17081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:37.688514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41030 (local address 127.25.25.2:39353)
0811 18:50:37.688734 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:37.688740 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:37.688763 (+ 23us) server_negotiation.cc:407] Connection header received
0811 18:50:37.688837 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:37.688842 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:37.688911 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:37.689014 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:37.690653 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.691444 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.692999 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.693441 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.693574 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:37.696624 (+ 3050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:37.696650 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:37.696668 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:37.696716 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:37.700414 (+ 3698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:37.701413 (+ 999us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:37.701423 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:37.701426 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:37.701609 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:37.702077 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:37.702082 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:37.702084 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:37.702549 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:37.702915 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:37.703262 (+ 347us) server_negotiation.cc:299] Negotiation successful
0811 18:50:37.703528 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 18:50:37.704742 16789 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:50:37.743315 17082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:37.742836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:33115 (local address 127.0.0.1:49242)
0811 18:50:37.743056 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:37.743163 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:33115: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260811 18:50:37.744493 17082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:37.744073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:33115 (local address 127.0.0.1:49256)
0811 18:50:37.744261 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:37.744357 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:33115: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 18:50:37.798151 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 16552
I20260811 18:50:37.805178 17082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:37.804648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:33115 (local address 127.0.0.1:49264)
0811 18:50:37.804911 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:37.805010 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:33115: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260811 18:50:37.806232 17082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:37.805872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:33115 (local address 127.0.0.1:49272)
0811 18:50:37.806032 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:37.806110 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:33115: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 18:50:37.827136 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 16803
I20260811 18:50:37.841912 17077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:37.828051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33620 (local address 127.25.25.3:43465)
0811 18:50:37.828394 (+ 343us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:37.828400 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:37.828463 (+ 63us) server_negotiation.cc:407] Connection header received
0811 18:50:37.828523 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:37.828527 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:37.828620 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:37.828739 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:37.830137 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.830920 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.832323 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:37.832737 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:37.832852 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:37.835455 (+ 2603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:37.835471 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:37.835489 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:37.835527 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:37.838605 (+ 3078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:37.839446 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:37.839456 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:37.839458 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:37.839617 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:37.840050 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:37.840053 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:37.840055 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:37.840496 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:37.840811 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:37.841165 (+ 354us) server_negotiation.cc:299] Negotiation successful
0811 18:50:37.841455 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168}
I20260811 18:50:37.842711 17027 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:50:37.887766 17082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:37.887123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:33115 (local address 127.0.0.1:49278)
0811 18:50:37.887388 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:37.887515 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:33115: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260811 18:50:37.889349 17082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:37.888810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:33115 (local address 127.0.0.1:49282)
0811 18:50:37.889073 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:37.889186 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:33115: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136}
I20260811 18:50:37.934693 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 16803
I20260811 18:50:37.964238 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 16148
I20260811 18:50:37.965571 16260 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:50:38.084626 17082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:38.083884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:33115 (local address 127.0.0.1:49288)
0811 18:50:38.084145 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:38.084272 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:33115: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260811 18:50:38.084937 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 16148
I20260811 18:50:38.124661 25700 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 18:50:38.472666 25700 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 18:50:38.472949 25700 mini_ranger.cc:66] Stopping Ranger...
I20260811 18:50:38.820302 25700 mini_ranger.cc:68] Stopped Ranger
2026-08-11 18:50:38.820 UTC [14490] LOG: received smart shutdown request
2026-08-11 18:50:38.824 UTC [14490] LOG: background worker "logical replication launcher" (PID 14502) exited with exit code 1
2026-08-11 18:50:38.824 UTC [14496] LOG: shutting down
2026-08-11 18:50:39.054 UTC [14490] LOG: database system is shut down
2026-08-11T18:50:39Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (61657 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:50:39 dist-test-slave-lgr5 krb5kdc[17152](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:50:39 dist-test-slave-lgr5 krb5kdc[17152](info): set up 2 sockets
Aug 11 18:50:39 dist-test-slave-lgr5 krb5kdc[17152](info): commencing operation
krb5kdc: starting...
W20260811 18:50:40.490942 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.271s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:50:40 dist-test-slave-lgr5 krb5kdc[17152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474240, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:50:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:50:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:50:40.805126 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:39295
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:46337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:39295,127.25.25.61:43863,127.25.25.60:35171
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:50:41.181265 17176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:50:41.181645 17176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:50:41.181804 17176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:50:41.190120 17176 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:50:41.190275 17176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:50:41.190358 17176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:50:41.190446 17176 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:50:41.190512 17176 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:50:41.201498 17176 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:46337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:39295,127.25.25.61:43863,127.25.25.60:35171
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:39295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:50:41.203073 17176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:50:41.204640 17176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:50:41.218487 17186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:41.218418 17189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:41.218446 17192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:50:41.221942 17176 server_base.cc:1034] running on GCE node
I20260811 18:50:41.222949 17176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:50:41.224712 17176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:50:41.225973 17176 hybrid_clock.cc:648] HybridClock initialized: now 1786474241225917 us; error 43 us; skew 500 ppm
I20260811 18:50:41.226464 17176 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:50:41 dist-test-slave-lgr5 krb5kdc[17152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474241, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:50:41.234310 17176 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:50:41.236279 17176 webserver.cc:460] Webserver started at http://127.25.25.62:39075/ using document root <none> and password file <none>
I20260811 18:50:41.237118 17176 fs_manager.cc:359] Metadata directory not provided
I20260811 18:50:41.237258 17176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:50:41.237587 17176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:50:41.241158 17176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "5fc0602d72e84982a306f58438b0f4fc"
format_stamp: "Formatted at 2026-08-11 18:50:41 on dist-test-slave-lgr5"
server_key: "10ce57cad18c7f861742af8baef5b609"
server_key_iv: "5d4ec60b3e64ceb096a49e831be2bd00"
server_key_version: "encryptionkey@0"
I20260811 18:50:41.242154 17176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "5fc0602d72e84982a306f58438b0f4fc"
format_stamp: "Formatted at 2026-08-11 18:50:41 on dist-test-slave-lgr5"
server_key: "10ce57cad18c7f861742af8baef5b609"
server_key_iv: "5d4ec60b3e64ceb096a49e831be2bd00"
server_key_version: "encryptionkey@0"
I20260811 18:50:41.248382 17176 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260811 18:50:41.252594 17203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:41.254351 17176 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 18:50:41.254599 17176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "5fc0602d72e84982a306f58438b0f4fc"
format_stamp: "Formatted at 2026-08-11 18:50:41 on dist-test-slave-lgr5"
server_key: "10ce57cad18c7f861742af8baef5b609"
server_key_iv: "5d4ec60b3e64ceb096a49e831be2bd00"
server_key_version: "encryptionkey@0"
I20260811 18:50:41.254843 17176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:50:41.292047 17176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:50:41.298125 17176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:50:41.298470 17176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:50:41.318567 17176 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:39295
I20260811 18:50:41.318630 17302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:39295 every 8 connection(s)
I20260811 18:50:41.320243 17176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:50:41.324936 17304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:50:41.328020 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 17176
I20260811 18:50:41.328294 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:50:41.328992 25700 external_mini_cluster.cc:1428] Setting key 3ae47de0fba655ac3d6885a184df9c23
I20260811 18:50:41.332937 17304 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39295 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:50:41 dist-test-slave-lgr5 krb5kdc[17152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474241, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.25.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.61@KRBTEST.COM" created.
I20260811 18:50:41.360247 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:41.336846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:39295 (local address 127.0.0.1:52376)
0811 18:50:41.338226 (+ 1380us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:41.338279 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:41.340474 (+ 2195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:41.341638 (+ 1164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:41.341646 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:41.342636 (+ 990us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:50:41.343055 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:41.343080 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:41.344920 (+ 1840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:41.344925 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:41.346125 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:41.346141 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:41.347219 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:41.347227 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:41.347501 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:41.348373 (+ 872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:50:41.348402 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:50:41.351158 (+ 2756us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:50:41.355195 (+ 4037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:41.355211 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:41.355225 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:41.355763 (+ 538us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:41.356288 (+ 525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:41.356294 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:41.356298 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:41.356515 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:41.357498 (+ 983us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:50:41.357508 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:50:41.357760 (+ 252us) client_negotiation.cc:769] Sending connection context
0811 18:50:41.358047 (+ 287us) client_negotiation.cc:240] Negotiation successful
0811 18:50:41.358762 (+ 715us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1139,"mutex_wait_us":226,"spinlock_wait_cycles":20736,"thread_start_us":908,"threads_started":1}
I20260811 18:50:41.360251 17306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:41.336845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52376 (local address 127.25.25.62:39295)
0811 18:50:41.337848 (+ 1003us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:41.337866 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:41.338424 (+ 558us) server_negotiation.cc:407] Connection header received
0811 18:50:41.340993 (+ 2569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:41.341000 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:41.341320 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:41.341576 (+ 256us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:41.343303 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:41.344697 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:41.346297 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:41.346935 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:41.347139 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:41.351441 (+ 4302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:41.351451 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:41.351468 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:41.351513 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:41.354962 (+ 3449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:41.355922 (+ 960us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:41.355930 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:41.355933 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:41.356168 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:41.356700 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:41.356705 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:41.356708 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:41.357323 (+ 615us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:41.357530 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:41.358196 (+ 666us) server_negotiation.cc:299] Negotiation successful
0811 18:50:41.358586 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":744,"thread_start_us":531,"threads_started":1}
I20260811 18:50:41.364167 17304 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:50:41.365547 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:41.365058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:43863 (local address 127.0.0.1:37278)
0811 18:50:41.365267 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:41.365404 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:43863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
W20260811 18:50:41.365906 17205 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.25.61:43863: connect: Connection refused (error 111)
I20260811 18:50:41.367834 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:41.367341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:43863 (local address 127.0.0.1:37292)
0811 18:50:41.367561 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:41.367648 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:43863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
W20260811 18:50:41.368104 17304 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.61:43863: Network error: Client connection negotiation failed: client connection to 127.25.25.61:43863: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.61.keytab.
Entry for principal kudu/127.25.25.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.61.keytab.
I20260811 18:50:41.396209 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.61:43863
--webserver_interface=127.25.25.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.61.keytab
--principal=kudu/127.25.25.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:46337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:39295,127.25.25.61:43863,127.25.25.60:35171
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:50:41.417531 17304 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 } attempt: 1
I20260811 18:50:41.418853 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:41.418375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:43863 (local address 127.0.0.1:37300)
0811 18:50:41.418584 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:41.418709 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:43863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260811 18:50:41.420331 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:41.419747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:43863 (local address 127.0.0.1:37304)
0811 18:50:41.419948 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:41.420112 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:43863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260811 18:50:41.420564 17304 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.61:43863: Network error: Client connection negotiation failed: client connection to 127.25.25.61:43863: connect: Connection refused (error 111)
I20260811 18:50:41.488881 17304 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 } attempt: 2
I20260811 18:50:41.490190 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:41.489643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:43863 (local address 127.0.0.1:37318)
0811 18:50:41.489929 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:41.490038 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:43863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260811 18:50:41.491632 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:41.491116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:43863 (local address 127.0.0.1:37330)
0811 18:50:41.491326 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:41.491444 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:43863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
W20260811 18:50:41.491887 17304 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.61:43863: Network error: Client connection negotiation failed: client connection to 127.25.25.61:43863: connect: Connection refused (error 111)
I20260811 18:50:41.583176 17304 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 } attempt: 3
I20260811 18:50:41.584456 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:41.583935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:43863 (local address 127.0.0.1:37338)
0811 18:50:41.584207 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:41.584303 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:43863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260811 18:50:41.585521 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:41.585113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:43863 (local address 127.0.0.1:37350)
0811 18:50:41.585268 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:41.585363 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:43863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 18:50:41.585736 17304 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.61:43863: Network error: Client connection negotiation failed: client connection to 127.25.25.61:43863: connect: Connection refused (error 111)
I20260811 18:50:41.729066 17304 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 } attempt: 4
I20260811 18:50:41.730453 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:41.729770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:43863 (local address 127.0.0.1:37364)
0811 18:50:41.730131 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:41.730262 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:43863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194}
I20260811 18:50:41.731676 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:41.731181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:43863 (local address 127.0.0.1:37378)
0811 18:50:41.731369 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:41.731491 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:43863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260811 18:50:41.731904 17304 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.61:43863: Network error: Client connection negotiation failed: client connection to 127.25.25.61:43863: connect: Connection refused (error 111)
W20260811 18:50:41.777173 17312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:50:41.777520 17312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:50:41.777637 17312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:50:41.785801 17312 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:50:41.785966 17312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:50:41.786023 17312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:50:41.786108 17312 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:50:41.786160 17312 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:50:41.796962 17312 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:46337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:39295,127.25.25.61:43863,127.25.25.60:35171
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.61.keytab
--principal=kudu/127.25.25.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.61:43863
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.25.25.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:50:41.798519 17312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:50:41.799994 17312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:50:41.812543 17320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:41.812580 17323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:41.812834 17319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:50:41.813454 17312 server_base.cc:1034] running on GCE node
I20260811 18:50:41.814451 17312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:50:41.816315 17312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:50:41.817601 17312 hybrid_clock.cc:648] HybridClock initialized: now 1786474241817547 us; error 46 us; skew 500 ppm
I20260811 18:50:41.818068 17312 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:50:41 dist-test-slave-lgr5 krb5kdc[17152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474241, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:50:41.821664 17312 init.cc:377] Logged in from keytab as kudu/127.25.25.61@KRBTEST.COM (short username kudu)
I20260811 18:50:41.823428 17312 webserver.cc:460] Webserver started at http://127.25.25.61:33205/ using document root <none> and password file <none>
I20260811 18:50:41.824276 17312 fs_manager.cc:359] Metadata directory not provided
I20260811 18:50:41.824409 17312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:50:41.824700 17312 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:50:41.828193 17312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-1/data/instance:
uuid: "76c6fb308b4946138b1a5056d09e9c63"
format_stamp: "Formatted at 2026-08-11 18:50:41 on dist-test-slave-lgr5"
server_key: "34b03f9b913323236f563bc4feca36c6"
server_key_iv: "e226710322ef3e4456fe08dc3f071782"
server_key_version: "encryptionkey@0"
I20260811 18:50:41.829169 17312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-1/wal/instance:
uuid: "76c6fb308b4946138b1a5056d09e9c63"
format_stamp: "Formatted at 2026-08-11 18:50:41 on dist-test-slave-lgr5"
server_key: "34b03f9b913323236f563bc4feca36c6"
server_key_iv: "e226710322ef3e4456fe08dc3f071782"
server_key_version: "encryptionkey@0"
I20260811 18:50:41.836014 17312 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s
I20260811 18:50:41.840641 17331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:41.842679 17312 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260811 18:50:41.842936 17312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-1/wal
uuid: "76c6fb308b4946138b1a5056d09e9c63"
format_stamp: "Formatted at 2026-08-11 18:50:41 on dist-test-slave-lgr5"
server_key: "34b03f9b913323236f563bc4feca36c6"
server_key_iv: "e226710322ef3e4456fe08dc3f071782"
server_key_version: "encryptionkey@0"
I20260811 18:50:41.843187 17312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:50:41.871459 17312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:50:41.876623 17312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:50:41.876938 17312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:50:41.896895 17312 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.61:43863
I20260811 18:50:41.896984 17426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.61:43863 every 8 connection(s)
I20260811 18:50:41.898437 17312 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-1/data/info.pb
I20260811 18:50:41.900938 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 17312
I20260811 18:50:41.901158 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-1/wal/instance
I20260811 18:50:41.901767 25700 external_mini_cluster.cc:1428] Setting key 1e9a15b1bb190909457c11eed4e01cec
I20260811 18:50:41.903247 17427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:50:41.913160 17427 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39295 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:50:41 dist-test-slave-lgr5 krb5kdc[17152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474241, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.61@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.25.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.60@KRBTEST.COM" created.
I20260811 18:50:41.937116 17433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:41.916515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52388 (local address 127.25.25.62:39295)
0811 18:50:41.917010 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:41.917015 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:41.918291 (+ 1276us) server_negotiation.cc:407] Connection header received
0811 18:50:41.920586 (+ 2295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:41.920592 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:41.920749 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:41.920865 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:41.922699 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:41.923488 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:41.925282 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:41.925741 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:41.925872 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:41.930234 (+ 4362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:41.930240 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:41.930244 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:41.930299 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:41.933439 (+ 3140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:41.934410 (+ 971us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:41.934416 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:41.934418 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:41.934557 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:41.935060 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:41.935064 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:41.935066 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:41.935405 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:41.935568 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:41.936459 (+ 891us) server_negotiation.cc:299] Negotiation successful
0811 18:50:41.936719 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":245,"threads_started":1}
I20260811 18:50:41.938293 17434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:41.917261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:39295 (local address 127.0.0.1:52388)
0811 18:50:41.918108 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:41.918151 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:41.920227 (+ 2076us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:41.921181 (+ 954us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:41.921192 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:41.921805 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:50:41.922467 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:41.922489 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:41.923676 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:41.923680 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:41.925116 (+ 1436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:41.925132 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:41.926014 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:41.926023 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:41.926257 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:41.927036 (+ 779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:50:41.927070 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:50:41.929902 (+ 2832us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:50:41.933656 (+ 3754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:41.933669 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:41.933692 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:41.934236 (+ 544us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:41.934680 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:41.934685 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:41.934688 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:41.934911 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:41.935555 (+ 644us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:50:41.935563 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:50:41.935983 (+ 420us) client_negotiation.cc:769] Sending connection context
0811 18:50:41.936326 (+ 343us) client_negotiation.cc:240] Negotiation successful
0811 18:50:41.936970 (+ 644us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":352,"threads_started":1}
I20260811 18:50:41.940428 17427 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:50:41 dist-test-slave-lgr5 krb5kdc[17152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474241, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.61@KRBTEST.COM for kudu/127.25.25.61@KRBTEST.COM
I20260811 18:50:41.956699 17434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:41.941237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:43863 (local address 127.0.0.1:37384)
0811 18:50:41.941416 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:41.941435 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:41.941558 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:41.942489 (+ 931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:41.942493 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:41.942901 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:50:41.943048 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:41.943056 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:41.944898 (+ 1842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:41.944903 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:41.946148 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:41.946167 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:41.947157 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:41.947163 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:41.947420 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:41.948172 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:50:41.948192 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:50:41.950494 (+ 2302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:50:41.954050 (+ 3556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:41.954056 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:41.954061 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:41.954478 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:41.954857 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:41.954862 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:41.954865 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:41.955023 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:41.955666 (+ 643us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:50:41.955671 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:50:41.955815 (+ 144us) client_negotiation.cc:769] Sending connection context
0811 18:50:41.955946 (+ 131us) client_negotiation.cc:240] Negotiation successful
0811 18:50:41.956291 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 18:50:41.956794 17435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:41.941315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37384 (local address 127.25.25.61:43863)
0811 18:50:41.941976 (+ 661us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:41.941983 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:41.942016 (+ 33us) server_negotiation.cc:407] Connection header received
0811 18:50:41.942076 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:41.942084 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:41.942322 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:41.942480 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:41.943213 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:41.944728 (+ 1515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:41.946337 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:41.946984 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:41.947125 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:41.950715 (+ 3590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:41.950729 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:41.950745 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:41.950783 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:41.953891 (+ 3108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:41.954616 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:41.954623 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:41.954626 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:41.954750 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:41.955138 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:41.955142 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:41.955144 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:41.955539 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:41.955753 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:41.956137 (+ 384us) server_negotiation.cc:299] Negotiation successful
0811 18:50:41.956424 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":481,"thread_start_us":284,"threads_started":1}
I20260811 18:50:41.959738 17427 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:50:41.961050 17434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:41.960473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:35171 (local address 127.0.0.1:48310)
0811 18:50:41.960670 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:41.960841 (+ 171us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 18:50:41.961344 17332 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
I20260811 18:50:41.963215 17434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:41.962805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:35171 (local address 127.0.0.1:48312)
0811 18:50:41.962985 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:41.963080 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 18:50:41.963514 17427 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:35171: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.60.keytab.
Entry for principal kudu/127.25.25.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.60.keytab.
I20260811 18:50:41.972466 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.60:35171
--webserver_interface=127.25.25.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.60.keytab
--principal=kudu/127.25.25.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:46337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:39295,127.25.25.61:43863,127.25.25.60:35171
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:50:42.012921 17427 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } attempt: 1
I20260811 18:50:42.014303 17434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.013835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:35171 (local address 127.0.0.1:48318)
0811 18:50:42.014044 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:42.014148 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 18:50:42.015337 17434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.014971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:35171 (local address 127.0.0.1:48328)
0811 18:50:42.015152 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:42.015222 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260811 18:50:42.015550 17427 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:35171: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
I20260811 18:50:42.031265 17304 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 } attempt: 5
Aug 11 18:50:42 dist-test-slave-lgr5 krb5kdc[17152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474241, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for kudu/127.25.25.61@KRBTEST.COM
I20260811 18:50:42.047724 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.032230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:43863 (local address 127.0.0.1:37390)
0811 18:50:42.032516 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:42.032536 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:42.032652 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:42.033061 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:42.033064 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:42.033495 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:50:42.033682 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:42.033692 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.035221 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.035226 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:42.036236 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:42.036254 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.037376 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.037382 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:42.037549 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:42.038270 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:50:42.038327 (+ 57us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:50:42.040729 (+ 2402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:50:42.044770 (+ 4041us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:42.044775 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:42.044778 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:42.045246 (+ 468us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:42.045811 (+ 565us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:42.045842 (+ 31us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:42.045845 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:42.046053 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:42.046766 (+ 713us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:50:42.046770 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:50:42.046970 (+ 200us) client_negotiation.cc:769] Sending connection context
0811 18:50:42.047133 (+ 163us) client_negotiation.cc:240] Negotiation successful
0811 18:50:42.047431 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82}
I20260811 18:50:42.047901 17435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.032385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37390 (local address 127.25.25.61:43863)
0811 18:50:42.032614 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:42.032621 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:42.032649 (+ 28us) server_negotiation.cc:407] Connection header received
0811 18:50:42.032789 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:42.032795 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:42.032899 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:42.033013 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:42.033895 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.035012 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.036418 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.037130 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.037302 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:42.041013 (+ 3711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:42.041021 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:42.041026 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:42.041075 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:42.044543 (+ 3468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:42.045423 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:42.045430 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:42.045433 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:42.045605 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:42.046198 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:42.046204 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:42.046207 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:42.046616 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:42.046781 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:42.047303 (+ 522us) server_negotiation.cc:299] Negotiation successful
0811 18:50:42.047557 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 18:50:42.049038 17304 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:50:42.050137 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.049709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:35171 (local address 127.0.0.1:48342)
0811 18:50:42.049896 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:42.049978 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260811 18:50:42.051247 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.050851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:35171 (local address 127.0.0.1:48354)
0811 18:50:42.051031 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:42.051121 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260811 18:50:42.051468 17304 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:35171: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
I20260811 18:50:42.083786 17427 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } attempt: 2
I20260811 18:50:42.084968 17434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.084498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:35171 (local address 127.0.0.1:48364)
0811 18:50:42.084710 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:42.084801 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260811 18:50:42.086232 17434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.085812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:35171 (local address 127.0.0.1:48368)
0811 18:50:42.086003 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:42.086088 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260811 18:50:42.086491 17427 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:35171: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
I20260811 18:50:42.102746 17304 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } attempt: 1
I20260811 18:50:42.104161 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.103603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:35171 (local address 127.0.0.1:48378)
0811 18:50:42.103838 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:42.103963 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260811 18:50:42.105314 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.104957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:35171 (local address 127.0.0.1:48390)
0811 18:50:42.105113 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:42.105199 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 18:50:42.105561 17304 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:35171: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
I20260811 18:50:42.173803 17304 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } attempt: 2
I20260811 18:50:42.175143 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.174566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:35171 (local address 127.0.0.1:48392)
0811 18:50:42.174829 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:42.174941 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260811 18:50:42.176390 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.175939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:35171 (local address 127.0.0.1:48394)
0811 18:50:42.176145 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:42.176226 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260811 18:50:42.176623 17304 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:35171: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
I20260811 18:50:42.177771 17427 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } attempt: 3
I20260811 18:50:42.178828 17434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.178384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:35171 (local address 127.0.0.1:48400)
0811 18:50:42.178571 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:42.178660 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 18:50:42.180218 17434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.179590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:35171 (local address 127.0.0.1:48414)
0811 18:50:42.179895 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:42.180010 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175}
W20260811 18:50:42.180526 17427 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:35171: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
I20260811 18:50:42.282887 17304 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } attempt: 3
I20260811 18:50:42.284271 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.283696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:35171 (local address 127.0.0.1:48422)
0811 18:50:42.283934 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:42.284041 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260811 18:50:42.285611 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.285152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:35171 (local address 127.0.0.1:48432)
0811 18:50:42.285371 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:42.285474 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
W20260811 18:50:42.285852 17304 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:35171: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
I20260811 18:50:42.323776 17427 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } attempt: 4
I20260811 18:50:42.324958 17434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.324468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:35171 (local address 127.0.0.1:48448)
0811 18:50:42.324703 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:42.324790 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 18:50:42.326061 17434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.325710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:35171 (local address 127.0.0.1:48452)
0811 18:50:42.325868 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:42.325943 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 18:50:42.326352 17427 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:35171: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
W20260811 18:50:42.358038 17438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:50:42.358386 17438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:50:42.358479 17438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:50:42.366307 17438 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:50:42.366434 17438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:50:42.366480 17438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:50:42.366544 17438 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:50:42.366590 17438 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:50:42.376838 17438 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:46337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:39295,127.25.25.61:43863,127.25.25.60:35171
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.60.keytab
--principal=kudu/127.25.25.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.60:35171
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.25.25.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:50:42.378274 17438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:50:42.379725 17438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:50:42.392143 17446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:42.392238 17450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:42.392182 17448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:50:42.393215 17438 server_base.cc:1034] running on GCE node
I20260811 18:50:42.394695 17438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:50:42.396344 17438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:50:42.397557 17438 hybrid_clock.cc:648] HybridClock initialized: now 1786474242397508 us; error 42 us; skew 500 ppm
I20260811 18:50:42.397962 17438 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:50:42 dist-test-slave-lgr5 krb5kdc[17152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474242, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:50:42.401302 17438 init.cc:377] Logged in from keytab as kudu/127.25.25.60@KRBTEST.COM (short username kudu)
I20260811 18:50:42.402985 17438 webserver.cc:460] Webserver started at http://127.25.25.60:38919/ using document root <none> and password file <none>
I20260811 18:50:42.403731 17438 fs_manager.cc:359] Metadata directory not provided
I20260811 18:50:42.403867 17438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:50:42.404237 17438 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:50:42.407739 17438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-2/data/instance:
uuid: "f7f05051836c44c4abe249a4c78b5da4"
format_stamp: "Formatted at 2026-08-11 18:50:42 on dist-test-slave-lgr5"
server_key: "c47ba97ac2003ac90f02b7b4f0503388"
server_key_iv: "cf7f5093eef45e090fb2aa940a0dce7a"
server_key_version: "encryptionkey@0"
I20260811 18:50:42.408747 17438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-2/wal/instance:
uuid: "f7f05051836c44c4abe249a4c78b5da4"
format_stamp: "Formatted at 2026-08-11 18:50:42 on dist-test-slave-lgr5"
server_key: "c47ba97ac2003ac90f02b7b4f0503388"
server_key_iv: "cf7f5093eef45e090fb2aa940a0dce7a"
server_key_version: "encryptionkey@0"
I20260811 18:50:42.415778 17438 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260811 18:50:42.420213 17466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:42.421995 17438 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 18:50:42.422248 17438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-2/wal
uuid: "f7f05051836c44c4abe249a4c78b5da4"
format_stamp: "Formatted at 2026-08-11 18:50:42 on dist-test-slave-lgr5"
server_key: "c47ba97ac2003ac90f02b7b4f0503388"
server_key_iv: "cf7f5093eef45e090fb2aa940a0dce7a"
server_key_version: "encryptionkey@0"
I20260811 18:50:42.422499 17438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:50:42.441500 17438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:50:42.446580 17438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:50:42.446967 17438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:50:42.463063 17304 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } attempt: 4
I20260811 18:50:42.464373 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.463811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:35171 (local address 127.0.0.1:48464)
0811 18:50:42.464118 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:42.464221 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260811 18:50:42.465585 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.465209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:35171 (local address 127.0.0.1:48472)
0811 18:50:42.465380 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:42.465465 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260811 18:50:42.465826 17304 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:35171: Network error: Client connection negotiation failed: client connection to 127.25.25.60:35171: connect: Connection refused (error 111)
I20260811 18:50:42.467204 17438 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.60:35171
I20260811 18:50:42.467235 17552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.60:35171 every 8 connection(s)
I20260811 18:50:42.468722 17438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-2/data/info.pb
I20260811 18:50:42.472759 17556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:50:42.476330 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 17438
I20260811 18:50:42.476552 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474012733352-25700-0/minicluster-data/master-2/wal/instance
I20260811 18:50:42.477118 25700 external_mini_cluster.cc:1428] Setting key ee518350e82a10e325289d9eda7a19a2
I20260811 18:50:42.481410 17556 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39295 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:50:42 dist-test-slave-lgr5 krb5kdc[17152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474240, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.60@KRBTEST.COM
Aug 11 18:50:42 dist-test-slave-lgr5 krb5kdc[17152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474242, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.60@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:50:42.504523 17562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.485685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52404 (local address 127.25.25.62:39295)
0811 18:50:42.486342 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:42.486349 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:42.486930 (+ 581us) server_negotiation.cc:407] Connection header received
0811 18:50:42.487380 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:42.487384 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:42.487462 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:42.487553 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:42.489401 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.490313 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.492108 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.492774 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.492973 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:42.497048 (+ 4075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:42.497057 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:42.497062 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:42.497114 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:42.500419 (+ 3305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:42.501571 (+ 1152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:42.501578 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:42.501582 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:42.501801 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:42.502367 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:42.502372 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:42.502375 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:42.502747 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:42.502960 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:42.503629 (+ 669us) server_negotiation.cc:299] Negotiation successful
0811 18:50:42.503907 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":274,"threads_started":1}
I20260811 18:50:42.505404 17561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.479453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48484 (local address 127.25.25.60:35171)
0811 18:50:42.480396 (+ 943us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:42.480410 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:42.480458 (+ 48us) server_negotiation.cc:407] Connection header received
0811 18:50:42.482296 (+ 1838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:42.482331 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:42.482867 (+ 536us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:42.483309 (+ 442us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:42.485346 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.487729 (+ 2383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.489851 (+ 2122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.490875 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.491089 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:42.496416 (+ 5327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:42.496429 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:42.496452 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:42.496502 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:42.500420 (+ 3918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:42.501569 (+ 1149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:42.501579 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:42.501582 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:42.501844 (+ 262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:42.502383 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:42.502388 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:42.502390 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:42.503128 (+ 738us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:42.503353 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:42.503814 (+ 461us) server_negotiation.cc:299] Negotiation successful
0811 18:50:42.504281 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":184,"server-negotiator.queue_time_us":704,"thread_start_us":426,"threads_started":1}
I20260811 18:50:42.505463 17564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.485680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:39295 (local address 127.0.0.1:52404)
0811 18:50:42.486714 (+ 1034us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:42.486763 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:42.486996 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:42.487743 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:42.487751 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:42.488761 (+ 1010us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:50:42.489093 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:42.489109 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.490521 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.490527 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:42.491898 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:42.491914 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.493083 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.493089 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:42.493234 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:42.493980 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:50:42.494008 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:50:42.496769 (+ 2761us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:50:42.500631 (+ 3862us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:42.500648 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:42.500663 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:42.501408 (+ 745us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:42.501976 (+ 568us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:42.501981 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:42.501985 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:42.502257 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:42.502903 (+ 646us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:50:42.502910 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:50:42.503181 (+ 271us) client_negotiation.cc:769] Sending connection context
0811 18:50:42.503528 (+ 347us) client_negotiation.cc:240] Negotiation successful
0811 18:50:42.504121 (+ 593us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":728,"spinlock_wait_cycles":17792,"thread_start_us":538,"threads_started":1}
I20260811 18:50:42.507331 17556 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:50:42 dist-test-slave-lgr5 krb5kdc[17152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474242, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.60@KRBTEST.COM for kudu/127.25.25.61@KRBTEST.COM
Aug 11 18:50:42 dist-test-slave-lgr5 krb5kdc[17152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474240, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:50:42.523131 17564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.508262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:43863 (local address 127.0.0.1:37398)
0811 18:50:42.508553 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:42.508572 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:42.508751 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:42.509132 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:42.509137 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:42.509592 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:50:42.509749 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:42.509759 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.511028 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.511034 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:42.512252 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:42.512268 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.513297 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.513304 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:42.513639 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:42.514360 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:50:42.514381 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:50:42.516897 (+ 2516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:50:42.520524 (+ 3627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:42.520529 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:42.520532 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:42.520971 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:42.521403 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:42.521407 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:42.521409 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:42.521573 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:42.522131 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:50:42.522137 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:50:42.522297 (+ 160us) client_negotiation.cc:769] Sending connection context
0811 18:50:42.522424 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 18:50:42.522748 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180}
I20260811 18:50:42.523159 17435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.508269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37398 (local address 127.25.25.61:43863)
0811 18:50:42.508485 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:42.508492 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:42.508641 (+ 149us) server_negotiation.cc:407] Connection header received
0811 18:50:42.508911 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:42.508917 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:42.508999 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:42.509075 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:42.509910 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.510867 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.512407 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.513091 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.513246 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:42.517176 (+ 3930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:42.517185 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:42.517189 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:42.517242 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:42.520355 (+ 3113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:42.521117 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:42.521123 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:42.521125 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:42.521272 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:42.521695 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:42.521699 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:42.521701 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:42.522001 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:42.522149 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:42.522557 (+ 408us) server_negotiation.cc:299] Negotiation successful
0811 18:50:42.522775 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 18:50:42.524482 17556 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:50:42.524659 17562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.508616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52412 (local address 127.25.25.62:39295)
0811 18:50:42.508776 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:42.508782 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:42.508801 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:50:42.508982 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:42.508986 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:42.509067 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:42.509165 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:42.510652 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.511640 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.513340 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.514036 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.514160 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:42.519074 (+ 4914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:42.519080 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:42.519083 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:42.519124 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:42.521759 (+ 2635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:42.522525 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:42.522530 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:42.522532 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:42.522668 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:42.523067 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:42.523071 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:42.523073 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:42.523440 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:42.523729 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:42.524058 (+ 329us) server_negotiation.cc:299] Negotiation successful
0811 18:50:42.524347 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
Aug 11 18:50:42 dist-test-slave-lgr5 krb5kdc[17152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474242, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.60@KRBTEST.COM for kudu/127.25.25.60@KRBTEST.COM
Aug 11 18:50:42 dist-test-slave-lgr5 krb5kdc[17152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474240, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.61@KRBTEST.COM
I20260811 18:50:42.538479 17561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.525320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48496 (local address 127.25.25.60:35171)
0811 18:50:42.525440 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:42.525446 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:42.525462 (+ 16us) server_negotiation.cc:407] Connection header received
0811 18:50:42.525623 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:42.525628 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:42.525682 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:42.525755 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:42.526520 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.527460 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.528670 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.529103 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.529208 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:42.532365 (+ 3157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:42.532370 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:42.532373 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:42.532404 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:42.535533 (+ 3129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:42.536333 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:42.536338 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:42.536340 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:42.536511 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:42.536972 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:42.536976 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:42.536978 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:42.537278 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:42.537392 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:42.537859 (+ 467us) server_negotiation.cc:299] Negotiation successful
0811 18:50:42.538215 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":119,"server-negotiator.queue_time_us":32}
I20260811 18:50:42.538503 17564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.525211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:35171 (local address 127.0.0.1:48496)
0811 18:50:42.525398 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:42.525417 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:42.525522 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:42.525785 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:42.525789 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:42.526190 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:50:42.526374 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:42.526388 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.527621 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.527627 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:42.528545 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:42.528559 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.529232 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.529238 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:42.529424 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:42.530028 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:50:42.530046 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:50:42.532176 (+ 2130us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:50:42.535694 (+ 3518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:42.535699 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:42.535702 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:42.536210 (+ 508us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:42.536633 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:42.536638 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:42.536641 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:42.536809 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:42.537399 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:50:42.537404 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:50:42.537588 (+ 184us) client_negotiation.cc:769] Sending connection context
0811 18:50:42.537734 (+ 146us) client_negotiation.cc:240] Negotiation successful
0811 18:50:42.538074 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 18:50:42.542223 17435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.526560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37414 (local address 127.25.25.61:43863)
0811 18:50:42.526742 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:42.526747 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:42.526807 (+ 60us) server_negotiation.cc:407] Connection header received
0811 18:50:42.526944 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:42.526949 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:42.527019 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:42.527111 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:42.528486 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.529218 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.530569 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.531016 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.531129 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:42.536032 (+ 4903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:42.536040 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:42.536046 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:42.536130 (+ 84us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:42.539285 (+ 3155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:42.540220 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:42.540225 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:42.540227 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:42.540387 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:42.540791 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:42.540796 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:42.540798 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:42.541091 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:42.541359 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:42.541673 (+ 314us) server_negotiation.cc:299] Negotiation successful
0811 18:50:42.541914 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 18:50:42.544109 17556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4: Bootstrap starting.
I20260811 18:50:42.547856 25700 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:50:42.548270 17556 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4: Neither blocks nor log segments found. Creating new log.
I20260811 18:50:42.549397 17556 log.cc:824] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4: Log is configured to *not* fsync() on all Append() calls
I20260811 18:50:42.552520 17556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4: No bootstrap required, opened a new log
I20260811 18:50:42.564638 17556 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc0602d72e84982a306f58438b0f4fc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39295 } } peers { permanent_uuid: "76c6fb308b4946138b1a5056d09e9c63" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 } } peers { permanent_uuid: "f7f05051836c44c4abe249a4c78b5da4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } }
I20260811 18:50:42.565238 17556 raft_consensus.cc:374] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:50:42.565462 17556 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7f05051836c44c4abe249a4c78b5da4, State: Initialized, Role: FOLLOWER
I20260811 18:50:42.566484 17556 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc0602d72e84982a306f58438b0f4fc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39295 } } peers { permanent_uuid: "76c6fb308b4946138b1a5056d09e9c63" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 } } peers { permanent_uuid: "f7f05051836c44c4abe249a4c78b5da4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } }
I20260811 18:50:42.571828 17435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.553366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37426 (local address 127.25.25.61:43863)
0811 18:50:42.553911 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:42.553916 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:42.553936 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:50:42.553995 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:42.554000 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:42.554075 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:42.554182 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:42.555983 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.557111 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.559342 (+ 2231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.560030 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.560182 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:42.563813 (+ 3631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:42.563819 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:42.563824 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:42.563868 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:42.567444 (+ 3576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:42.568555 (+ 1111us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:42.568562 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:42.568566 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:42.568755 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:42.569250 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:42.569256 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:42.569259 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:42.569671 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:42.569938 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:42.571123 (+ 1185us) server_negotiation.cc:299] Negotiation successful
0811 18:50:42.571411 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411}
I20260811 18:50:42.574395 17562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.553577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52426 (local address 127.25.25.62:39295)
0811 18:50:42.553750 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:42.553756 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:42.554168 (+ 412us) server_negotiation.cc:407] Connection header received
0811 18:50:42.556214 (+ 2046us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:42.556221 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:42.556305 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:42.556377 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:42.558755 (+ 2378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.559990 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.562360 (+ 2370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.563054 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.563193 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:42.566761 (+ 3568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:42.566770 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:42.566775 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:42.566838 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:42.570558 (+ 3720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:42.571806 (+ 1248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:42.571813 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:42.571816 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:42.572012 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:42.572556 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:42.572562 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:42.572565 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:42.572974 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:42.573219 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:42.573771 (+ 552us) server_negotiation.cc:299] Negotiation successful
0811 18:50:42.574040 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 18:50:42.574102 17581 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc0602d72e84982a306f58438b0f4fc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39295 } } peers { permanent_uuid: "76c6fb308b4946138b1a5056d09e9c63" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 } } peers { permanent_uuid: "f7f05051836c44c4abe249a4c78b5da4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } } }
I20260811 18:50:42.574590 17581 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:50:42.576661 17556 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:50:42.579823 17561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.554050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48508 (local address 127.25.25.60:35171)
0811 18:50:42.554231 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:42.554236 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:42.560713 (+ 6477us) server_negotiation.cc:407] Connection header received
0811 18:50:42.560921 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:42.560927 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:42.561035 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:42.561133 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:42.565593 (+ 4460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.566703 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.568743 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.569652 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.569761 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:42.573520 (+ 3759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:42.573528 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:42.573533 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:42.573578 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:42.576822 (+ 3244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:42.577535 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:42.577541 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:42.577545 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:42.577736 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:42.578193 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:42.578197 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:42.578200 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:42.578583 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:42.578864 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:42.579191 (+ 327us) server_negotiation.cc:299] Negotiation successful
0811 18:50:42.579481 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260811 18:50:42.587006 17595 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:50:42.587150 17595 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:50:42.584559 17438 master_runner.cc:186] Error getting master registration for 127.25.25.62:39295: OK, instance_id { permanent_uuid: "5fc0602d72e84982a306f58438b0f4fc" instance_seqno: 1786474241312735 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 18:50:42.594043 17438 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 18:50:42.625626 17427 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } attempt: 5
Aug 11 18:50:42 dist-test-slave-lgr5 krb5kdc[17152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474241, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.61@KRBTEST.COM for kudu/127.25.25.60@KRBTEST.COM
I20260811 18:50:42.643165 17561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.627113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48522 (local address 127.25.25.60:35171)
0811 18:50:42.627341 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:42.627347 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:42.627380 (+ 33us) server_negotiation.cc:407] Connection header received
0811 18:50:42.627437 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:42.627442 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:42.627556 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:42.627660 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:42.628786 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.629662 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.631441 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.631911 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.632014 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:42.636207 (+ 4193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:42.636215 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:42.636220 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:42.636267 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:42.639957 (+ 3690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:42.640996 (+ 1039us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:42.641001 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:42.641003 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:42.641171 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:42.641679 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:42.641683 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:42.641685 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:42.642000 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:42.642117 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:42.642655 (+ 538us) server_negotiation.cc:299] Negotiation successful
0811 18:50:42.642890 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260811 18:50:42.643209 17434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.626328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:35171 (local address 127.0.0.1:48522)
0811 18:50:42.626737 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:42.626758 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:42.626890 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:42.627738 (+ 848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:42.627744 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:42.628378 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:50:42.628605 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:42.628620 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.629832 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.629838 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:42.631256 (+ 1418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:42.631276 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.632069 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.632100 (+ 31us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:42.632332 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:42.633011 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:50:42.633036 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:50:42.635896 (+ 2860us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:50:42.640151 (+ 4255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:42.640157 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:42.640161 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:42.640847 (+ 686us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:42.641281 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:42.641286 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:42.641290 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:42.641537 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:42.642115 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:50:42.642120 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:50:42.642318 (+ 198us) client_negotiation.cc:769] Sending connection context
0811 18:50:42.642477 (+ 159us) client_negotiation.cc:240] Negotiation successful
0811 18:50:42.642810 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259}
I20260811 18:50:42.648058 17427 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76c6fb308b4946138b1a5056d09e9c63: Bootstrap starting.
I20260811 18:50:42.652299 17427 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 76c6fb308b4946138b1a5056d09e9c63: Neither blocks nor log segments found. Creating new log.
I20260811 18:50:42.653666 17427 log.cc:824] T 00000000000000000000000000000000 P 76c6fb308b4946138b1a5056d09e9c63: Log is configured to *not* fsync() on all Append() calls
I20260811 18:50:42.656574 17427 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76c6fb308b4946138b1a5056d09e9c63: No bootstrap required, opened a new log
I20260811 18:50:42.664649 17427 raft_consensus.cc:348] T 00000000000000000000000000000000 P 76c6fb308b4946138b1a5056d09e9c63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc0602d72e84982a306f58438b0f4fc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39295 } } peers { permanent_uuid: "76c6fb308b4946138b1a5056d09e9c63" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 } } peers { permanent_uuid: "f7f05051836c44c4abe249a4c78b5da4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } }
I20260811 18:50:42.665277 17427 raft_consensus.cc:374] T 00000000000000000000000000000000 P 76c6fb308b4946138b1a5056d09e9c63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:50:42.665450 17427 raft_consensus.cc:729] T 00000000000000000000000000000000 P 76c6fb308b4946138b1a5056d09e9c63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76c6fb308b4946138b1a5056d09e9c63, State: Initialized, Role: FOLLOWER
I20260811 18:50:42.666280 17427 consensus_queue.cc:260] T 00000000000000000000000000000000 P 76c6fb308b4946138b1a5056d09e9c63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc0602d72e84982a306f58438b0f4fc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39295 } } peers { permanent_uuid: "76c6fb308b4946138b1a5056d09e9c63" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 } } peers { permanent_uuid: "f7f05051836c44c4abe249a4c78b5da4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } }
I20260811 18:50:42.667279 17598 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76c6fb308b4946138b1a5056d09e9c63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc0602d72e84982a306f58438b0f4fc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39295 } } peers { permanent_uuid: "76c6fb308b4946138b1a5056d09e9c63" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 } } peers { permanent_uuid: "f7f05051836c44c4abe249a4c78b5da4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } } }
I20260811 18:50:42.667701 17598 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76c6fb308b4946138b1a5056d09e9c63 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:50:42.668671 17427 sys_catalog.cc:564] T 00000000000000000000000000000000 P 76c6fb308b4946138b1a5056d09e9c63 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 18:50:42.679540 17619 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 76c6fb308b4946138b1a5056d09e9c63: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:50:42.679883 17619 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:50:42.676326 17312 master_runner.cc:186] Error getting master registration for 127.25.25.62:39295: OK, instance_id { permanent_uuid: "5fc0602d72e84982a306f58438b0f4fc" instance_seqno: 1786474241312735 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 18:50:42.688392 17312 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 18:50:42.699821 17476 tablet.cc:2369] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:50:42.743103 17304 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } attempt: 5
Aug 11 18:50:42 dist-test-slave-lgr5 krb5kdc[17152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474241, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for kudu/127.25.25.60@KRBTEST.COM
I20260811 18:50:42.757071 17581 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:50:42.757547 17581 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc0602d72e84982a306f58438b0f4fc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39295 } } peers { permanent_uuid: "76c6fb308b4946138b1a5056d09e9c63" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 } } peers { permanent_uuid: "f7f05051836c44c4abe249a4c78b5da4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } }
I20260811 18:50:42.759502 17581 leader_election.cc:288] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5fc0602d72e84982a306f58438b0f4fc (127.25.25.62:39295), 76c6fb308b4946138b1a5056d09e9c63 (127.25.25.61:43863)
I20260811 18:50:42.761087 17380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f7f05051836c44c4abe249a4c78b5da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76c6fb308b4946138b1a5056d09e9c63" is_pre_election: true
I20260811 18:50:42.761842 17380 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 76c6fb308b4946138b1a5056d09e9c63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7f05051836c44c4abe249a4c78b5da4 in term 0.
I20260811 18:50:42.762691 17467 leader_election.cc:302] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76c6fb308b4946138b1a5056d09e9c63, f7f05051836c44c4abe249a4c78b5da4; no voters:
I20260811 18:50:42.763458 17581 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:50:42.763650 17581 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:50:42.763753 17581 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:50:42.767387 17581 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc0602d72e84982a306f58438b0f4fc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39295 } } peers { permanent_uuid: "76c6fb308b4946138b1a5056d09e9c63" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 } } peers { permanent_uuid: "f7f05051836c44c4abe249a4c78b5da4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } }
I20260811 18:50:42.769764 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.744069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:35171 (local address 127.0.0.1:48530)
0811 18:50:42.744464 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:42.744487 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:42.744661 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:42.745120 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:42.745126 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:42.745697 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:50:42.745926 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:42.745941 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.747709 (+ 1768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.747716 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:42.749485 (+ 1769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:42.749515 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.750972 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.750981 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:42.751193 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:42.751996 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:50:42.752027 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:50:42.756390 (+ 4363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:50:42.761786 (+ 5396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:42.761792 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:42.761797 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:42.762448 (+ 651us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:42.764881 (+ 2433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:42.764888 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:42.764893 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:42.765363 (+ 470us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:42.766693 (+ 1330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:50:42.766699 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:50:42.767011 (+ 312us) client_negotiation.cc:769] Sending connection context
0811 18:50:42.767225 (+ 214us) client_negotiation.cc:240] Negotiation successful
0811 18:50:42.768218 (+ 993us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214}
I20260811 18:50:42.770363 17380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f7f05051836c44c4abe249a4c78b5da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76c6fb308b4946138b1a5056d09e9c63"
I20260811 18:50:42.770618 17561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:42.744104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48530 (local address 127.25.25.60:35171)
0811 18:50:42.744325 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:42.744331 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:42.744622 (+ 291us) server_negotiation.cc:407] Connection header received
0811 18:50:42.744807 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:42.744813 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:42.744915 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:42.745061 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:42.746133 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.747414 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.749780 (+ 2366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:42.750695 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:42.750852 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:42.756701 (+ 5849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:42.756710 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:42.756716 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:42.756768 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:42.761542 (+ 4774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:42.762631 (+ 1089us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:42.762639 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:42.762643 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:42.764605 (+ 1962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:42.765617 (+ 1012us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:42.765625 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:42.765629 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:42.766490 (+ 861us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:42.767858 (+ 1368us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:42.768406 (+ 548us) server_negotiation.cc:299] Negotiation successful
0811 18:50:42.769570 (+ 1164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 18:50:42.770656 17380 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 76c6fb308b4946138b1a5056d09e9c63 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:50:42.774598 17380 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 76c6fb308b4946138b1a5056d09e9c63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7f05051836c44c4abe249a4c78b5da4 in term 1.
I20260811 18:50:42.775264 17467 leader_election.cc:302] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76c6fb308b4946138b1a5056d09e9c63, f7f05051836c44c4abe249a4c78b5da4; no voters:
I20260811 18:50:42.783851 17304 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5fc0602d72e84982a306f58438b0f4fc: Bootstrap starting.
I20260811 18:50:42.793875 17581 leader_election.cc:288] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [CANDIDATE]: Term 1 election: Requested vote from peers 5fc0602d72e84982a306f58438b0f4fc (127.25.25.62:39295), 76c6fb308b4946138b1a5056d09e9c63 (127.25.25.61:43863)
I20260811 18:50:42.794643 17581 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:50:42.794845 17581 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [term 1 LEADER]: Becoming Leader. State: Replica: f7f05051836c44c4abe249a4c78b5da4, State: Running, Role: LEADER
I20260811 18:50:42.795575 17581 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc0602d72e84982a306f58438b0f4fc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39295 } } peers { permanent_uuid: "76c6fb308b4946138b1a5056d09e9c63" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 } } peers { permanent_uuid: "f7f05051836c44c4abe249a4c78b5da4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } }
I20260811 18:50:42.800403 17304 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5fc0602d72e84982a306f58438b0f4fc: Neither blocks nor log segments found. Creating new log.
I20260811 18:50:42.805935 17624 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7f05051836c44c4abe249a4c78b5da4. Latest consensus state: current_term: 1 leader_uuid: "f7f05051836c44c4abe249a4c78b5da4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc0602d72e84982a306f58438b0f4fc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39295 } } peers { permanent_uuid: "76c6fb308b4946138b1a5056d09e9c63" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 } } peers { permanent_uuid: "f7f05051836c44c4abe249a4c78b5da4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } } }
I20260811 18:50:42.806473 17624 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [sys.catalog]: This master's current role is: LEADER
I20260811 18:50:42.807354 17304 log.cc:824] T 00000000000000000000000000000000 P 5fc0602d72e84982a306f58438b0f4fc: Log is configured to *not* fsync() on all Append() calls
I20260811 18:50:42.818322 17304 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5fc0602d72e84982a306f58438b0f4fc: No bootstrap required, opened a new log
I20260811 18:50:42.819172 17627 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:50:42.821698 17627 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:50:42.835316 17304 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5fc0602d72e84982a306f58438b0f4fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc0602d72e84982a306f58438b0f4fc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39295 } } peers { permanent_uuid: "76c6fb308b4946138b1a5056d09e9c63" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 } } peers { permanent_uuid: "f7f05051836c44c4abe249a4c78b5da4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } }
I20260811 18:50:42.835816 17304 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5fc0602d72e84982a306f58438b0f4fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:50:42.835963 17304 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5fc0602d72e84982a306f58438b0f4fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fc0602d72e84982a306f58438b0f4fc, State: Initialized, Role: FOLLOWER
I20260811 18:50:42.840521 17304 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5fc0602d72e84982a306f58438b0f4fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc0602d72e84982a306f58438b0f4fc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39295 } } peers { permanent_uuid: "76c6fb308b4946138b1a5056d09e9c63" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 } } peers { permanent_uuid: "f7f05051836c44c4abe249a4c78b5da4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } }
I20260811 18:50:42.850291 17380 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 76c6fb308b4946138b1a5056d09e9c63 [term 1 FOLLOWER]: Refusing update from remote peer f7f05051836c44c4abe249a4c78b5da4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:50:42.851691 17581 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76c6fb308b4946138b1a5056d09e9c63" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:50:42.854773 17240 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5fc0602d72e84982a306f58438b0f4fc [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:50:42.854825 17304 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5fc0602d72e84982a306f58438b0f4fc [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:50:42.859830 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f7f05051836c44c4abe249a4c78b5da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fc0602d72e84982a306f58438b0f4fc"
I20260811 18:50:42.859225 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f7f05051836c44c4abe249a4c78b5da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fc0602d72e84982a306f58438b0f4fc" is_pre_election: true
I20260811 18:50:42.861649 17240 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5fc0602d72e84982a306f58438b0f4fc [term 1 FOLLOWER]: Refusing update from remote peer f7f05051836c44c4abe249a4c78b5da4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:50:42.862746 17581 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fc0602d72e84982a306f58438b0f4fc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:50:42.847959 17634 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5fc0602d72e84982a306f58438b0f4fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc0602d72e84982a306f58438b0f4fc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39295 } } peers { permanent_uuid: "76c6fb308b4946138b1a5056d09e9c63" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 } } peers { permanent_uuid: "f7f05051836c44c4abe249a4c78b5da4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } } }
I20260811 18:50:42.869758 17634 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5fc0602d72e84982a306f58438b0f4fc [sys.catalog]: This master's current role is: FOLLOWER
W20260811 18:50:42.880242 17342 tablet.cc:2369] T 00000000000000000000000000000000 P 76c6fb308b4946138b1a5056d09e9c63: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:50:42.888134 17598 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76c6fb308b4946138b1a5056d09e9c63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7f05051836c44c4abe249a4c78b5da4. Latest consensus state: current_term: 1 leader_uuid: "f7f05051836c44c4abe249a4c78b5da4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc0602d72e84982a306f58438b0f4fc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39295 } } peers { permanent_uuid: "76c6fb308b4946138b1a5056d09e9c63" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 } } peers { permanent_uuid: "f7f05051836c44c4abe249a4c78b5da4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } } }
I20260811 18:50:42.888536 17598 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76c6fb308b4946138b1a5056d09e9c63 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:50:42.892053 17631 mvcc.cc:205] Tried to move back new op lower bound from 7317398498694983680 to 7317398498522046464. Current Snapshot: MvccSnapshot[applied={T|T < 7317398498694983680}]
I20260811 18:50:42.906733 17598 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76c6fb308b4946138b1a5056d09e9c63 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f7f05051836c44c4abe249a4c78b5da4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc0602d72e84982a306f58438b0f4fc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39295 } } peers { permanent_uuid: "76c6fb308b4946138b1a5056d09e9c63" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 } } peers { permanent_uuid: "f7f05051836c44c4abe249a4c78b5da4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } } }
I20260811 18:50:42.907073 17598 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76c6fb308b4946138b1a5056d09e9c63 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:50:42.911144 17634 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5fc0602d72e84982a306f58438b0f4fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7f05051836c44c4abe249a4c78b5da4. Latest consensus state: current_term: 1 leader_uuid: "f7f05051836c44c4abe249a4c78b5da4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc0602d72e84982a306f58438b0f4fc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39295 } } peers { permanent_uuid: "76c6fb308b4946138b1a5056d09e9c63" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 } } peers { permanent_uuid: "f7f05051836c44c4abe249a4c78b5da4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } } }
I20260811 18:50:42.911553 17634 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5fc0602d72e84982a306f58438b0f4fc [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:50:42.920014 17581 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f7f05051836c44c4abe249a4c78b5da4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc0602d72e84982a306f58438b0f4fc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39295 } } peers { permanent_uuid: "76c6fb308b4946138b1a5056d09e9c63" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 } } peers { permanent_uuid: "f7f05051836c44c4abe249a4c78b5da4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } } }
I20260811 18:50:42.920455 17581 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [sys.catalog]: This master's current role is: LEADER
I20260811 18:50:42.927975 17627 catalog_manager.cc:1347] Generated new cluster ID: 2548ea949edf4d358871ca05a116fdfc
I20260811 18:50:42.928133 17627 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:50:42.929199 17624 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f7f05051836c44c4abe249a4c78b5da4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc0602d72e84982a306f58438b0f4fc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39295 } } peers { permanent_uuid: "76c6fb308b4946138b1a5056d09e9c63" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 } } peers { permanent_uuid: "f7f05051836c44c4abe249a4c78b5da4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } } }
I20260811 18:50:42.929492 17624 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4 [sys.catalog]: This master's current role is: LEADER
I20260811 18:50:42.936275 17646 mvcc.cc:205] Tried to move back new op lower bound from 7317398498694983680 to 7317398498522046464. Current Snapshot: MvccSnapshot[applied={T|T < 7317398498694983680}]
I20260811 18:50:42.952602 17634 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5fc0602d72e84982a306f58438b0f4fc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f7f05051836c44c4abe249a4c78b5da4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc0602d72e84982a306f58438b0f4fc" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39295 } } peers { permanent_uuid: "76c6fb308b4946138b1a5056d09e9c63" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 43863 } } peers { permanent_uuid: "f7f05051836c44c4abe249a4c78b5da4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 35171 } } }
I20260811 18:50:42.952976 17634 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5fc0602d72e84982a306f58438b0f4fc [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:50:42.979486 17627 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:50:42.986452 17627 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:50:43.039489 17663 catalog_manager.cc:1259] Loaded cluster ID: 2548ea949edf4d358871ca05a116fdfc
I20260811 18:50:43.039600 17663 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5fc0602d72e84982a306f58438b0f4fc: loading cluster ID for follower catalog manager: success
I20260811 18:50:43.044623 17663 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5fc0602d72e84982a306f58438b0f4fc: acquiring CA information for follower catalog manager: success
W20260811 18:50:43.046110 17663 catalog_manager.cc:873] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
I20260811 18:50:43.053920 17627 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f7f05051836c44c4abe249a4c78b5da4: Generated new TSK 0
I20260811 18:50:43.055328 17627 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:50:43.682147 17619 catalog_manager.cc:1259] Loaded cluster ID: 2548ea949edf4d358871ca05a116fdfc
I20260811 18:50:43.682260 17619 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 76c6fb308b4946138b1a5056d09e9c63: loading cluster ID for follower catalog manager: success
I20260811 18:50:43.684978 17619 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 76c6fb308b4946138b1a5056d09e9c63: acquiring CA information for follower catalog manager: success
I20260811 18:50:43.687074 17619 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 76c6fb308b4946138b1a5056d09e9c63: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 18:50:44.049235 17663 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5fc0602d72e84982a306f58438b0f4fc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 18:50:44.187270 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 17176
I20260811 18:50:44.189251 17291 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:50:44.303941 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 17176
I20260811 18:50:44.338222 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 17312
I20260811 18:50:44.339396 17420 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:50:44.452740 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 17312
I20260811 18:50:44.486928 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 17438
I20260811 18:50:44.488179 17543 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:50:44.600477 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 17438
2026-08-11T18:50:44Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5435 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:50:44 dist-test-slave-lgr5 krb5kdc[17680](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:50:44 dist-test-slave-lgr5 krb5kdc[17680](info): set up 2 sockets
Aug 11 18:50:44 dist-test-slave-lgr5 krb5kdc[17680](info): commencing operation
krb5kdc: starting...
W20260811 18:50:45.916806 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.261s user 0.006s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:50:46 dist-test-slave-lgr5 krb5kdc[17680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474246, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:50:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:50:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:50:46.240613 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:39007
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:37085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:39007
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:50:46.608695 17699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:50:46.609026 17699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:50:46.609163 17699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:50:46.616937 17699 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:50:46.617079 17699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:50:46.617136 17699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:50:46.617219 17699 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:50:46.617276 17699 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:50:46.628633 17699 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:37085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:39007
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:39007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:50:46.630254 17699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:50:46.631805 17699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:50:46.644802 17708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:46.644868 17715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:46.644809 17709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:50:46.646006 17699 server_base.cc:1034] running on GCE node
I20260811 18:50:46.646994 17699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:50:46.648936 17699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:50:46.650219 17699 hybrid_clock.cc:648] HybridClock initialized: now 1786474246650159 us; error 63 us; skew 500 ppm
I20260811 18:50:46.650631 17699 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:50:46 dist-test-slave-lgr5 krb5kdc[17680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474246, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:50:46.659633 17699 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:50:46.661589 17699 webserver.cc:460] Webserver started at http://127.25.25.62:36381/ using document root <none> and password file <none>
I20260811 18:50:46.662407 17699 fs_manager.cc:359] Metadata directory not provided
I20260811 18:50:46.662546 17699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:50:46.662885 17699 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:50:46.666352 17699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "ee7f2f04bf3c480cb81e2e6e30cc24ea"
format_stamp: "Formatted at 2026-08-11 18:50:46 on dist-test-slave-lgr5"
server_key: "73950ed638fdab496085f319e246c395"
server_key_iv: "9df1b9497986c839df19a11f425939b9"
server_key_version: "encryptionkey@0"
I20260811 18:50:46.667227 17699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "ee7f2f04bf3c480cb81e2e6e30cc24ea"
format_stamp: "Formatted at 2026-08-11 18:50:46 on dist-test-slave-lgr5"
server_key: "73950ed638fdab496085f319e246c395"
server_key_iv: "9df1b9497986c839df19a11f425939b9"
server_key_version: "encryptionkey@0"
I20260811 18:50:46.673344 17699 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 18:50:46.678085 17724 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:46.679991 17699 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 18:50:46.680279 17699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "ee7f2f04bf3c480cb81e2e6e30cc24ea"
format_stamp: "Formatted at 2026-08-11 18:50:46 on dist-test-slave-lgr5"
server_key: "73950ed638fdab496085f319e246c395"
server_key_iv: "9df1b9497986c839df19a11f425939b9"
server_key_version: "encryptionkey@0"
I20260811 18:50:46.680539 17699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:50:46.709174 17699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:50:46.714567 17699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:50:46.714906 17699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:50:46.735769 17699 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:39007
I20260811 18:50:46.735821 17822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:39007 every 8 connection(s)
I20260811 18:50:46.737324 17699 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:50:46.741664 17824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:50:46.743374 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 17699
I20260811 18:50:46.743615 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:50:46.744527 25700 external_mini_cluster.cc:1428] Setting key 59bf24fc12d781634aafd933c86ce9bf
I20260811 18:50:46.755754 17824 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee7f2f04bf3c480cb81e2e6e30cc24ea: Bootstrap starting.
I20260811 18:50:46.760277 17824 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee7f2f04bf3c480cb81e2e6e30cc24ea: Neither blocks nor log segments found. Creating new log.
Aug 11 18:50:46 dist-test-slave-lgr5 krb5kdc[17680](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474246, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:50:46.761754 17824 log.cc:824] T 00000000000000000000000000000000 P ee7f2f04bf3c480cb81e2e6e30cc24ea: Log is configured to *not* fsync() on all Append() calls
I20260811 18:50:46.765365 17824 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee7f2f04bf3c480cb81e2e6e30cc24ea: No bootstrap required, opened a new log
I20260811 18:50:46.771601 17827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:46.746822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45432 (local address 127.25.25.62:39007)
0811 18:50:46.747975 (+ 1153us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:46.747989 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:46.748044 (+ 55us) server_negotiation.cc:407] Connection header received
0811 18:50:46.750059 (+ 2015us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:46.750089 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:46.750545 (+ 456us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:46.750938 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:46.753213 (+ 2275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:46.754721 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:46.756805 (+ 2084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:46.757631 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:46.757801 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:46.763273 (+ 5472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:46.763287 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:46.763314 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:46.763369 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:46.766583 (+ 3214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:46.767671 (+ 1088us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:46.767679 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:46.767687 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:46.767909 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:46.768398 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:46.768404 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:46.768407 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:46.769118 (+ 711us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:46.769439 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:46.769972 (+ 533us) server_negotiation.cc:299] Negotiation successful
0811 18:50:46.770460 (+ 488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":814,"thread_start_us":496,"threads_started":1}
I20260811 18:50:46.774255 17824 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee7f2f04bf3c480cb81e2e6e30cc24ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee7f2f04bf3c480cb81e2e6e30cc24ea" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39007 } }
I20260811 18:50:46.774642 17824 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee7f2f04bf3c480cb81e2e6e30cc24ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:50:46.774768 17824 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee7f2f04bf3c480cb81e2e6e30cc24ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee7f2f04bf3c480cb81e2e6e30cc24ea, State: Initialized, Role: FOLLOWER
I20260811 18:50:46.775398 17824 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee7f2f04bf3c480cb81e2e6e30cc24ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee7f2f04bf3c480cb81e2e6e30cc24ea" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39007 } }
I20260811 18:50:46.775666 25700 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:50:46.775676 17824 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee7f2f04bf3c480cb81e2e6e30cc24ea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:50:46.775838 17824 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee7f2f04bf3c480cb81e2e6e30cc24ea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:50:46.775992 17824 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee7f2f04bf3c480cb81e2e6e30cc24ea [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:50:46.778367 17824 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee7f2f04bf3c480cb81e2e6e30cc24ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee7f2f04bf3c480cb81e2e6e30cc24ea" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39007 } }
I20260811 18:50:46.778920 17824 leader_election.cc:302] T 00000000000000000000000000000000 P ee7f2f04bf3c480cb81e2e6e30cc24ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee7f2f04bf3c480cb81e2e6e30cc24ea; no voters:
I20260811 18:50:46.779584 17824 leader_election.cc:288] T 00000000000000000000000000000000 P ee7f2f04bf3c480cb81e2e6e30cc24ea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:50:46.779711 17830 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee7f2f04bf3c480cb81e2e6e30cc24ea [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:50:46.780396 17830 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee7f2f04bf3c480cb81e2e6e30cc24ea [term 1 LEADER]: Becoming Leader. State: Replica: ee7f2f04bf3c480cb81e2e6e30cc24ea, State: Running, Role: LEADER
I20260811 18:50:46.780974 17830 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee7f2f04bf3c480cb81e2e6e30cc24ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee7f2f04bf3c480cb81e2e6e30cc24ea" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39007 } }
I20260811 18:50:46.781687 17824 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee7f2f04bf3c480cb81e2e6e30cc24ea [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:50:46.783978 17832 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee7f2f04bf3c480cb81e2e6e30cc24ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee7f2f04bf3c480cb81e2e6e30cc24ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee7f2f04bf3c480cb81e2e6e30cc24ea" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39007 } } }
I20260811 18:50:46.784457 17832 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee7f2f04bf3c480cb81e2e6e30cc24ea [sys.catalog]: This master's current role is: LEADER
I20260811 18:50:46.785050 17835 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee7f2f04bf3c480cb81e2e6e30cc24ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee7f2f04bf3c480cb81e2e6e30cc24ea. Latest consensus state: current_term: 1 leader_uuid: "ee7f2f04bf3c480cb81e2e6e30cc24ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee7f2f04bf3c480cb81e2e6e30cc24ea" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 39007 } } }
I20260811 18:50:46.785403 17835 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee7f2f04bf3c480cb81e2e6e30cc24ea [sys.catalog]: This master's current role is: LEADER
I20260811 18:50:46.789479 17848 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:50:46.794595 17848 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:50:46.804822 17848 catalog_manager.cc:1347] Generated new cluster ID: d1e1acc67b564331ad7bcb033e9b9e3f
I20260811 18:50:46.804981 17848 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:50:46.823412 17848 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:50:46.824941 17848 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:50:46.832496 17848 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee7f2f04bf3c480cb81e2e6e30cc24ea: Generated new TSK 0
I20260811 18:50:46.833443 17848 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:50:46.889338 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 17699
I20260811 18:50:46.890636 17816 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:50:46.990579 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 17699
2026-08-11T18:50:47Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2382 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:50:47 dist-test-slave-lgr5 krb5kdc[17873](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:50:47 dist-test-slave-lgr5 krb5kdc[17873](info): set up 2 sockets
Aug 11 18:50:47 dist-test-slave-lgr5 krb5kdc[17873](info): commencing operation
krb5kdc: starting...
W20260811 18:50:48.300912 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.263s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:50:48 dist-test-slave-lgr5 krb5kdc[17873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:50:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:50:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:50:48.624300 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:42917
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:44237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:42917
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:50:48.987057 17902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:50:48.987417 17902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:50:48.987543 17902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:50:48.995244 17902 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:50:48.995412 17902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:50:48.995493 17902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:50:48.995572 17902 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:50:48.995625 17902 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:50:49.006911 17902 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:44237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:42917
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:42917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:50:49.008517 17902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:50:49.010003 17902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:50:49.023294 17915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:49.023612 17918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:49.023864 17912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:50:49.025847 17902 server_base.cc:1034] running on GCE node
I20260811 18:50:49.026804 17902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:50:49.028586 17902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:50:49.029866 17902 hybrid_clock.cc:648] HybridClock initialized: now 1786474249029806 us; error 51 us; skew 500 ppm
I20260811 18:50:49.030311 17902 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:50:49 dist-test-slave-lgr5 krb5kdc[17873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474249, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:50:49.033972 17902 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:50:49.035714 17902 webserver.cc:460] Webserver started at http://127.25.25.62:35163/ using document root <none> and password file <none>
I20260811 18:50:49.036512 17902 fs_manager.cc:359] Metadata directory not provided
I20260811 18:50:49.036628 17902 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:50:49.036973 17902 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:50:49.040390 17902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "9567f2f2049744a8a0f2239c663d36ac"
format_stamp: "Formatted at 2026-08-11 18:50:49 on dist-test-slave-lgr5"
server_key: "aaaa9472bc1a20254b4e14627a4c8e1c"
server_key_iv: "dae1bc19c0805d825286799e5acbe799"
server_key_version: "encryptionkey@0"
I20260811 18:50:49.041224 17902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "9567f2f2049744a8a0f2239c663d36ac"
format_stamp: "Formatted at 2026-08-11 18:50:49 on dist-test-slave-lgr5"
server_key: "aaaa9472bc1a20254b4e14627a4c8e1c"
server_key_iv: "dae1bc19c0805d825286799e5acbe799"
server_key_version: "encryptionkey@0"
I20260811 18:50:49.047179 17902 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260811 18:50:49.051344 17929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:49.053212 17902 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 18:50:49.053472 17902 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "9567f2f2049744a8a0f2239c663d36ac"
format_stamp: "Formatted at 2026-08-11 18:50:49 on dist-test-slave-lgr5"
server_key: "aaaa9472bc1a20254b4e14627a4c8e1c"
server_key_iv: "dae1bc19c0805d825286799e5acbe799"
server_key_version: "encryptionkey@0"
I20260811 18:50:49.053738 17902 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:50:49.080830 17902 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:50:49.085683 17902 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:50:49.085985 17902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:50:49.107801 17902 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:42917
I20260811 18:50:49.107812 18028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:42917 every 8 connection(s)
I20260811 18:50:49.109496 17902 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:50:49.114013 18029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:50:49.116034 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 17902
I20260811 18:50:49.116307 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:50:49.116998 25700 external_mini_cluster.cc:1428] Setting key 8080be5896300a0f61643e485066a436
I20260811 18:50:49.128595 18029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac: Bootstrap starting.
I20260811 18:50:49.132624 18029 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac: Neither blocks nor log segments found. Creating new log.
I20260811 18:50:49.133726 18029 log.cc:824] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac: Log is configured to *not* fsync() on all Append() calls
Aug 11 18:50:49 dist-test-slave-lgr5 krb5kdc[17873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:50:49.137063 18029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac: No bootstrap required, opened a new log
I20260811 18:50:49.143746 18036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:49.119441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39942 (local address 127.25.25.62:42917)
0811 18:50:49.120434 (+ 993us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:49.120453 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:49.120517 (+ 64us) server_negotiation.cc:407] Connection header received
0811 18:50:49.122972 (+ 2455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:49.123010 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:49.123642 (+ 632us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:49.124232 (+ 590us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:49.125836 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:49.127890 (+ 2054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:49.129474 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:49.130590 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:49.130819 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:49.135337 (+ 4518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:49.135348 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:49.135373 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:49.135421 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:49.138566 (+ 3145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:49.139688 (+ 1122us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:49.139697 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:49.139705 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:49.139953 (+ 248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:49.140564 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:49.140569 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:49.140574 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:49.141247 (+ 673us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:49.141532 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:49.142019 (+ 487us) server_negotiation.cc:299] Negotiation successful
0811 18:50:49.142562 (+ 543us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":711,"thread_start_us":361,"threads_started":1}
I20260811 18:50:49.146459 18029 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9567f2f2049744a8a0f2239c663d36ac" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42917 } }
I20260811 18:50:49.146903 18029 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:50:49.147024 18029 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9567f2f2049744a8a0f2239c663d36ac, State: Initialized, Role: FOLLOWER
I20260811 18:50:49.147644 18029 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9567f2f2049744a8a0f2239c663d36ac" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42917 } }
I20260811 18:50:49.147903 18029 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:50:49.148286 18029 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:50:49.148521 18029 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:50:49.150976 18029 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9567f2f2049744a8a0f2239c663d36ac" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42917 } }
I20260811 18:50:49.151592 18029 leader_election.cc:302] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9567f2f2049744a8a0f2239c663d36ac; no voters:
I20260811 18:50:49.152375 18029 leader_election.cc:288] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:50:49.152513 18041 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:50:49.153313 18041 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [term 1 LEADER]: Becoming Leader. State: Replica: 9567f2f2049744a8a0f2239c663d36ac, State: Running, Role: LEADER
I20260811 18:50:49.153971 18041 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9567f2f2049744a8a0f2239c663d36ac" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42917 } }
I20260811 18:50:49.154664 18029 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:50:49.156876 18043 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9567f2f2049744a8a0f2239c663d36ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9567f2f2049744a8a0f2239c663d36ac" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42917 } } }
I20260811 18:50:49.157405 18043 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [sys.catalog]: This master's current role is: LEADER
I20260811 18:50:49.157415 18046 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9567f2f2049744a8a0f2239c663d36ac. Latest consensus state: current_term: 1 leader_uuid: "9567f2f2049744a8a0f2239c663d36ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9567f2f2049744a8a0f2239c663d36ac" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42917 } } }
I20260811 18:50:49.158775 18046 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [sys.catalog]: This master's current role is: LEADER
I20260811 18:50:49.161422 18050 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:50:49.167181 18050 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:50:49.175902 18050 catalog_manager.cc:1347] Generated new cluster ID: 878a0dc0c0b4465ebe9b180d2333f4d3
I20260811 18:50:49.176043 18050 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:50:49.204952 18050 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:50:49.206719 18050 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:50:49.217363 18050 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac: Generated new TSK 0
I20260811 18:50:49.218366 18050 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.25.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
I20260811 18:50:49.307047 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:0
--local_ip_for_outbound_sockets=127.25.25.1
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:42917
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:44237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:50:49.694442 18080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:50:49.694756 18080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:50:49.694881 18080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:50:49.702927 18080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:50:49.703094 18080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:50:49.703258 18080 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:50:49.714231 18080 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:44237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:42917
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:50:49.715765 18080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:50:49.717689 18080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:50:49.733397 18087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:49.733559 18099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:49.733566 18094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:50:49.734683 18080 server_base.cc:1034] running on GCE node
I20260811 18:50:49.735430 18080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:50:49.736608 18080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:50:49.737872 18080 hybrid_clock.cc:648] HybridClock initialized: now 1786474249737811 us; error 43 us; skew 500 ppm
I20260811 18:50:49.738260 18080 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:50:49 dist-test-slave-lgr5 krb5kdc[17873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474249, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:50:49.741954 18080 init.cc:377] Logged in from keytab as kudu/127.25.25.1@KRBTEST.COM (short username kudu)
I20260811 18:50:49.743804 18080 webserver.cc:460] Webserver started at http://127.25.25.1:35461/ using document root <none> and password file <none>
I20260811 18:50:49.744644 18080 fs_manager.cc:359] Metadata directory not provided
I20260811 18:50:49.744760 18080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:50:49.745048 18080 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:50:49.748173 18080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/data/instance:
uuid: "6cc791c6040c468491720b1d49ab2eab"
format_stamp: "Formatted at 2026-08-11 18:50:49 on dist-test-slave-lgr5"
server_key: "ec3d38c8aeb17709c9b0ca84982359a7"
server_key_iv: "fdba48f9de9e3c90865a54bd5ce0fd16"
server_key_version: "encryptionkey@0"
I20260811 18:50:49.749028 18080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance:
uuid: "6cc791c6040c468491720b1d49ab2eab"
format_stamp: "Formatted at 2026-08-11 18:50:49 on dist-test-slave-lgr5"
server_key: "ec3d38c8aeb17709c9b0ca84982359a7"
server_key_iv: "fdba48f9de9e3c90865a54bd5ce0fd16"
server_key_version: "encryptionkey@0"
I20260811 18:50:49.754645 18080 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 18:50:49.758685 18111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:49.760493 18080 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:50:49.760686 18080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "6cc791c6040c468491720b1d49ab2eab"
format_stamp: "Formatted at 2026-08-11 18:50:49 on dist-test-slave-lgr5"
server_key: "ec3d38c8aeb17709c9b0ca84982359a7"
server_key_iv: "fdba48f9de9e3c90865a54bd5ce0fd16"
server_key_version: "encryptionkey@0"
I20260811 18:50:49.760900 18080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:50:49.794839 18080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:50:49.800251 18080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:50:49.800581 18080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:50:49.801787 18080 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:50:49.803514 18080 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:50:49.803610 18080 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:49.803714 18080 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:50:49.803794 18080 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:49.839924 18080 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:43305
I20260811 18:50:49.839962 18308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:43305 every 8 connection(s)
I20260811 18:50:49.841531 18080 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:50:49.851037 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 18080
I20260811 18:50:49.851243 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance
I20260811 18:50:49.851933 25700 external_mini_cluster.cc:1428] Setting key c61712e2849b5d23e39ae0aeb209738d
Aug 11 18:50:49 dist-test-slave-lgr5 krb5kdc[17873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474249, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:50:49.863497 18312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:49.844542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:46749 (local address 127.25.25.62:42917)
0811 18:50:49.845047 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:49.845052 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:49.846099 (+ 1047us) server_negotiation.cc:407] Connection header received
0811 18:50:49.848031 (+ 1932us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:49.848037 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:49.848162 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:49.848266 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:49.849934 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:49.850679 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:49.852475 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:49.852886 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:49.853013 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:49.856969 (+ 3956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:49.856975 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:49.856978 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:49.857018 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:49.859832 (+ 2814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:49.860742 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:49.860748 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:49.860750 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:49.860881 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:49.861363 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:49.861367 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:49.861369 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:49.861701 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:49.861864 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:49.862826 (+ 962us) server_negotiation.cc:299] Negotiation successful
0811 18:50:49.863113 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":285,"threads_started":1}
I20260811 18:50:49.864766 18313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:49.845091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.1:46749)
0811 18:50:49.845903 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:49.845956 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:49.847705 (+ 1749us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:49.848554 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:49.848564 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:49.849129 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:50:49.849737 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:49.849757 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:49.850848 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:49.850852 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:49.852307 (+ 1455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:49.852323 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:49.853137 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:49.853145 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:49.853413 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:49.854095 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:50:49.854121 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:50:49.856692 (+ 2571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:50:49.860018 (+ 3326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:49.860030 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:49.860047 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:49.860595 (+ 548us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:49.861002 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:49.861008 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:49.861012 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:49.861232 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:49.861845 (+ 613us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:50:49.861853 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:50:49.862274 (+ 421us) client_negotiation.cc:769] Sending connection context
0811 18:50:49.862603 (+ 329us) client_negotiation.cc:240] Negotiation successful
0811 18:50:49.863347 (+ 744us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":320,"threads_started":1}
I20260811 18:50:49.866796 18309 heartbeater.cc:347] Connected to a master server at 127.25.25.62:42917
I20260811 18:50:49.867218 18309 heartbeater.cc:464] Registering TS with master...
I20260811 18:50:49.868254 18309 heartbeater.cc:511] Master 127.25.25.62:42917 requested a full tablet report, sending...
I20260811 18:50:49.871129 17970 ts_manager.cc:194] Registered new tserver with Master: 6cc791c6040c468491720b1d49ab2eab (127.25.25.1:43305)
I20260811 18:50:49.873329 17970 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.1@KRBTEST.COM'} at 127.25.25.1:46749
WARNING: no policy specified for kudu/127.25.25.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
I20260811 18:50:49.919811 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:0
--local_ip_for_outbound_sockets=127.25.25.2
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:42917
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:44237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:50:50.290097 18317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:50:50.290418 18317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:50:50.290527 18317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:50:50.298990 18317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:50:50.299165 18317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:50:50.299360 18317 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:50:50.310247 18317 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:44237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:42917
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:50:50.311672 18317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:50:50.313225 18317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:50:50.328495 18325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:50.328578 18328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:50.328715 18324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:50:50.330091 18317 server_base.cc:1034] running on GCE node
I20260811 18:50:50.330832 18317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:50:50.332012 18317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:50:50.333334 18317 hybrid_clock.cc:648] HybridClock initialized: now 1786474250333246 us; error 76 us; skew 500 ppm
I20260811 18:50:50.333757 18317 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:50:50 dist-test-slave-lgr5 krb5kdc[17873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474250, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:50:50.337464 18317 init.cc:377] Logged in from keytab as kudu/127.25.25.2@KRBTEST.COM (short username kudu)
I20260811 18:50:50.339416 18317 webserver.cc:460] Webserver started at http://127.25.25.2:35699/ using document root <none> and password file <none>
I20260811 18:50:50.340401 18317 fs_manager.cc:359] Metadata directory not provided
I20260811 18:50:50.340582 18317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:50:50.340955 18317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:50:50.344516 18317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/data/instance:
uuid: "f67291534f6e47de982937436b0bc4f1"
format_stamp: "Formatted at 2026-08-11 18:50:50 on dist-test-slave-lgr5"
server_key: "df988355afc2a5d05b6303d3f7eec4ff"
server_key_iv: "7c8e18291c31c247899436c315aeaf1b"
server_key_version: "encryptionkey@0"
I20260811 18:50:50.345468 18317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance:
uuid: "f67291534f6e47de982937436b0bc4f1"
format_stamp: "Formatted at 2026-08-11 18:50:50 on dist-test-slave-lgr5"
server_key: "df988355afc2a5d05b6303d3f7eec4ff"
server_key_iv: "7c8e18291c31c247899436c315aeaf1b"
server_key_version: "encryptionkey@0"
I20260811 18:50:50.351951 18317 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 18:50:50.356765 18339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:50.358915 18317 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260811 18:50:50.359138 18317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "f67291534f6e47de982937436b0bc4f1"
format_stamp: "Formatted at 2026-08-11 18:50:50 on dist-test-slave-lgr5"
server_key: "df988355afc2a5d05b6303d3f7eec4ff"
server_key_iv: "7c8e18291c31c247899436c315aeaf1b"
server_key_version: "encryptionkey@0"
I20260811 18:50:50.359378 18317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:50:50.378895 18317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:50:50.383803 18317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:50:50.384155 18317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:50:50.385275 18317 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:50:50.386929 18317 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:50:50.387010 18317 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:50.387121 18317 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:50:50.387188 18317 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:50.420198 18317 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:45615
I20260811 18:50:50.420284 18517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:45615 every 8 connection(s)
I20260811 18:50:50.421591 18317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:50:50.421917 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 18317
I20260811 18:50:50.422097 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance
I20260811 18:50:50.422700 25700 external_mini_cluster.cc:1428] Setting key f5b2a97f85e88ffa714929f9ddc4eed5
Aug 11 18:50:50 dist-test-slave-lgr5 krb5kdc[17873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474250, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:50:50.445376 18520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:50.424537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:34785 (local address 127.25.25.62:42917)
0811 18:50:50.425359 (+ 822us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:50.425366 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:50.426346 (+ 980us) server_negotiation.cc:407] Connection header received
0811 18:50:50.428327 (+ 1981us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:50.428333 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:50.428421 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:50.428540 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:50.430196 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:50.431197 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:50.433003 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:50.433575 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:50.433700 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:50.437890 (+ 4190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:50.437896 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:50.437900 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:50.437942 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:50.440751 (+ 2809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:50.441764 (+ 1013us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:50.441771 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:50.441774 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:50.441953 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:50.442564 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:50.442570 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:50.442573 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:50.442950 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:50.443166 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:50.444726 (+ 1560us) server_negotiation.cc:299] Negotiation successful
0811 18:50:50.445020 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":687,"thread_start_us":566,"threads_started":1}
I20260811 18:50:50.446291 18521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:50.425270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.2:34785)
0811 18:50:50.426157 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:50.426216 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:50.427980 (+ 1764us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:50.428775 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:50.428785 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:50.429364 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:50:50.429989 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:50.430011 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:50.431383 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:50.431387 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:50.432840 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:50.432855 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:50.433859 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:50.433867 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:50.434210 (+ 343us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:50.434944 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:50:50.434976 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:50:50.437584 (+ 2608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:50:50.440945 (+ 3361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:50.440957 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:50.440977 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:50.441584 (+ 607us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:50.442124 (+ 540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:50.442128 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:50.442131 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:50.442411 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:50.443155 (+ 744us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:50:50.443193 (+ 38us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:50:50.444007 (+ 814us) client_negotiation.cc:769] Sending connection context
0811 18:50:50.444558 (+ 551us) client_negotiation.cc:240] Negotiation successful
0811 18:50:50.445048 (+ 490us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":357,"threads_started":1}
I20260811 18:50:50.448304 18518 heartbeater.cc:347] Connected to a master server at 127.25.25.62:42917
I20260811 18:50:50.448633 18518 heartbeater.cc:464] Registering TS with master...
I20260811 18:50:50.449509 18518 heartbeater.cc:511] Master 127.25.25.62:42917 requested a full tablet report, sending...
I20260811 18:50:50.451267 17970 ts_manager.cc:194] Registered new tserver with Master: f67291534f6e47de982937436b0bc4f1 (127.25.25.2:45615)
I20260811 18:50:50.452237 17970 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.2@KRBTEST.COM'} at 127.25.25.2:34785
WARNING: no policy specified for kudu/127.25.25.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
I20260811 18:50:50.493767 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:0
--local_ip_for_outbound_sockets=127.25.25.3
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:42917
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:44237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:50:50.862035 18526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:50:50.862412 18526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:50:50.862548 18526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:50:50.870774 18526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:50:50.870916 18526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:50:50.871075 18526 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:50:50.877355 18309 heartbeater.cc:503] Master 127.25.25.62:42917 was elected leader, sending a full tablet report...
I20260811 18:50:50.882099 18526 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:44237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:42917
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:50:50.883589 18526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:50:50.885210 18526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:50:50.899523 18541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:50.899554 18542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:50.899483 18544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:50:50.900770 18526 server_base.cc:1034] running on GCE node
I20260811 18:50:50.901490 18526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:50:50.902578 18526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:50:50.903854 18526 hybrid_clock.cc:648] HybridClock initialized: now 1786474250903778 us; error 59 us; skew 500 ppm
I20260811 18:50:50.904277 18526 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:50:50 dist-test-slave-lgr5 krb5kdc[17873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474250, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:50:50.907635 18526 init.cc:377] Logged in from keytab as kudu/127.25.25.3@KRBTEST.COM (short username kudu)
I20260811 18:50:50.909255 18526 webserver.cc:460] Webserver started at http://127.25.25.3:39473/ using document root <none> and password file <none>
I20260811 18:50:50.910034 18526 fs_manager.cc:359] Metadata directory not provided
I20260811 18:50:50.910197 18526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:50:50.910523 18526 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:50:50.913684 18526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/data/instance:
uuid: "9ff9454f802e4ba5ac0de34f20f5ece1"
format_stamp: "Formatted at 2026-08-11 18:50:50 on dist-test-slave-lgr5"
server_key: "4107bc072c322422b10624eb94849169"
server_key_iv: "d7105739568a35874e13a9a8c3ca8d5d"
server_key_version: "encryptionkey@0"
I20260811 18:50:50.914523 18526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance:
uuid: "9ff9454f802e4ba5ac0de34f20f5ece1"
format_stamp: "Formatted at 2026-08-11 18:50:50 on dist-test-slave-lgr5"
server_key: "4107bc072c322422b10624eb94849169"
server_key_iv: "d7105739568a35874e13a9a8c3ca8d5d"
server_key_version: "encryptionkey@0"
I20260811 18:50:50.920289 18526 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 18:50:50.924415 18558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:50.926393 18526 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 18:50:50.926643 18526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "9ff9454f802e4ba5ac0de34f20f5ece1"
format_stamp: "Formatted at 2026-08-11 18:50:50 on dist-test-slave-lgr5"
server_key: "4107bc072c322422b10624eb94849169"
server_key_iv: "d7105739568a35874e13a9a8c3ca8d5d"
server_key_version: "encryptionkey@0"
I20260811 18:50:50.926910 18526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:50:50.942639 18526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:50:50.947660 18526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:50:50.947962 18526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:50:50.949137 18526 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:50:50.950690 18526 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:50:50.950769 18526 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:50.950876 18526 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:50:50.950932 18526 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:50.985486 18526 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:43177
I20260811 18:50:50.985519 18739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:43177 every 8 connection(s)
I20260811 18:50:50.986982 18526 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:50:50.996637 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 18526
I20260811 18:50:50.996817 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance
I20260811 18:50:50.997255 25700 external_mini_cluster.cc:1428] Setting key 6b2d962d06180e089b2c0ec1beaebb43
Aug 11 18:50:50 dist-test-slave-lgr5 krb5kdc[17873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474250, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:50:51.009382 18743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:50.989991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:38355 (local address 127.25.25.62:42917)
0811 18:50:50.990478 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:50.990485 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:50.991598 (+ 1113us) server_negotiation.cc:407] Connection header received
0811 18:50:50.993597 (+ 1999us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:50.993602 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:50.993683 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:50.993791 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:50.995543 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:50.996437 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:50.998304 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:50.998780 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:50.998921 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:51.002941 (+ 4020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:51.002948 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:51.002951 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:51.002995 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:51.005883 (+ 2888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:51.006773 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:51.006778 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:51.006781 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:51.006923 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:51.007414 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:51.007418 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:51.007420 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:51.007724 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:51.007885 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:51.008723 (+ 838us) server_negotiation.cc:299] Negotiation successful
0811 18:50:51.008990 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":202,"threads_started":1}
I20260811 18:50:51.010553 18745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:50.990570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.3:38355)
0811 18:50:50.991417 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:50.991467 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:50.993264 (+ 1797us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:50.994049 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:50.994058 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:50.994673 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:50:50.995328 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:50.995349 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:50.996605 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:50.996609 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:50.998153 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:50.998168 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:50.999051 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:50.999060 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:50.999312 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:51.000006 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:50:51.000032 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:50:51.002615 (+ 2583us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:50:51.006096 (+ 3481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:51.006107 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:51.006124 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:51.006635 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:51.007047 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:51.007052 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:51.007056 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:51.007283 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:51.007865 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:50:51.007874 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:50:51.008328 (+ 454us) client_negotiation.cc:769] Sending connection context
0811 18:50:51.008601 (+ 273us) client_negotiation.cc:240] Negotiation successful
0811 18:50:51.009204 (+ 603us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":331,"threads_started":1}
I20260811 18:50:51.012321 18740 heartbeater.cc:347] Connected to a master server at 127.25.25.62:42917
I20260811 18:50:51.012658 18740 heartbeater.cc:464] Registering TS with master...
I20260811 18:50:51.013461 18740 heartbeater.cc:511] Master 127.25.25.62:42917 requested a full tablet report, sending...
I20260811 18:50:51.015007 17970 ts_manager.cc:194] Registered new tserver with Master: 9ff9454f802e4ba5ac0de34f20f5ece1 (127.25.25.3:43177)
I20260811 18:50:51.015911 17970 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.3@KRBTEST.COM'} at 127.25.25.3:38355
I20260811 18:50:51.026582 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:50:51.045707 18743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:51.031727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43090 (local address 127.25.25.62:42917)
0811 18:50:51.031983 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:51.031990 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:51.032501 (+ 511us) server_negotiation.cc:407] Connection header received
0811 18:50:51.032703 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:51.032707 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:51.032813 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:51.032919 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:51.034570 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.035383 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.036960 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.037398 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.037513 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:51.040046 (+ 2533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:51.040052 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:51.040056 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:51.040129 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:51.042840 (+ 2711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:51.043704 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:51.043709 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:51.043712 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:51.043865 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:51.044311 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:51.044315 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:51.044317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:51.044689 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:51.044887 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:51.045257 (+ 370us) server_negotiation.cc:299] Negotiation successful
0811 18:50:51.045471 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 18:50:51.050505 17970 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43090:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:50:51.058389 17970 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:50:51.112916 18780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:51.075218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35918 (local address 127.25.25.2:45615)
0811 18:50:51.099165 (+ 23947us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:51.099175 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:51.101756 (+ 2581us) server_negotiation.cc:407] Connection header received
0811 18:50:51.102697 (+ 941us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:51.102707 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:51.103042 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:51.103301 (+ 259us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:50:51.104144 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.105793 (+ 1649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.109444 (+ 3651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.111111 (+ 1667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.111251 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:51.111466 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:51.112422 (+ 956us) server_negotiation.cc:299] Negotiation successful
0811 18:50:51.112611 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23744,"thread_start_us":25356,"threads_started":1}
I20260811 18:50:51.112923 18773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:51.075051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:43305 (local address 127.0.0.1:59456)
0811 18:50:51.102328 (+ 27277us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:51.102345 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:51.103038 (+ 693us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:51.103948 (+ 910us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:51.103957 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:51.103984 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:50:51.104457 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:51.104467 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.105987 (+ 1520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.105992 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:51.109221 (+ 3229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:51.109231 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.111691 (+ 2460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.111696 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:51.111973 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:51.112069 (+ 96us) client_negotiation.cc:769] Sending connection context
0811 18:50:51.112235 (+ 166us) client_negotiation.cc:240] Negotiation successful
0811 18:50:51.112468 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27157,"mutex_wait_us":297,"thread_start_us":24947,"threads_started":1}
I20260811 18:50:51.113871 18782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:51.075768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59456 (local address 127.25.25.1:43305)
0811 18:50:51.098366 (+ 22598us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:51.098378 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:51.102469 (+ 4091us) server_negotiation.cc:407] Connection header received
0811 18:50:51.103264 (+ 795us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:51.103273 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:51.103552 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:51.103758 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:50:51.104631 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.105800 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.109432 (+ 3632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.111120 (+ 1688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.111232 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:51.111499 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:51.113420 (+ 1921us) server_negotiation.cc:299] Negotiation successful
0811 18:50:51.113617 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22335,"thread_start_us":22633,"threads_started":1}
I20260811 18:50:51.113940 18777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:51.074414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:43177 (local address 127.0.0.1:47570)
0811 18:50:51.099878 (+ 25464us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:51.099942 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:51.100265 (+ 323us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:51.103636 (+ 3371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:51.103641 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:51.103667 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:50:51.104198 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:51.104213 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.106226 (+ 2013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.106235 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:51.109228 (+ 2993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:51.109247 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.113076 (+ 3829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.113082 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:51.113263 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:51.113297 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 18:50:51.113384 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 18:50:51.113533 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25118,"mutex_wait_us":209,"thread_start_us":26727,"threads_started":1}
I20260811 18:50:51.114722 18772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:51.074640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47570 (local address 127.25.25.3:43177)
0811 18:50:51.103007 (+ 28367us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:51.103016 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:51.103053 (+ 37us) server_negotiation.cc:407] Connection header received
0811 18:50:51.103151 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:51.103158 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:51.103412 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:51.103614 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:50:51.104414 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.106056 (+ 1642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.109452 (+ 3396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.112546 (+ 3094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.112687 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:51.112925 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:51.114193 (+ 1268us) server_negotiation.cc:299] Negotiation successful
0811 18:50:51.114380 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28185,"thread_start_us":28017,"threads_started":1}
I20260811 18:50:51.116768 18770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:51.074889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:45615 (local address 127.0.0.1:35918)
0811 18:50:51.101580 (+ 26691us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:51.101605 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:51.102385 (+ 780us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:51.103304 (+ 919us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:51.103320 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:51.103353 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:50:51.103894 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:51.103911 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.105992 (+ 2081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.105997 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:51.109157 (+ 3160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:51.109197 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.111633 (+ 2436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.111640 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:51.111971 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:51.112069 (+ 98us) client_negotiation.cc:769] Sending connection context
0811 18:50:51.112242 (+ 173us) client_negotiation.cc:240] Negotiation successful
0811 18:50:51.116381 (+ 4139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26448,"mutex_wait_us":4034,"thread_start_us":27150,"threads_started":1}
I20260811 18:50:51.118157 18203 tablet_service.cc:1467] Processing CreateTablet for tablet 3d39385cefd24a0da806857026f0edff (DEFAULT_TABLE table=test-table [id=47f858ee9eca49808dccdfe35f0d321c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:50:51.119977 18203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d39385cefd24a0da806857026f0edff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:50:51.122207 18644 tablet_service.cc:1467] Processing CreateTablet for tablet 3d39385cefd24a0da806857026f0edff (DEFAULT_TABLE table=test-table [id=47f858ee9eca49808dccdfe35f0d321c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:50:51.123200 18429 tablet_service.cc:1467] Processing CreateTablet for tablet 3d39385cefd24a0da806857026f0edff (DEFAULT_TABLE table=test-table [id=47f858ee9eca49808dccdfe35f0d321c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:50:51.124122 18644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d39385cefd24a0da806857026f0edff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:50:51.124980 18429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d39385cefd24a0da806857026f0edff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:50:51.136951 18783 tablet_bootstrap.cc:492] T 3d39385cefd24a0da806857026f0edff P 9ff9454f802e4ba5ac0de34f20f5ece1: Bootstrap starting.
I20260811 18:50:51.139528 18785 tablet_bootstrap.cc:492] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab: Bootstrap starting.
I20260811 18:50:51.142663 18788 tablet_bootstrap.cc:492] T 3d39385cefd24a0da806857026f0edff P f67291534f6e47de982937436b0bc4f1: Bootstrap starting.
I20260811 18:50:51.142735 18783 tablet_bootstrap.cc:654] T 3d39385cefd24a0da806857026f0edff P 9ff9454f802e4ba5ac0de34f20f5ece1: Neither blocks nor log segments found. Creating new log.
I20260811 18:50:51.143618 18785 tablet_bootstrap.cc:654] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab: Neither blocks nor log segments found. Creating new log.
I20260811 18:50:51.144196 18783 log.cc:824] T 3d39385cefd24a0da806857026f0edff P 9ff9454f802e4ba5ac0de34f20f5ece1: Log is configured to *not* fsync() on all Append() calls
I20260811 18:50:51.144999 18785 log.cc:824] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab: Log is configured to *not* fsync() on all Append() calls
I20260811 18:50:51.146306 18788 tablet_bootstrap.cc:654] T 3d39385cefd24a0da806857026f0edff P f67291534f6e47de982937436b0bc4f1: Neither blocks nor log segments found. Creating new log.
I20260811 18:50:51.147552 18783 tablet_bootstrap.cc:492] T 3d39385cefd24a0da806857026f0edff P 9ff9454f802e4ba5ac0de34f20f5ece1: No bootstrap required, opened a new log
I20260811 18:50:51.147637 18788 log.cc:824] T 3d39385cefd24a0da806857026f0edff P f67291534f6e47de982937436b0bc4f1: Log is configured to *not* fsync() on all Append() calls
I20260811 18:50:51.147855 18783 ts_tablet_manager.cc:1397] T 3d39385cefd24a0da806857026f0edff P 9ff9454f802e4ba5ac0de34f20f5ece1: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260811 18:50:51.148300 18785 tablet_bootstrap.cc:492] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab: No bootstrap required, opened a new log
I20260811 18:50:51.148671 18785 ts_tablet_manager.cc:1397] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.006s
I20260811 18:50:51.155992 18788 tablet_bootstrap.cc:492] T 3d39385cefd24a0da806857026f0edff P f67291534f6e47de982937436b0bc4f1: No bootstrap required, opened a new log
I20260811 18:50:51.156515 18788 ts_tablet_manager.cc:1397] T 3d39385cefd24a0da806857026f0edff P f67291534f6e47de982937436b0bc4f1: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.013s
I20260811 18:50:51.156865 18783 raft_consensus.cc:348] T 3d39385cefd24a0da806857026f0edff P 9ff9454f802e4ba5ac0de34f20f5ece1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 } } peers { permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 } } peers { permanent_uuid: "6cc791c6040c468491720b1d49ab2eab" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 43305 } }
I20260811 18:50:51.157300 18783 raft_consensus.cc:374] T 3d39385cefd24a0da806857026f0edff P 9ff9454f802e4ba5ac0de34f20f5ece1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:50:51.157428 18783 raft_consensus.cc:729] T 3d39385cefd24a0da806857026f0edff P 9ff9454f802e4ba5ac0de34f20f5ece1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ff9454f802e4ba5ac0de34f20f5ece1, State: Initialized, Role: FOLLOWER
I20260811 18:50:51.158088 18783 consensus_queue.cc:260] T 3d39385cefd24a0da806857026f0edff P 9ff9454f802e4ba5ac0de34f20f5ece1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 } } peers { permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 } } peers { permanent_uuid: "6cc791c6040c468491720b1d49ab2eab" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 43305 } }
I20260811 18:50:51.159466 18740 heartbeater.cc:503] Master 127.25.25.62:42917 was elected leader, sending a full tablet report...
I20260811 18:50:51.160109 18783 ts_tablet_manager.cc:1428] T 3d39385cefd24a0da806857026f0edff P 9ff9454f802e4ba5ac0de34f20f5ece1: Time spent starting tablet: real 0.012s user 0.009s sys 0.004s
I20260811 18:50:51.160028 18785 raft_consensus.cc:348] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 } } peers { permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 } } peers { permanent_uuid: "6cc791c6040c468491720b1d49ab2eab" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 43305 } }
I20260811 18:50:51.160593 18785 raft_consensus.cc:374] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:50:51.160717 18785 raft_consensus.cc:729] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc791c6040c468491720b1d49ab2eab, State: Initialized, Role: FOLLOWER
I20260811 18:50:51.161432 18785 consensus_queue.cc:260] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 } } peers { permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 } } peers { permanent_uuid: "6cc791c6040c468491720b1d49ab2eab" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 43305 } }
I20260811 18:50:51.163590 18785 ts_tablet_manager.cc:1428] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab: Time spent starting tablet: real 0.015s user 0.013s sys 0.001s
I20260811 18:50:51.168530 18788 raft_consensus.cc:348] T 3d39385cefd24a0da806857026f0edff P f67291534f6e47de982937436b0bc4f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 } } peers { permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 } } peers { permanent_uuid: "6cc791c6040c468491720b1d49ab2eab" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 43305 } }
I20260811 18:50:51.169087 18788 raft_consensus.cc:374] T 3d39385cefd24a0da806857026f0edff P f67291534f6e47de982937436b0bc4f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:50:51.169189 18788 raft_consensus.cc:729] T 3d39385cefd24a0da806857026f0edff P f67291534f6e47de982937436b0bc4f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f67291534f6e47de982937436b0bc4f1, State: Initialized, Role: FOLLOWER
I20260811 18:50:51.169808 18788 consensus_queue.cc:260] T 3d39385cefd24a0da806857026f0edff P f67291534f6e47de982937436b0bc4f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 } } peers { permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 } } peers { permanent_uuid: "6cc791c6040c468491720b1d49ab2eab" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 43305 } }
I20260811 18:50:51.171005 18518 heartbeater.cc:503] Master 127.25.25.62:42917 was elected leader, sending a full tablet report...
I20260811 18:50:51.171522 18788 ts_tablet_manager.cc:1428] T 3d39385cefd24a0da806857026f0edff P f67291534f6e47de982937436b0bc4f1: Time spent starting tablet: real 0.015s user 0.008s sys 0.005s
W20260811 18:50:51.173854 18519 tablet.cc:2369] T 3d39385cefd24a0da806857026f0edff P f67291534f6e47de982937436b0bc4f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:50:51.178099 18801 raft_consensus.cc:482] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:50:51.178463 18801 raft_consensus.cc:504] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 } } peers { permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 } } peers { permanent_uuid: "6cc791c6040c468491720b1d49ab2eab" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 43305 } }
I20260811 18:50:51.180368 18801 leader_election.cc:288] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ff9454f802e4ba5ac0de34f20f5ece1 (127.25.25.3:43177), f67291534f6e47de982937436b0bc4f1 (127.25.25.2:45615)
I20260811 18:50:51.189973 18780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:51.180934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:33281 (local address 127.25.25.2:45615)
0811 18:50:51.181129 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:51.181133 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:51.182077 (+ 944us) server_negotiation.cc:407] Connection header received
0811 18:50:51.182252 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:51.182256 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:51.182315 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:51.182378 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:50:51.182956 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.184023 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.187013 (+ 2990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.188431 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.188623 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:51.188743 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:51.189509 (+ 766us) server_negotiation.cc:299] Negotiation successful
0811 18:50:51.189677 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 18:50:51.190369 18803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:51.180793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:43177 (local address 127.25.25.1:46127)
0811 18:50:51.181580 (+ 787us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:51.181596 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:51.181771 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:51.182127 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:51.182131 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:51.182153 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:50:51.182547 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:51.182564 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.184012 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.184017 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:51.186705 (+ 2688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:51.186732 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.188908 (+ 2176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.188917 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:51.189209 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:51.189301 (+ 92us) client_negotiation.cc:769] Sending connection context
0811 18:50:51.189433 (+ 132us) client_negotiation.cc:240] Negotiation successful
0811 18:50:51.189694 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":677,"mutex_wait_us":169,"thread_start_us":855,"threads_started":1}
I20260811 18:50:51.190833 18772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:51.180826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:46127 (local address 127.25.25.3:43177)
0811 18:50:51.181052 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:51.181058 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:51.181704 (+ 646us) server_negotiation.cc:407] Connection header received
0811 18:50:51.181934 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:51.181939 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:51.182001 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:51.182086 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:50:51.182707 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.183843 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.187009 (+ 3166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.188431 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.188623 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:51.188743 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:51.190397 (+ 1654us) server_negotiation.cc:299] Negotiation successful
0811 18:50:51.190575 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260811 18:50:51.190371 18804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:51.180780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:45615 (local address 127.25.25.1:33281)
0811 18:50:51.181965 (+ 1185us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:51.181984 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:51.182112 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:51.182433 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:51.182437 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:51.182466 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:50:51.182808 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:51.182818 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.184195 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.184201 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:51.186705 (+ 2504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:51.186732 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.188882 (+ 2150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.188894 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:51.189212 (+ 318us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:51.189290 (+ 78us) client_negotiation.cc:769] Sending connection context
0811 18:50:51.189433 (+ 143us) client_negotiation.cc:240] Negotiation successful
0811 18:50:51.189694 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1040,"mutex_wait_us":179,"thread_start_us":434,"threads_started":1}
I20260811 18:50:51.192005 18671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d39385cefd24a0da806857026f0edff" candidate_uuid: "6cc791c6040c468491720b1d49ab2eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" is_pre_election: true
I20260811 18:50:51.192121 18455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d39385cefd24a0da806857026f0edff" candidate_uuid: "6cc791c6040c468491720b1d49ab2eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f67291534f6e47de982937436b0bc4f1" is_pre_election: true
I20260811 18:50:51.192636 18671 raft_consensus.cc:2454] T 3d39385cefd24a0da806857026f0edff P 9ff9454f802e4ba5ac0de34f20f5ece1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc791c6040c468491720b1d49ab2eab in term 0.
I20260811 18:50:51.192719 18455 raft_consensus.cc:2454] T 3d39385cefd24a0da806857026f0edff P f67291534f6e47de982937436b0bc4f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc791c6040c468491720b1d49ab2eab in term 0.
I20260811 18:50:51.193471 18112 leader_election.cc:302] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc791c6040c468491720b1d49ab2eab, 9ff9454f802e4ba5ac0de34f20f5ece1; no voters:
I20260811 18:50:51.194000 18801 raft_consensus.cc:2781] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:50:51.194198 18801 raft_consensus.cc:482] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:50:51.194346 18801 raft_consensus.cc:3037] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:50:51.196951 18801 raft_consensus.cc:504] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 } } peers { permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 } } peers { permanent_uuid: "6cc791c6040c468491720b1d49ab2eab" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 43305 } }
I20260811 18:50:51.197650 18801 leader_election.cc:288] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab [CANDIDATE]: Term 1 election: Requested vote from peers 9ff9454f802e4ba5ac0de34f20f5ece1 (127.25.25.3:43177), f67291534f6e47de982937436b0bc4f1 (127.25.25.2:45615)
I20260811 18:50:51.198383 18671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d39385cefd24a0da806857026f0edff" candidate_uuid: "6cc791c6040c468491720b1d49ab2eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1"
I20260811 18:50:51.198447 18455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d39385cefd24a0da806857026f0edff" candidate_uuid: "6cc791c6040c468491720b1d49ab2eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f67291534f6e47de982937436b0bc4f1"
I20260811 18:50:51.198607 18671 raft_consensus.cc:3037] T 3d39385cefd24a0da806857026f0edff P 9ff9454f802e4ba5ac0de34f20f5ece1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:50:51.198712 18455 raft_consensus.cc:3037] T 3d39385cefd24a0da806857026f0edff P f67291534f6e47de982937436b0bc4f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:50:51.201210 18671 raft_consensus.cc:2454] T 3d39385cefd24a0da806857026f0edff P 9ff9454f802e4ba5ac0de34f20f5ece1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc791c6040c468491720b1d49ab2eab in term 1.
I20260811 18:50:51.201222 18455 raft_consensus.cc:2454] T 3d39385cefd24a0da806857026f0edff P f67291534f6e47de982937436b0bc4f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc791c6040c468491720b1d49ab2eab in term 1.
I20260811 18:50:51.201812 18112 leader_election.cc:302] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 6cc791c6040c468491720b1d49ab2eab, 9ff9454f802e4ba5ac0de34f20f5ece1, f67291534f6e47de982937436b0bc4f1; no voters:
I20260811 18:50:51.202180 18801 raft_consensus.cc:2781] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:50:51.202701 18801 raft_consensus.cc:686] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab [term 1 LEADER]: Becoming Leader. State: Replica: 6cc791c6040c468491720b1d49ab2eab, State: Running, Role: LEADER
I20260811 18:50:51.203282 18801 consensus_queue.cc:237] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 } } peers { permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 } } peers { permanent_uuid: "6cc791c6040c468491720b1d49ab2eab" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 43305 } }
I20260811 18:50:51.208156 17969 catalog_manager.cc:5495] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cc791c6040c468491720b1d49ab2eab (127.25.25.1). New cstate: current_term: 1 leader_uuid: "6cc791c6040c468491720b1d49ab2eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc791c6040c468491720b1d49ab2eab" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 43305 } health_report { overall_health: HEALTHY } } }
W20260811 18:50:51.238950 18742 tablet.cc:2369] T 3d39385cefd24a0da806857026f0edff P 9ff9454f802e4ba5ac0de34f20f5ece1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:50:51.249511 18782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:51.243913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59466 (local address 127.25.25.1:43305)
0811 18:50:51.244158 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:51.244163 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:51.244182 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:50:51.244330 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:51.244334 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:51.244428 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:51.244573 (+ 145us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:50:51.245020 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.245742 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.247291 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.247719 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.247812 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:51.248394 (+ 582us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:50:51.248920 (+ 526us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:50:51.249043 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:51.249192 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 18:50:51.249269 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 18:50:51.259169 18455 raft_consensus.cc:1261] T 3d39385cefd24a0da806857026f0edff P f67291534f6e47de982937436b0bc4f1 [term 1 FOLLOWER]: Refusing update from remote peer 6cc791c6040c468491720b1d49ab2eab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:50:51.259176 18671 raft_consensus.cc:1261] T 3d39385cefd24a0da806857026f0edff P 9ff9454f802e4ba5ac0de34f20f5ece1 [term 1 FOLLOWER]: Refusing update from remote peer 6cc791c6040c468491720b1d49ab2eab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:50:51.260514 18805 consensus_queue.cc:1035] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:50:51.260887 18801 consensus_queue.cc:1035] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:50:51.274789 18813 mvcc.cc:205] Tried to move back new op lower bound from 7317398533145448448 to 7317398532933144576. Current Snapshot: MvccSnapshot[applied={T|T < 7317398533145448448}]
I20260811 18:50:51.282282 18815 mvcc.cc:205] Tried to move back new op lower bound from 7317398533145448448 to 7317398532933144576. Current Snapshot: MvccSnapshot[applied={T|T < 7317398533145448448}]
I20260811 18:50:51.289827 17970 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:50:51.290132 17970 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:50:51.294257 17970 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac: Sending DeleteTablet for 3 replicas of tablet 3d39385cefd24a0da806857026f0edff
I20260811 18:50:51.295691 18429 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d39385cefd24a0da806857026f0edff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:50:51 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:35918
I20260811 18:50:51.295691 18644 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d39385cefd24a0da806857026f0edff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:50:51 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:47570
I20260811 18:50:51.296519 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 18080
I20260811 18:50:51.296631 18203 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d39385cefd24a0da806857026f0edff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:50:51 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:59456
I20260811 18:50:51.311264 18828 tablet_replica.cc:330] T 3d39385cefd24a0da806857026f0edff P f67291534f6e47de982937436b0bc4f1: stopping tablet replica
I20260811 18:50:51.312017 18828 raft_consensus.cc:2229] T 3d39385cefd24a0da806857026f0edff P f67291534f6e47de982937436b0bc4f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:50:51.312760 18828 raft_consensus.cc:2258] T 3d39385cefd24a0da806857026f0edff P f67291534f6e47de982937436b0bc4f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:50:51.315510 18828 ts_tablet_manager.cc:1905] T 3d39385cefd24a0da806857026f0edff P f67291534f6e47de982937436b0bc4f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:50:51.317147 18830 tablet_replica.cc:330] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab: stopping tablet replica
I20260811 18:50:51.317682 18830 raft_consensus.cc:2229] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:50:51.318423 18830 raft_consensus.cc:2258] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 11 18:50:51 dist-test-slave-lgr5 krb5kdc[17873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.1@KRBTEST.COM
I20260811 18:50:51.324571 18826 tablet_replica.cc:330] T 3d39385cefd24a0da806857026f0edff P 9ff9454f802e4ba5ac0de34f20f5ece1: stopping tablet replica
I20260811 18:50:51.324570 18828 ts_tablet_manager.cc:1918] T 3d39385cefd24a0da806857026f0edff P f67291534f6e47de982937436b0bc4f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:50:51.324767 18828 log.cc:1196] T 3d39385cefd24a0da806857026f0edff P f67291534f6e47de982937436b0bc4f1: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/wal/wals/3d39385cefd24a0da806857026f0edff
I20260811 18:50:51.325222 18826 raft_consensus.cc:2229] T 3d39385cefd24a0da806857026f0edff P 9ff9454f802e4ba5ac0de34f20f5ece1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:50:51.325613 18828 ts_tablet_manager.cc:1939] T 3d39385cefd24a0da806857026f0edff P f67291534f6e47de982937436b0bc4f1: Deleting consensus metadata
I20260811 18:50:51.325825 18826 raft_consensus.cc:2258] T 3d39385cefd24a0da806857026f0edff P 9ff9454f802e4ba5ac0de34f20f5ece1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:50:51.326633 18830 ts_tablet_manager.cc:1905] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:50:51.328063 17937 catalog_manager.cc:4841] TS f67291534f6e47de982937436b0bc4f1 (127.25.25.2:45615): tablet 3d39385cefd24a0da806857026f0edff (table test-table [id=47f858ee9eca49808dccdfe35f0d321c]) successfully deleted
I20260811 18:50:51.330837 18826 ts_tablet_manager.cc:1905] T 3d39385cefd24a0da806857026f0edff P 9ff9454f802e4ba5ac0de34f20f5ece1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:50:51.335824 18782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:51.297964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59476 (local address 127.25.25.1:43305)
0811 18:50:51.298154 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:51.298165 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:51.307985 (+ 9820us) server_negotiation.cc:407] Connection header received
0811 18:50:51.308622 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:51.308629 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:51.308738 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:51.308822 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:51.311255 (+ 2433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.312622 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.314809 (+ 2187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.315580 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.315701 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:51.326389 (+ 10688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:51.326409 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:51.326428 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:51.326494 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:51.331002 (+ 4508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:51.332159 (+ 1157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:51.332169 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:51.332173 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:51.332392 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:51.332908 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:51.332913 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:51.332916 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:51.333425 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:51.333715 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:51.334423 (+ 708us) server_negotiation.cc:299] Negotiation successful
0811 18:50:51.334686 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 18:50:51.336179 18830 ts_tablet_manager.cc:1918] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:50:51.336395 18830 log.cc:1196] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/wal/wals/3d39385cefd24a0da806857026f0edff
I20260811 18:50:51.336663 18303 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:50:51.338196 18826 ts_tablet_manager.cc:1918] T 3d39385cefd24a0da806857026f0edff P 9ff9454f802e4ba5ac0de34f20f5ece1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:50:51.338414 18826 log.cc:1196] T 3d39385cefd24a0da806857026f0edff P 9ff9454f802e4ba5ac0de34f20f5ece1: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/wal/wals/3d39385cefd24a0da806857026f0edff
I20260811 18:50:51.338964 18826 ts_tablet_manager.cc:1939] T 3d39385cefd24a0da806857026f0edff P 9ff9454f802e4ba5ac0de34f20f5ece1: Deleting consensus metadata
I20260811 18:50:51.341086 17932 catalog_manager.cc:4841] TS 9ff9454f802e4ba5ac0de34f20f5ece1 (127.25.25.3:43177): tablet 3d39385cefd24a0da806857026f0edff (table test-table [id=47f858ee9eca49808dccdfe35f0d321c]) successfully deleted
I20260811 18:50:51.438467 18830 ts_tablet_manager.cc:1939] T 3d39385cefd24a0da806857026f0edff P 6cc791c6040c468491720b1d49ab2eab: Deleting consensus metadata
I20260811 18:50:51.439141 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 18080
I20260811 18:50:51.470259 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 18317
W20260811 18:50:51.470161 17936 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.25.1:43305 (error 108)
I20260811 18:50:51.472515 18773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:51.471973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:43305 (local address 127.0.0.1:59486)
0811 18:50:51.472198 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:51.472321 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:43305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260811 18:50:51.472817 17936 catalog_manager.cc:4584] TS 6cc791c6040c468491720b1d49ab2eab (127.25.25.1:43305): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3d39385cefd24a0da806857026f0edff: Network error: Client connection negotiation failed: client connection to 127.25.25.1:43305: connect: Connection refused (error 111)
Aug 11 18:50:51 dist-test-slave-lgr5 krb5kdc[17873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.2@KRBTEST.COM
I20260811 18:50:51.489384 18780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:51.471176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35932 (local address 127.25.25.2:45615)
0811 18:50:51.471378 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:51.471384 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:51.471406 (+ 22us) server_negotiation.cc:407] Connection header received
0811 18:50:51.471709 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:51.471716 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:51.471828 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:51.471964 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:51.473634 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.474610 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.476735 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.477191 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.477338 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:51.482379 (+ 5041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:51.482403 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:51.482421 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:51.482481 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:51.485953 (+ 3472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:51.486910 (+ 957us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:51.486920 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:51.486922 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:51.487087 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:51.487534 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:51.487539 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:51.487541 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:51.488016 (+ 475us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:51.488420 (+ 404us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:51.488759 (+ 339us) server_negotiation.cc:299] Negotiation successful
0811 18:50:51.489016 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 18:50:51.490562 18512 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:50:51.526822 18773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:51.526101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:43305 (local address 127.0.0.1:59498)
0811 18:50:51.526436 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:51.526573 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:43305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260811 18:50:51.528232 18773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:51.527689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:43305 (local address 127.0.0.1:59514)
0811 18:50:51.527894 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:51.528022 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:43305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 18:50:51.584676 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 18317
I20260811 18:50:51.597543 18773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:51.596924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:43305 (local address 127.0.0.1:59520)
0811 18:50:51.597189 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:51.597309 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:43305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260811 18:50:51.598825 18773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:51.598386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:43305 (local address 127.0.0.1:59524)
0811 18:50:51.598571 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:51.598670 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:43305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 18:50:51.614758 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 18526
Aug 11 18:50:51 dist-test-slave-lgr5 krb5kdc[17873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.3@KRBTEST.COM
I20260811 18:50:51.632419 18772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:51.615687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47578 (local address 127.25.25.3:43177)
0811 18:50:51.615881 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:51.615886 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:51.615905 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:50:51.616018 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:51.616023 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:51.616141 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:51.616228 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:51.617640 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.618416 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.619864 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:51.620337 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:51.620452 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:51.625698 (+ 5246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:51.625716 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:51.625733 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:51.625783 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:51.629094 (+ 3311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:51.630007 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:51.630017 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:51.630019 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:51.630180 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:51.630636 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:51.630640 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:51.630642 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:51.631098 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:51.631407 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:51.631782 (+ 375us) server_negotiation.cc:299] Negotiation successful
0811 18:50:51.632051 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 18:50:51.633136 18732 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:50:51.679804 18773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:51.679246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:43305 (local address 127.0.0.1:59532)
0811 18:50:51.679541 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:51.679647 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:43305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260811 18:50:51.680958 18773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:51.680527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:43305 (local address 127.0.0.1:59544)
0811 18:50:51.680733 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:51.680821 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:43305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260811 18:50:51.725977 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 18526
I20260811 18:50:51.750660 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 17902
I20260811 18:50:51.752192 18020 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:50:51.866762 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 17902
I20260811 18:50:51.903195 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:42917
--webserver_interface=127.25.25.62
--webserver_port=35163
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:44237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:42917
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:50:52.273301 18840 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:50:52.273672 18840 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:50:52.273818 18840 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:50:52.282061 18840 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:50:52.282232 18840 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:50:52.282323 18840 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:50:52.282404 18840 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:50:52.282477 18840 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:50:52.293321 18840 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:44237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:42917
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:42917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=35163
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:50:52.294780 18840 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:50:52.296247 18840 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:50:52.323704 18854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:52.323753 18852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:52.323757 18849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:50:52.324843 18840 server_base.cc:1034] running on GCE node
I20260811 18:50:52.325834 18840 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:50:52.327705 18840 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:50:52.329015 18840 hybrid_clock.cc:648] HybridClock initialized: now 1786474252328908 us; error 74 us; skew 500 ppm
I20260811 18:50:52.329638 18840 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:50:52 dist-test-slave-lgr5 krb5kdc[17873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474252, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:50:52.338634 18840 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:50:52.340728 18840 webserver.cc:460] Webserver started at http://127.25.25.62:35163/ using document root <none> and password file <none>
I20260811 18:50:52.341596 18840 fs_manager.cc:359] Metadata directory not provided
I20260811 18:50:52.341750 18840 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:50:52.349088 18840 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.000s
I20260811 18:50:52.352845 18867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:52.354725 18840 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260811 18:50:52.354961 18840 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "9567f2f2049744a8a0f2239c663d36ac"
format_stamp: "Formatted at 2026-08-11 18:50:49 on dist-test-slave-lgr5"
server_key: "aaaa9472bc1a20254b4e14627a4c8e1c"
server_key_iv: "dae1bc19c0805d825286799e5acbe799"
server_key_version: "encryptionkey@0"
I20260811 18:50:52.356235 18840 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:50:52.375114 18840 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:50:52.380594 18840 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:50:52.380939 18840 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:50:52.401787 18840 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:42917
I20260811 18:50:52.401821 18956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:42917 every 8 connection(s)
I20260811 18:50:52.403695 18840 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:50:52.411999 18958 sys_catalog.cc:263] Verifying existing consensus state
I20260811 18:50:52.414273 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 18840
I20260811 18:50:52.415123 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:43305
--local_ip_for_outbound_sockets=127.25.25.1
--tserver_master_addrs=127.25.25.62:42917
--webserver_port=35461
--webserver_interface=127.25.25.1
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:44237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:50:52.416234 18958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac: Bootstrap starting.
I20260811 18:50:52.441149 18958 log.cc:824] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac: Log is configured to *not* fsync() on all Append() calls
I20260811 18:50:52.460983 18958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:50:52.461736 18958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac: Bootstrap complete.
I20260811 18:50:52.475989 18958 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9567f2f2049744a8a0f2239c663d36ac" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42917 } }
I20260811 18:50:52.477524 18958 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9567f2f2049744a8a0f2239c663d36ac, State: Initialized, Role: FOLLOWER
I20260811 18:50:52.478374 18958 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9567f2f2049744a8a0f2239c663d36ac" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42917 } }
I20260811 18:50:52.478713 18958 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:50:52.478848 18958 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:50:52.479046 18958 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [term 1 FOLLOWER]: Advancing to term 2
I20260811 18:50:52.485440 18958 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9567f2f2049744a8a0f2239c663d36ac" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42917 } }
I20260811 18:50:52.486569 18958 leader_election.cc:302] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9567f2f2049744a8a0f2239c663d36ac; no voters:
I20260811 18:50:52.487452 18958 leader_election.cc:288] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 18:50:52.487634 18964 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [term 2 FOLLOWER]: Leader election won for term 2
I20260811 18:50:52.489367 18964 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [term 2 LEADER]: Becoming Leader. State: Replica: 9567f2f2049744a8a0f2239c663d36ac, State: Running, Role: LEADER
I20260811 18:50:52.490067 18964 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9567f2f2049744a8a0f2239c663d36ac" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42917 } }
I20260811 18:50:52.490530 18958 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:50:52.492959 18968 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "9567f2f2049744a8a0f2239c663d36ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9567f2f2049744a8a0f2239c663d36ac" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42917 } } }
I20260811 18:50:52.492877 18970 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9567f2f2049744a8a0f2239c663d36ac. Latest consensus state: current_term: 2 leader_uuid: "9567f2f2049744a8a0f2239c663d36ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9567f2f2049744a8a0f2239c663d36ac" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42917 } } }
I20260811 18:50:52.493495 18970 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [sys.catalog]: This master's current role is: LEADER
I20260811 18:50:52.493494 18968 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [sys.catalog]: This master's current role is: LEADER
I20260811 18:50:52.497349 18977 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:50:52.507643 18977 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:50:52.509604 18977 catalog_manager.cc:1259] Loaded cluster ID: 878a0dc0c0b4465ebe9b180d2333f4d3
I20260811 18:50:52.509826 18977 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:50:52.513875 18977 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 18:50:52.531980 18977 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 18:50:52.542387 18977 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:50:52.544359 18977 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac: Loaded TSK: 0
I20260811 18:50:52.546129 18977 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 18:50:52.820251 18962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:50:52.820593 18962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:50:52.820724 18962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:50:52.828500 18962 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:50:52.828629 18962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:50:52.828791 18962 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:50:52.839530 18962 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:44237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:43305
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=35461
--tserver_master_addrs=127.25.25.62:42917
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:50:52.841054 18962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:50:52.842509 18962 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:50:52.858095 19024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:52.858063 19015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:52.858619 19014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:50:52.862103 18962 server_base.cc:1034] running on GCE node
I20260811 18:50:52.862998 18962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:50:52.864328 18962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:50:52.865629 18962 hybrid_clock.cc:648] HybridClock initialized: now 1786474252865569 us; error 54 us; skew 500 ppm
I20260811 18:50:52.866029 18962 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:50:52 dist-test-slave-lgr5 krb5kdc[17873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474252, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:50:52.869669 18962 init.cc:377] Logged in from keytab as kudu/127.25.25.1@KRBTEST.COM (short username kudu)
I20260811 18:50:52.871495 18962 webserver.cc:460] Webserver started at http://127.25.25.1:35461/ using document root <none> and password file <none>
I20260811 18:50:52.872345 18962 fs_manager.cc:359] Metadata directory not provided
I20260811 18:50:52.872483 18962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:50:52.878484 18962 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.003s
I20260811 18:50:52.881559 19038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:52.883317 18962 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:50:52.883524 18962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "6cc791c6040c468491720b1d49ab2eab"
format_stamp: "Formatted at 2026-08-11 18:50:49 on dist-test-slave-lgr5"
server_key: "ec3d38c8aeb17709c9b0ca84982359a7"
server_key_iv: "fdba48f9de9e3c90865a54bd5ce0fd16"
server_key_version: "encryptionkey@0"
I20260811 18:50:52.884677 18962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:50:52.898571 18962 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:50:52.903257 18962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:50:52.903520 18962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:50:52.904628 18962 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:50:52.906133 18962 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:50:52.906229 18962 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:52.906315 18962 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:50:52.906370 18962 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:52.939157 18962 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:43305
I20260811 18:50:52.939239 19242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:43305 every 8 connection(s)
I20260811 18:50:52.940727 18962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:50:52.944044 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 18962
I20260811 18:50:52.944748 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:45615
--local_ip_for_outbound_sockets=127.25.25.2
--tserver_master_addrs=127.25.25.62:42917
--webserver_port=35699
--webserver_interface=127.25.25.2
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:44237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:50:52 dist-test-slave-lgr5 krb5kdc[17873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474252, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:50:52.968170 19246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:52.944052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.1:55771)
0811 18:50:52.944986 (+ 934us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:52.945036 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:52.946828 (+ 1792us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:52.948560 (+ 1732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:52.948569 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:52.949134 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:50:52.949742 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:52.949764 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:52.952057 (+ 2293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:52.952063 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:52.953613 (+ 1550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:52.953634 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:52.955151 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:52.955159 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:52.955418 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:52.956224 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:50:52.956250 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:50:52.959080 (+ 2830us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:50:52.962955 (+ 3875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:52.962964 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:52.962978 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:52.963476 (+ 498us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:52.963992 (+ 516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:52.963998 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:52.964001 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:52.964265 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:52.965257 (+ 992us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:50:52.965268 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:50:52.965680 (+ 412us) client_negotiation.cc:769] Sending connection context
0811 18:50:52.965963 (+ 283us) client_negotiation.cc:240] Negotiation successful
0811 18:50:52.966677 (+ 714us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":380,"threads_started":1}
I20260811 18:50:52.968171 19245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:52.943686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:55771 (local address 127.25.25.62:42917)
0811 18:50:52.944363 (+ 677us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:52.944379 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:52.945203 (+ 824us) server_negotiation.cc:407] Connection header received
0811 18:50:52.947462 (+ 2259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:52.947481 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:52.947941 (+ 460us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:52.948389 (+ 448us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:52.950012 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:52.951817 (+ 1805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:52.953819 (+ 2002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:52.954840 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:52.955072 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:52.959470 (+ 4398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:52.959481 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:52.959499 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:52.959546 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:52.962744 (+ 3198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:52.963650 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:52.963658 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:52.963663 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:52.963854 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:52.964400 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:52.964405 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:52.964407 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:52.965021 (+ 614us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:52.965322 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:52.966267 (+ 945us) server_negotiation.cc:299] Negotiation successful
0811 18:50:52.966706 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":257,"threads_started":1}
I20260811 18:50:52.972252 19243 heartbeater.cc:347] Connected to a master server at 127.25.25.62:42917
I20260811 18:50:52.972587 19243 heartbeater.cc:464] Registering TS with master...
I20260811 18:50:52.973400 19243 heartbeater.cc:511] Master 127.25.25.62:42917 requested a full tablet report, sending...
I20260811 18:50:52.975811 18895 ts_manager.cc:194] Registered new tserver with Master: 6cc791c6040c468491720b1d49ab2eab (127.25.25.1:43305)
I20260811 18:50:52.977458 18895 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.1@KRBTEST.COM'} at 127.25.25.1:55771
W20260811 18:50:53.308212 19247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:50:53.308645 19247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:50:53.308846 19247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:50:53.318809 19247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:50:53.318934 19247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:50:53.319108 19247 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:50:53.329646 19247 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:44237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:45615
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=35699
--tserver_master_addrs=127.25.25.62:42917
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:50:53.331075 19247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:50:53.332559 19247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:50:53.347105 19262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:53.347370 19256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:53.347350 19255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:50:53.348717 19247 server_base.cc:1034] running on GCE node
I20260811 18:50:53.349407 19247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:50:53.350534 19247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:50:53.351770 19247 hybrid_clock.cc:648] HybridClock initialized: now 1786474253351710 us; error 54 us; skew 500 ppm
I20260811 18:50:53.352176 19247 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:50:53 dist-test-slave-lgr5 krb5kdc[17873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474253, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:50:53.355886 19247 init.cc:377] Logged in from keytab as kudu/127.25.25.2@KRBTEST.COM (short username kudu)
I20260811 18:50:53.357626 19247 webserver.cc:460] Webserver started at http://127.25.25.2:35699/ using document root <none> and password file <none>
I20260811 18:50:53.358345 19247 fs_manager.cc:359] Metadata directory not provided
I20260811 18:50:53.358479 19247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:50:53.364306 19247 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 18:50:53.367280 19277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:53.368866 19247 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:50:53.369035 19247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "f67291534f6e47de982937436b0bc4f1"
format_stamp: "Formatted at 2026-08-11 18:50:50 on dist-test-slave-lgr5"
server_key: "df988355afc2a5d05b6303d3f7eec4ff"
server_key_iv: "7c8e18291c31c247899436c315aeaf1b"
server_key_version: "encryptionkey@0"
I20260811 18:50:53.370074 19247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:50:53.389534 19247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:50:53.394295 19247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:50:53.394589 19247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:50:53.395687 19247 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:50:53.397148 19247 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:50:53.397235 19247 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:53.397320 19247 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:50:53.397373 19247 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:53.430608 19247 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:45615
I20260811 18:50:53.430686 19482 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:45615 every 8 connection(s)
I20260811 18:50:53.432157 19247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:50:53.437898 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 19247
I20260811 18:50:53.438670 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:43177
--local_ip_for_outbound_sockets=127.25.25.3
--tserver_master_addrs=127.25.25.62:42917
--webserver_port=39473
--webserver_interface=127.25.25.3
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:44237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:50:53 dist-test-slave-lgr5 krb5kdc[17873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474253, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:50:53.457324 19245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:53.435052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:59103 (local address 127.25.25.62:42917)
0811 18:50:53.435273 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:53.435278 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:53.436603 (+ 1325us) server_negotiation.cc:407] Connection header received
0811 18:50:53.439230 (+ 2627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:53.439236 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:53.439373 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:53.439474 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:53.441677 (+ 2203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:53.442454 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:53.444689 (+ 2235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:53.445157 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:53.445276 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:53.449635 (+ 4359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:53.449641 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:53.449644 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:53.449685 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:53.453364 (+ 3679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:53.454563 (+ 1199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:53.454569 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:53.454572 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:53.454774 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:53.455326 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:53.455331 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:53.455334 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:53.455709 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:53.455856 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:53.456710 (+ 854us) server_negotiation.cc:299] Negotiation successful
0811 18:50:53.456986 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 18:50:53.458190 19487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:53.435539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.2:59103)
0811 18:50:53.436415 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:53.436458 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:53.438807 (+ 2349us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:53.439793 (+ 986us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:53.439806 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:53.440629 (+ 823us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:50:53.441460 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:53.441486 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:53.442622 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:53.442627 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:53.444493 (+ 1866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:53.444509 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:53.445414 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:53.445421 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:53.445733 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:53.446507 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:50:53.446538 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:50:53.449239 (+ 2701us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:50:53.453659 (+ 4420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:53.453672 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:53.453693 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:53.454375 (+ 682us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:53.454924 (+ 549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:53.454930 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:53.454941 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:53.455194 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:53.455826 (+ 632us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:50:53.455833 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:50:53.456285 (+ 452us) client_negotiation.cc:769] Sending connection context
0811 18:50:53.456560 (+ 275us) client_negotiation.cc:240] Negotiation successful
0811 18:50:53.457028 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":300,"threads_started":1}
I20260811 18:50:53.459931 19483 heartbeater.cc:347] Connected to a master server at 127.25.25.62:42917
I20260811 18:50:53.460275 19483 heartbeater.cc:464] Registering TS with master...
I20260811 18:50:53.461153 19483 heartbeater.cc:511] Master 127.25.25.62:42917 requested a full tablet report, sending...
I20260811 18:50:53.462687 18895 ts_manager.cc:194] Registered new tserver with Master: f67291534f6e47de982937436b0bc4f1 (127.25.25.2:45615)
I20260811 18:50:53.463625 18895 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.2@KRBTEST.COM'} at 127.25.25.2:59103
W20260811 18:50:53.805939 19489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:50:53.806272 19489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:50:53.806375 19489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:50:53.814079 19489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:50:53.814234 19489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:50:53.814355 19489 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:50:53.825006 19489 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:44237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:43177
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=39473
--tserver_master_addrs=127.25.25.62:42917
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:50:53.826471 19489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:50:53.827956 19489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:50:53.842679 19498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:53.842801 19499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:53.842765 19503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:50:53.843668 19489 server_base.cc:1034] running on GCE node
I20260811 18:50:53.844419 19489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:50:53.845518 19489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:50:53.846753 19489 hybrid_clock.cc:648] HybridClock initialized: now 1786474253846697 us; error 47 us; skew 500 ppm
I20260811 18:50:53.847112 19489 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:50:53 dist-test-slave-lgr5 krb5kdc[17873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474253, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:50:53.850585 19489 init.cc:377] Logged in from keytab as kudu/127.25.25.3@KRBTEST.COM (short username kudu)
I20260811 18:50:53.852306 19489 webserver.cc:460] Webserver started at http://127.25.25.3:39473/ using document root <none> and password file <none>
I20260811 18:50:53.853091 19489 fs_manager.cc:359] Metadata directory not provided
I20260811 18:50:53.853236 19489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:50:53.859541 19489 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 18:50:53.862953 19513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:53.864663 19489 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 18:50:53.864873 19489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "9ff9454f802e4ba5ac0de34f20f5ece1"
format_stamp: "Formatted at 2026-08-11 18:50:50 on dist-test-slave-lgr5"
server_key: "4107bc072c322422b10624eb94849169"
server_key_iv: "d7105739568a35874e13a9a8c3ca8d5d"
server_key_version: "encryptionkey@0"
I20260811 18:50:53.866029 19489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:50:53.896351 19489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:50:53.901433 19489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:50:53.901731 19489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:50:53.902896 19489 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:50:53.904492 19489 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:50:53.904589 19489 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:53.904723 19489 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:50:53.904808 19489 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:53.937697 19489 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:43177
I20260811 18:50:53.937767 19698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:43177 every 8 connection(s)
I20260811 18:50:53.939273 19489 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:50:53.944152 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 19489
Aug 11 18:50:53 dist-test-slave-lgr5 krb5kdc[17873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474253, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:50:53.960616 19702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:53.945085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43102 (local address 127.25.25.62:42917)
0811 18:50:53.945634 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:53.945665 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:53.946183 (+ 518us) server_negotiation.cc:407] Connection header received
0811 18:50:53.946344 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:53.946348 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:53.946406 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:53.946495 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:53.948071 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:53.948908 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:53.950345 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:53.950827 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:53.950943 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:53.954133 (+ 3190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:53.954138 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:53.954141 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:53.954176 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:53.957288 (+ 3112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:53.957983 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:53.957988 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:53.957990 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:53.958119 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:53.958526 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:53.958530 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:53.958532 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:53.958849 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:53.959117 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:53.959870 (+ 753us) server_negotiation.cc:299] Negotiation successful
0811 18:50:53.960138 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":245,"threads_started":1}
I20260811 18:50:53.961205 19245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:53.942085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:36287 (local address 127.25.25.62:42917)
0811 18:50:53.942300 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:53.942307 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:53.943680 (+ 1373us) server_negotiation.cc:407] Connection header received
0811 18:50:53.945952 (+ 2272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:53.945958 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:53.946041 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:53.946129 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:53.947729 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:53.948560 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:53.950157 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:53.950597 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:53.950719 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:53.954633 (+ 3914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:53.954637 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:53.954641 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:53.954684 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:53.957474 (+ 2790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:53.958247 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:53.958251 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:53.958253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:53.958394 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:53.958968 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:53.958972 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:53.958975 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:53.959290 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:53.959408 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:53.960216 (+ 808us) server_negotiation.cc:299] Negotiation successful
0811 18:50:53.960435 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 18:50:53.962208 19701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:53.942628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.3:36287)
0811 18:50:53.943470 (+ 842us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:53.943527 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:53.945652 (+ 2125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:53.946403 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:53.946412 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:53.946948 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:50:53.947552 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:53.947570 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:53.948713 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:53.948717 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:53.950001 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:53.950015 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:53.950842 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:53.950850 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:53.951088 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:53.951771 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:50:53.951805 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:50:53.954390 (+ 2585us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:50:53.957627 (+ 3237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:53.957637 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:53.957656 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:53.958125 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:53.958503 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:53.958508 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:53.958512 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:53.958841 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:53.959449 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:50:53.959456 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:50:53.959810 (+ 354us) client_negotiation.cc:769] Sending connection context
0811 18:50:53.960116 (+ 306us) client_negotiation.cc:240] Negotiation successful
0811 18:50:53.960794 (+ 678us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":315,"threads_started":1}
I20260811 18:50:53.963614 19699 heartbeater.cc:347] Connected to a master server at 127.25.25.62:42917
I20260811 18:50:53.963901 19699 heartbeater.cc:464] Registering TS with master...
I20260811 18:50:53.964694 19699 heartbeater.cc:511] Master 127.25.25.62:42917 requested a full tablet report, sending...
I20260811 18:50:53.966346 18895 ts_manager.cc:194] Registered new tserver with Master: 9ff9454f802e4ba5ac0de34f20f5ece1 (127.25.25.3:43177)
I20260811 18:50:53.967185 18895 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.3@KRBTEST.COM'} at 127.25.25.3:36287
I20260811 18:50:53.976686 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:50:53.981050 19243 heartbeater.cc:503] Master 127.25.25.62:42917 was elected leader, sending a full tablet report...
I20260811 18:50:53.985566 19245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:53.977926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43112 (local address 127.25.25.62:42917)
0811 18:50:53.978196 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:53.978202 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:53.979172 (+ 970us) server_negotiation.cc:407] Connection header received
0811 18:50:53.979504 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:53.979511 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:53.979742 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:53.979971 (+ 229us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:50:53.980556 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:53.981439 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:53.983047 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:53.983496 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:53.983606 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:53.984317 (+ 711us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:50:53.984912 (+ 595us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:50:53.985039 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:53.985216 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 18:50:53.985300 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 18:50:53.986600 18895 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:43112:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:50:53.994212 18895 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:50:54.034456 19715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:54.008128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47582 (local address 127.25.25.3:43177)
0811 18:50:54.022025 (+ 13897us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:54.022036 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:54.023236 (+ 1200us) server_negotiation.cc:407] Connection header received
0811 18:50:54.023351 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:54.023358 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:54.023556 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:54.023724 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:50:54.025104 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.026856 (+ 1752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.030923 (+ 4067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.032969 (+ 2046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.033121 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:54.033376 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:54.033928 (+ 552us) server_negotiation.cc:299] Negotiation successful
0811 18:50:54.034121 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13708,"thread_start_us":13531,"threads_started":1}
I20260811 18:50:54.034430 19712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:54.007623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:45615 (local address 127.0.0.1:35938)
0811 18:50:54.019405 (+ 11782us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:54.019486 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:54.019746 (+ 260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:54.025050 (+ 5304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:54.025055 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:54.025083 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:50:54.025446 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:54.025458 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.027762 (+ 2304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.027767 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:54.029725 (+ 1958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:54.029745 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.033150 (+ 3405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.033158 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:54.033415 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:54.033519 (+ 104us) client_negotiation.cc:769] Sending connection context
0811 18:50:54.033674 (+ 155us) client_negotiation.cc:240] Negotiation successful
0811 18:50:54.033902 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11417,"mutex_wait_us":1,"thread_start_us":15055,"threads_started":1}
I20260811 18:50:54.035120 19719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:54.008656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59566 (local address 127.25.25.1:43305)
0811 18:50:54.020610 (+ 11954us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:54.020622 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:54.022982 (+ 2360us) server_negotiation.cc:407] Connection header received
0811 18:50:54.023125 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:54.023136 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:54.023469 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:54.023724 (+ 255us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:50:54.025104 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.026856 (+ 1752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.031072 (+ 4216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.032969 (+ 1897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.033121 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:54.033375 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:54.034596 (+ 1221us) server_negotiation.cc:299] Negotiation successful
0811 18:50:54.034782 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11726,"thread_start_us":11553,"threads_started":1}
I20260811 18:50:54.035153 19711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:54.008458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:43177 (local address 127.0.0.1:47582)
0811 18:50:54.022954 (+ 14496us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:54.022973 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:54.023095 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:54.024108 (+ 1013us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:54.024114 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:54.024161 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:50:54.024803 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:54.024821 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.027016 (+ 2195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.027022 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:54.030331 (+ 3309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:54.030376 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.033510 (+ 3134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.033517 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:54.033680 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:54.033745 (+ 65us) client_negotiation.cc:769] Sending connection context
0811 18:50:54.033818 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 18:50:54.033956 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14357,"mutex_wait_us":205,"spinlock_wait_cycles":1408,"thread_start_us":13786,"threads_started":1}
I20260811 18:50:54.034466 19717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:54.008001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:43305 (local address 127.0.0.1:59566)
0811 18:50:54.022560 (+ 14559us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:54.022586 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:54.022783 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:54.024105 (+ 1322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:54.024114 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:54.024167 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:50:54.024846 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:54.024857 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.027054 (+ 2197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.027058 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:54.030327 (+ 3269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:54.030376 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.033555 (+ 3179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.033560 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:54.033742 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:54.033769 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 18:50:54.033855 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 18:50:54.034005 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14412,"mutex_wait_us":219,"spinlock_wait_cycles":4480,"thread_start_us":12658,"threads_started":1}
I20260811 18:50:54.035423 19713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:54.008059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35938 (local address 127.25.25.2:45615)
0811 18:50:54.024486 (+ 16427us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:54.024496 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:54.024524 (+ 28us) server_negotiation.cc:407] Connection header received
0811 18:50:54.024615 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:54.024620 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:54.024821 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:54.025046 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:50:54.025639 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.027358 (+ 1719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.030041 (+ 2683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.032909 (+ 2868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.033048 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:54.033300 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:54.034143 (+ 843us) server_negotiation.cc:299] Negotiation successful
0811 18:50:54.034346 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16205,"spinlock_wait_cycles":27904,"thread_start_us":16132,"threads_started":1}
I20260811 18:50:54.039366 19588 tablet_service.cc:1467] Processing CreateTablet for tablet 2c2d24cefec744318f9e40b50def82d5 (DEFAULT_TABLE table=test-table [id=25600c5fcd7f4870a685ff9edbcc72e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:50:54.039364 19130 tablet_service.cc:1467] Processing CreateTablet for tablet 2c2d24cefec744318f9e40b50def82d5 (DEFAULT_TABLE table=test-table [id=25600c5fcd7f4870a685ff9edbcc72e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:50:54.039362 19367 tablet_service.cc:1467] Processing CreateTablet for tablet 2c2d24cefec744318f9e40b50def82d5 (DEFAULT_TABLE table=test-table [id=25600c5fcd7f4870a685ff9edbcc72e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:50:54.040787 19588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c2d24cefec744318f9e40b50def82d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:50:54.040840 19130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c2d24cefec744318f9e40b50def82d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:50:54.040843 19367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c2d24cefec744318f9e40b50def82d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:50:54.054245 19720 tablet_bootstrap.cc:492] T 2c2d24cefec744318f9e40b50def82d5 P 9ff9454f802e4ba5ac0de34f20f5ece1: Bootstrap starting.
I20260811 18:50:54.056737 19722 tablet_bootstrap.cc:492] T 2c2d24cefec744318f9e40b50def82d5 P f67291534f6e47de982937436b0bc4f1: Bootstrap starting.
I20260811 18:50:54.059676 19720 tablet_bootstrap.cc:654] T 2c2d24cefec744318f9e40b50def82d5 P 9ff9454f802e4ba5ac0de34f20f5ece1: Neither blocks nor log segments found. Creating new log.
I20260811 18:50:54.060592 19722 tablet_bootstrap.cc:654] T 2c2d24cefec744318f9e40b50def82d5 P f67291534f6e47de982937436b0bc4f1: Neither blocks nor log segments found. Creating new log.
I20260811 18:50:54.061110 19725 tablet_bootstrap.cc:492] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab: Bootstrap starting.
I20260811 18:50:54.061300 19720 log.cc:824] T 2c2d24cefec744318f9e40b50def82d5 P 9ff9454f802e4ba5ac0de34f20f5ece1: Log is configured to *not* fsync() on all Append() calls
I20260811 18:50:54.061874 19722 log.cc:824] T 2c2d24cefec744318f9e40b50def82d5 P f67291534f6e47de982937436b0bc4f1: Log is configured to *not* fsync() on all Append() calls
I20260811 18:50:54.065143 19725 tablet_bootstrap.cc:654] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab: Neither blocks nor log segments found. Creating new log.
I20260811 18:50:54.065191 19720 tablet_bootstrap.cc:492] T 2c2d24cefec744318f9e40b50def82d5 P 9ff9454f802e4ba5ac0de34f20f5ece1: No bootstrap required, opened a new log
I20260811 18:50:54.065511 19722 tablet_bootstrap.cc:492] T 2c2d24cefec744318f9e40b50def82d5 P f67291534f6e47de982937436b0bc4f1: No bootstrap required, opened a new log
I20260811 18:50:54.065500 19720 ts_tablet_manager.cc:1397] T 2c2d24cefec744318f9e40b50def82d5 P 9ff9454f802e4ba5ac0de34f20f5ece1: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.001s
I20260811 18:50:54.065793 19722 ts_tablet_manager.cc:1397] T 2c2d24cefec744318f9e40b50def82d5 P f67291534f6e47de982937436b0bc4f1: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260811 18:50:54.066277 19725 log.cc:824] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab: Log is configured to *not* fsync() on all Append() calls
I20260811 18:50:54.069254 19725 tablet_bootstrap.cc:492] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab: No bootstrap required, opened a new log
I20260811 18:50:54.069671 19725 ts_tablet_manager.cc:1397] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.005s
I20260811 18:50:54.077044 19720 raft_consensus.cc:348] T 2c2d24cefec744318f9e40b50def82d5 P 9ff9454f802e4ba5ac0de34f20f5ece1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 } } peers { permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 } } peers { permanent_uuid: "6cc791c6040c468491720b1d49ab2eab" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 43305 } }
I20260811 18:50:54.077654 19720 raft_consensus.cc:374] T 2c2d24cefec744318f9e40b50def82d5 P 9ff9454f802e4ba5ac0de34f20f5ece1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:50:54.077762 19720 raft_consensus.cc:729] T 2c2d24cefec744318f9e40b50def82d5 P 9ff9454f802e4ba5ac0de34f20f5ece1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ff9454f802e4ba5ac0de34f20f5ece1, State: Initialized, Role: FOLLOWER
I20260811 18:50:54.077615 19722 raft_consensus.cc:348] T 2c2d24cefec744318f9e40b50def82d5 P f67291534f6e47de982937436b0bc4f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 } } peers { permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 } } peers { permanent_uuid: "6cc791c6040c468491720b1d49ab2eab" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 43305 } }
I20260811 18:50:54.078109 19722 raft_consensus.cc:374] T 2c2d24cefec744318f9e40b50def82d5 P f67291534f6e47de982937436b0bc4f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:50:54.078220 19722 raft_consensus.cc:729] T 2c2d24cefec744318f9e40b50def82d5 P f67291534f6e47de982937436b0bc4f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f67291534f6e47de982937436b0bc4f1, State: Initialized, Role: FOLLOWER
I20260811 18:50:54.078145 19725 raft_consensus.cc:348] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 } } peers { permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 } } peers { permanent_uuid: "6cc791c6040c468491720b1d49ab2eab" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 43305 } }
I20260811 18:50:54.078588 19725 raft_consensus.cc:374] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:50:54.078697 19725 raft_consensus.cc:729] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc791c6040c468491720b1d49ab2eab, State: Initialized, Role: FOLLOWER
I20260811 18:50:54.078552 19720 consensus_queue.cc:260] T 2c2d24cefec744318f9e40b50def82d5 P 9ff9454f802e4ba5ac0de34f20f5ece1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 } } peers { permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 } } peers { permanent_uuid: "6cc791c6040c468491720b1d49ab2eab" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 43305 } }
I20260811 18:50:54.078853 19722 consensus_queue.cc:260] T 2c2d24cefec744318f9e40b50def82d5 P f67291534f6e47de982937436b0bc4f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 } } peers { permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 } } peers { permanent_uuid: "6cc791c6040c468491720b1d49ab2eab" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 43305 } }
I20260811 18:50:54.079291 19725 consensus_queue.cc:260] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 } } peers { permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 } } peers { permanent_uuid: "6cc791c6040c468491720b1d49ab2eab" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 43305 } }
I20260811 18:50:54.080334 19483 heartbeater.cc:503] Master 127.25.25.62:42917 was elected leader, sending a full tablet report...
I20260811 18:50:54.081171 19722 ts_tablet_manager.cc:1428] T 2c2d24cefec744318f9e40b50def82d5 P f67291534f6e47de982937436b0bc4f1: Time spent starting tablet: real 0.015s user 0.014s sys 0.001s
I20260811 18:50:54.083812 19725 ts_tablet_manager.cc:1428] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab: Time spent starting tablet: real 0.014s user 0.010s sys 0.003s
I20260811 18:50:54.085572 19699 heartbeater.cc:503] Master 127.25.25.62:42917 was elected leader, sending a full tablet report...
I20260811 18:50:54.088732 19720 ts_tablet_manager.cc:1428] T 2c2d24cefec744318f9e40b50def82d5 P 9ff9454f802e4ba5ac0de34f20f5ece1: Time spent starting tablet: real 0.023s user 0.008s sys 0.013s
W20260811 18:50:54.184386 19485 tablet.cc:2369] T 2c2d24cefec744318f9e40b50def82d5 P f67291534f6e47de982937436b0bc4f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:50:54.191188 19700 tablet.cc:2369] T 2c2d24cefec744318f9e40b50def82d5 P 9ff9454f802e4ba5ac0de34f20f5ece1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:50:54.193128 19244 tablet.cc:2369] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:50:54.215590 19734 raft_consensus.cc:482] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:50:54.215952 19734 raft_consensus.cc:504] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 } } peers { permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 } } peers { permanent_uuid: "6cc791c6040c468491720b1d49ab2eab" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 43305 } }
I20260811 18:50:54.217789 19734 leader_election.cc:288] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f67291534f6e47de982937436b0bc4f1 (127.25.25.2:45615), 9ff9454f802e4ba5ac0de34f20f5ece1 (127.25.25.3:43177)
I20260811 18:50:54.227386 19713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:54.218292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:59457 (local address 127.25.25.2:45615)
0811 18:50:54.218538 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:54.218544 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:54.219633 (+ 1089us) server_negotiation.cc:407] Connection header received
0811 18:50:54.219775 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:54.219780 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:54.219866 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:54.219940 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:50:54.220601 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.221641 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.224741 (+ 3100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.226038 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.226208 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:54.226320 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:54.226948 (+ 628us) server_negotiation.cc:299] Negotiation successful
0811 18:50:54.227109 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260811 18:50:54.227666 19738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:54.218332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:45615 (local address 127.25.25.1:59457)
0811 18:50:54.219527 (+ 1195us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:54.219542 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:54.219659 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:54.219989 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:54.219993 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:54.220020 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:50:54.220438 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:54.220447 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.221771 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.221775 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:54.224499 (+ 2724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:54.224521 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.226438 (+ 1917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.226444 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:54.226700 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:54.226760 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 18:50:54.226883 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 18:50:54.227093 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1100,"mutex_wait_us":287,"thread_start_us":828,"threads_started":1}
I20260811 18:50:54.227694 19735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:54.218293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:43177 (local address 127.25.25.1:49695)
0811 18:50:54.219170 (+ 877us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:54.219191 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:54.219385 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:54.219753 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:54.219758 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:54.219783 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:50:54.220234 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:54.220253 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.221695 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.221701 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:54.224500 (+ 2799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:54.224520 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.226400 (+ 1880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.226409 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:54.226694 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:54.226754 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 18:50:54.226884 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 18:50:54.227093 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":735,"mutex_wait_us":215,"thread_start_us":438,"threads_started":1}
I20260811 18:50:54.228669 19715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:54.218281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:49695 (local address 127.25.25.3:43177)
0811 18:50:54.218518 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:54.218525 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:54.219345 (+ 820us) server_negotiation.cc:407] Connection header received
0811 18:50:54.219539 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:54.219543 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:54.219615 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:54.219707 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:50:54.220420 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.221547 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.224747 (+ 3200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.226048 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.226208 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:54.226320 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:54.227670 (+ 1350us) server_negotiation.cc:299] Negotiation successful
0811 18:50:54.227874 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 18:50:54.228993 19397 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c2d24cefec744318f9e40b50def82d5" candidate_uuid: "6cc791c6040c468491720b1d49ab2eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f67291534f6e47de982937436b0bc4f1" is_pre_election: true
I20260811 18:50:54.229657 19397 raft_consensus.cc:2454] T 2c2d24cefec744318f9e40b50def82d5 P f67291534f6e47de982937436b0bc4f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc791c6040c468491720b1d49ab2eab in term 0.
I20260811 18:50:54.229645 19619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c2d24cefec744318f9e40b50def82d5" candidate_uuid: "6cc791c6040c468491720b1d49ab2eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" is_pre_election: true
I20260811 18:50:54.230218 19619 raft_consensus.cc:2454] T 2c2d24cefec744318f9e40b50def82d5 P 9ff9454f802e4ba5ac0de34f20f5ece1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc791c6040c468491720b1d49ab2eab in term 0.
I20260811 18:50:54.230471 19048 leader_election.cc:302] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc791c6040c468491720b1d49ab2eab, f67291534f6e47de982937436b0bc4f1; no voters:
I20260811 18:50:54.230942 19734 raft_consensus.cc:2781] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:50:54.231096 19734 raft_consensus.cc:482] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:50:54.231194 19734 raft_consensus.cc:3037] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:50:54.233632 19734 raft_consensus.cc:504] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 } } peers { permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 } } peers { permanent_uuid: "6cc791c6040c468491720b1d49ab2eab" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 43305 } }
I20260811 18:50:54.234345 19734 leader_election.cc:288] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [CANDIDATE]: Term 1 election: Requested vote from peers f67291534f6e47de982937436b0bc4f1 (127.25.25.2:45615), 9ff9454f802e4ba5ac0de34f20f5ece1 (127.25.25.3:43177)
I20260811 18:50:54.234985 19619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c2d24cefec744318f9e40b50def82d5" candidate_uuid: "6cc791c6040c468491720b1d49ab2eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1"
I20260811 18:50:54.235006 19397 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c2d24cefec744318f9e40b50def82d5" candidate_uuid: "6cc791c6040c468491720b1d49ab2eab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f67291534f6e47de982937436b0bc4f1"
I20260811 18:50:54.235212 19619 raft_consensus.cc:3037] T 2c2d24cefec744318f9e40b50def82d5 P 9ff9454f802e4ba5ac0de34f20f5ece1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:50:54.235241 19397 raft_consensus.cc:3037] T 2c2d24cefec744318f9e40b50def82d5 P f67291534f6e47de982937436b0bc4f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:50:54.237622 19397 raft_consensus.cc:2454] T 2c2d24cefec744318f9e40b50def82d5 P f67291534f6e47de982937436b0bc4f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc791c6040c468491720b1d49ab2eab in term 1.
I20260811 18:50:54.237671 19619 raft_consensus.cc:2454] T 2c2d24cefec744318f9e40b50def82d5 P 9ff9454f802e4ba5ac0de34f20f5ece1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc791c6040c468491720b1d49ab2eab in term 1.
I20260811 18:50:54.238140 19048 leader_election.cc:302] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc791c6040c468491720b1d49ab2eab, f67291534f6e47de982937436b0bc4f1; no voters:
I20260811 18:50:54.238436 19734 raft_consensus.cc:2781] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:50:54.238929 19734 raft_consensus.cc:686] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [term 1 LEADER]: Becoming Leader. State: Replica: 6cc791c6040c468491720b1d49ab2eab, State: Running, Role: LEADER
I20260811 18:50:54.239421 19734 consensus_queue.cc:237] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 } } peers { permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 } } peers { permanent_uuid: "6cc791c6040c468491720b1d49ab2eab" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 43305 } }
I20260811 18:50:54.244781 18895 catalog_manager.cc:5495] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cc791c6040c468491720b1d49ab2eab (127.25.25.1). New cstate: current_term: 1 leader_uuid: "6cc791c6040c468491720b1d49ab2eab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc791c6040c468491720b1d49ab2eab" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 43305 } health_report { overall_health: HEALTHY } } }
I20260811 18:50:54.289301 19719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:54.282652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59578 (local address 127.25.25.1:43305)
0811 18:50:54.282876 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:54.282881 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:54.282901 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:50:54.283140 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:54.283146 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:54.283238 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:54.283380 (+ 142us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:50:54.283837 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.284747 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.286561 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.287050 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.287178 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:54.288007 (+ 829us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:50:54.288675 (+ 668us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:50:54.288820 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:54.288977 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 18:50:54.289084 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 18:50:54.298588 19397 raft_consensus.cc:1261] T 2c2d24cefec744318f9e40b50def82d5 P f67291534f6e47de982937436b0bc4f1 [term 1 FOLLOWER]: Refusing update from remote peer 6cc791c6040c468491720b1d49ab2eab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:50:54.298591 19619 raft_consensus.cc:1261] T 2c2d24cefec744318f9e40b50def82d5 P 9ff9454f802e4ba5ac0de34f20f5ece1 [term 1 FOLLOWER]: Refusing update from remote peer 6cc791c6040c468491720b1d49ab2eab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:50:54.299801 19734 consensus_queue.cc:1035] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:50:54.300160 19739 consensus_queue.cc:1035] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:50:54.310508 19741 mvcc.cc:205] Tried to move back new op lower bound from 7317398545595113472 to 7317398545368788992. Current Snapshot: MvccSnapshot[applied={T|T < 7317398545595113472}]
I20260811 18:50:54.327905 18895 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:43112:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:50:54.328243 18895 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:43112:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:50:54.332168 18895 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac: Sending DeleteTablet for 3 replicas of tablet 2c2d24cefec744318f9e40b50def82d5
I20260811 18:50:54.333534 19588 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c2d24cefec744318f9e40b50def82d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:50:54 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:47582
I20260811 18:50:54.333587 19367 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c2d24cefec744318f9e40b50def82d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:50:54 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:35938
I20260811 18:50:54.334383 19130 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c2d24cefec744318f9e40b50def82d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:50:54 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:59566
I20260811 18:50:54.337177 19761 tablet_replica.cc:330] T 2c2d24cefec744318f9e40b50def82d5 P 9ff9454f802e4ba5ac0de34f20f5ece1: stopping tablet replica
I20260811 18:50:54.337271 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 18962
I20260811 18:50:54.337815 19761 raft_consensus.cc:2229] T 2c2d24cefec744318f9e40b50def82d5 P 9ff9454f802e4ba5ac0de34f20f5ece1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:50:54.338653 19761 raft_consensus.cc:2258] T 2c2d24cefec744318f9e40b50def82d5 P 9ff9454f802e4ba5ac0de34f20f5ece1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:50:54.339630 19759 tablet_replica.cc:330] T 2c2d24cefec744318f9e40b50def82d5 P f67291534f6e47de982937436b0bc4f1: stopping tablet replica
I20260811 18:50:54.340135 19759 raft_consensus.cc:2229] T 2c2d24cefec744318f9e40b50def82d5 P f67291534f6e47de982937436b0bc4f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:50:54.340673 19759 raft_consensus.cc:2258] T 2c2d24cefec744318f9e40b50def82d5 P f67291534f6e47de982937436b0bc4f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:50:54.342892 19761 ts_tablet_manager.cc:1905] T 2c2d24cefec744318f9e40b50def82d5 P 9ff9454f802e4ba5ac0de34f20f5ece1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:50:54.342970 19759 ts_tablet_manager.cc:1905] T 2c2d24cefec744318f9e40b50def82d5 P f67291534f6e47de982937436b0bc4f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:50:54.350335 19759 ts_tablet_manager.cc:1918] T 2c2d24cefec744318f9e40b50def82d5 P f67291534f6e47de982937436b0bc4f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:50:54.350370 19761 ts_tablet_manager.cc:1918] T 2c2d24cefec744318f9e40b50def82d5 P 9ff9454f802e4ba5ac0de34f20f5ece1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:50:54.350569 19759 log.cc:1196] T 2c2d24cefec744318f9e40b50def82d5 P f67291534f6e47de982937436b0bc4f1: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/wal/wals/2c2d24cefec744318f9e40b50def82d5
I20260811 18:50:54.350780 19761 log.cc:1196] T 2c2d24cefec744318f9e40b50def82d5 P 9ff9454f802e4ba5ac0de34f20f5ece1: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/wal/wals/2c2d24cefec744318f9e40b50def82d5
I20260811 18:50:54.351182 19759 ts_tablet_manager.cc:1939] T 2c2d24cefec744318f9e40b50def82d5 P f67291534f6e47de982937436b0bc4f1: Deleting consensus metadata
I20260811 18:50:54.351613 19761 ts_tablet_manager.cc:1939] T 2c2d24cefec744318f9e40b50def82d5 P 9ff9454f802e4ba5ac0de34f20f5ece1: Deleting consensus metadata
I20260811 18:50:54.353598 18874 catalog_manager.cc:4841] TS f67291534f6e47de982937436b0bc4f1 (127.25.25.2:45615): tablet 2c2d24cefec744318f9e40b50def82d5 (table test-table [id=25600c5fcd7f4870a685ff9edbcc72e7]) successfully deleted
I20260811 18:50:54.353626 18869 catalog_manager.cc:4841] TS 9ff9454f802e4ba5ac0de34f20f5ece1 (127.25.25.3:43177): tablet 2c2d24cefec744318f9e40b50def82d5 (table test-table [id=25600c5fcd7f4870a685ff9edbcc72e7]) successfully deleted
I20260811 18:50:54.356691 19763 tablet_replica.cc:330] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab: stopping tablet replica
I20260811 18:50:54.357247 19763 raft_consensus.cc:2229] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:50:54.358016 19763 raft_consensus.cc:2258] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:50:54.358685 19719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:54.338928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59594 (local address 127.25.25.1:43305)
0811 18:50:54.339139 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:54.339146 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:54.339167 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:50:54.339237 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:54.339242 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:54.339322 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:54.339420 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:54.341351 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.342554 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.344490 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.345180 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.345302 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:54.350750 (+ 5448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:54.350772 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:54.350805 (+ 33us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:54.350873 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:54.354920 (+ 4047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:54.355873 (+ 953us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:54.355886 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:54.355890 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:54.356154 (+ 264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:54.356762 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:54.356767 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:54.356770 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:54.357216 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:54.357573 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:54.357976 (+ 403us) server_negotiation.cc:299] Negotiation successful
0811 18:50:54.358254 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 18:50:54.359560 19230 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:50:54.360769 19763 ts_tablet_manager.cc:1905] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:50:54.470278 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 18962
W20260811 18:50:54.493171 18871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.25.1:43305 (error 108)
I20260811 18:50:54.493425 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 19247
I20260811 18:50:54.494910 19717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:54.494467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:43305 (local address 127.0.0.1:59606)
0811 18:50:54.494645 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:54.494750 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:43305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260811 18:50:54.495167 18871 catalog_manager.cc:4584] TS 6cc791c6040c468491720b1d49ab2eab (127.25.25.1:43305): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2c2d24cefec744318f9e40b50def82d5: Network error: Client connection negotiation failed: client connection to 127.25.25.1:43305: connect: Connection refused (error 111)
I20260811 18:50:54.509743 19713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:54.494322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35942 (local address 127.25.25.2:45615)
0811 18:50:54.494507 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:54.494513 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:54.494534 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:50:54.494740 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:54.494746 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:54.494841 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:54.494935 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:54.496530 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.497314 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.498852 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.499485 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.499631 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:54.502639 (+ 3008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:54.502661 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:54.502681 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:54.502733 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:54.506249 (+ 3516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:54.507254 (+ 1005us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:54.507264 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:54.507266 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:54.507444 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:54.507887 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:54.507893 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:54.507895 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:54.508437 (+ 542us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:54.508747 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:54.509118 (+ 371us) server_negotiation.cc:299] Negotiation successful
0811 18:50:54.509386 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 18:50:54.510437 19473 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:50:54.548950 19717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:54.548434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:43305 (local address 127.0.0.1:59622)
0811 18:50:54.548677 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:54.548792 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:43305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260811 18:50:54.550122 19717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:54.549734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:43305 (local address 127.0.0.1:59636)
0811 18:50:54.549892 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:54.549987 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:43305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 18:50:54.603492 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 19247
I20260811 18:50:54.611095 19717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:54.610527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:43305 (local address 127.0.0.1:59652)
0811 18:50:54.610773 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:54.610888 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:43305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260811 18:50:54.612315 19717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:54.611884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:43305 (local address 127.0.0.1:59656)
0811 18:50:54.612056 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:54.612165 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:43305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260811 18:50:54.638895 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 19489
I20260811 18:50:54.652670 19715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:54.639648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47598 (local address 127.25.25.3:43177)
0811 18:50:54.639836 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:54.639842 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:54.639863 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:50:54.640046 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:54.640051 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:54.640163 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:54.640251 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:54.641669 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.642397 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.643762 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:54.644228 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:54.644359 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:54.646966 (+ 2607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:54.646982 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:54.646999 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:54.647043 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:54.649659 (+ 2616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:54.650397 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:54.650405 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:54.650408 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:54.650587 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:54.651031 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:54.651035 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:54.651037 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:54.651425 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:54.651708 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:54.652065 (+ 357us) server_negotiation.cc:299] Negotiation successful
0811 18:50:54.652341 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 18:50:54.653357 19690 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:50:54.693179 19717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:54.692594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:43305 (local address 127.0.0.1:59668)
0811 18:50:54.692848 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:54.692973 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:43305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260811 18:50:54.694442 19717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:54.693999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:43305 (local address 127.0.0.1:59678)
0811 18:50:54.694211 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:54.694306 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:43305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260811 18:50:54.745182 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 19489
I20260811 18:50:54.777957 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 18840
I20260811 18:50:54.779273 18952 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:50:54.899642 19717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:54.899023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:43305 (local address 127.0.0.1:59692)
0811 18:50:54.899287 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:54.899431 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:43305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 18:50:54.899622 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 18840
I20260811 18:50:54.929600 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:42917
--webserver_interface=127.25.25.62
--webserver_port=35163
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:44237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:42917
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:50:55.305069 19770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:50:55.305450 19770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:50:55.305595 19770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:50:55.313657 19770 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:50:55.313838 19770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:50:55.313928 19770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:50:55.314013 19770 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:50:55.314075 19770 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:50:55.324849 19770 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:44237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:42917
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:42917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=35163
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:50:55.326354 19770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:50:55.327818 19770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:50:55.340554 19782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:55.340626 19779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:55.341128 19777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:50:55.341872 19770 server_base.cc:1034] running on GCE node
I20260811 18:50:55.342727 19770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:50:55.344390 19770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:50:55.345628 19770 hybrid_clock.cc:648] HybridClock initialized: now 1786474255345578 us; error 38 us; skew 500 ppm
I20260811 18:50:55.346017 19770 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:50:55 dist-test-slave-lgr5 krb5kdc[17873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474255, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:50:55.349210 19770 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:50:55.350992 19770 webserver.cc:460] Webserver started at http://127.25.25.62:35163/ using document root <none> and password file <none>
I20260811 18:50:55.351718 19770 fs_manager.cc:359] Metadata directory not provided
I20260811 18:50:55.351825 19770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:50:55.357946 19770 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 18:50:55.361271 19797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:55.362910 19770 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 18:50:55.363078 19770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "9567f2f2049744a8a0f2239c663d36ac"
format_stamp: "Formatted at 2026-08-11 18:50:49 on dist-test-slave-lgr5"
server_key: "aaaa9472bc1a20254b4e14627a4c8e1c"
server_key_iv: "dae1bc19c0805d825286799e5acbe799"
server_key_version: "encryptionkey@0"
I20260811 18:50:55.364208 19770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:50:55.393055 19770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:50:55.398105 19770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:50:55.398362 19770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:50:55.418143 19770 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:42917
I20260811 18:50:55.418162 19879 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:42917 every 8 connection(s)
I20260811 18:50:55.419788 19770 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:50:55.421694 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 19770
I20260811 18:50:55.422776 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:43305
--local_ip_for_outbound_sockets=127.25.25.1
--tserver_master_addrs=127.25.25.62:42917
--webserver_port=35461
--webserver_interface=127.25.25.1
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:44237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:50:55.429849 19882 sys_catalog.cc:263] Verifying existing consensus state
I20260811 18:50:55.435017 19882 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac: Bootstrap starting.
I20260811 18:50:55.457307 19882 log.cc:824] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac: Log is configured to *not* fsync() on all Append() calls
I20260811 18:50:55.480293 19882 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:50:55.481201 19882 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac: Bootstrap complete.
I20260811 18:50:55.497792 19882 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9567f2f2049744a8a0f2239c663d36ac" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42917 } }
I20260811 18:50:55.499439 19882 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9567f2f2049744a8a0f2239c663d36ac, State: Initialized, Role: FOLLOWER
I20260811 18:50:55.500398 19882 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9567f2f2049744a8a0f2239c663d36ac" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42917 } }
I20260811 18:50:55.500733 19882 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:50:55.500895 19882 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:50:55.501101 19882 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [term 2 FOLLOWER]: Advancing to term 3
I20260811 18:50:55.508162 19882 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9567f2f2049744a8a0f2239c663d36ac" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42917 } }
I20260811 18:50:55.508811 19882 leader_election.cc:302] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9567f2f2049744a8a0f2239c663d36ac; no voters:
I20260811 18:50:55.509528 19882 leader_election.cc:288] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 18:50:55.509684 19888 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [term 3 FOLLOWER]: Leader election won for term 3
I20260811 18:50:55.510918 19888 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [term 3 LEADER]: Becoming Leader. State: Replica: 9567f2f2049744a8a0f2239c663d36ac, State: Running, Role: LEADER
I20260811 18:50:55.511767 19888 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9567f2f2049744a8a0f2239c663d36ac" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42917 } }
I20260811 18:50:55.512135 19882 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:50:55.514659 19890 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9567f2f2049744a8a0f2239c663d36ac. Latest consensus state: current_term: 3 leader_uuid: "9567f2f2049744a8a0f2239c663d36ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9567f2f2049744a8a0f2239c663d36ac" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42917 } } }
I20260811 18:50:55.515125 19890 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [sys.catalog]: This master's current role is: LEADER
I20260811 18:50:55.515738 19889 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "9567f2f2049744a8a0f2239c663d36ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9567f2f2049744a8a0f2239c663d36ac" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42917 } } }
I20260811 18:50:55.516053 19889 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9567f2f2049744a8a0f2239c663d36ac [sys.catalog]: This master's current role is: LEADER
I20260811 18:50:55.526407 19901 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:50:55.542634 19901 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:50:55.544699 19901 catalog_manager.cc:1259] Loaded cluster ID: 878a0dc0c0b4465ebe9b180d2333f4d3
I20260811 18:50:55.544868 19901 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 18:50:55.547150 19901 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f6301dd69ad google::LogMessage::Fail() at ??:0
@ 0x7f6301dd988a google::LogMessage::SendToLog() at ??:0
@ 0x7f6301dd64de google::LogMessage::Flush() at ??:0
@ 0x7f6301dd7a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f6317809512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f6317806976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f631788e610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f631788e439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f6304a22345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f6304a2591c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f6304a25799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f6304a00eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f6307cda6db start_thread at ??:0
@ 0x7f6300c7061f clone at ??:0
W20260811 18:50:55.873327 19884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:50:55.873658 19884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:50:55.873759 19884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:50:55.881435 19884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:50:55.881583 19884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:50:55.881704 19884 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:50:55.892191 19884 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:44237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:43305
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=35461
--tserver_master_addrs=127.25.25.62:42917
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:50:55.893579 19884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:50:55.894939 19884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:50:55.908787 19958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:55.908813 19961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:55.908990 19966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:50:55.909665 19884 server_base.cc:1034] running on GCE node
I20260811 18:50:55.910358 19884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:50:55.911412 19884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:50:55.912619 19884 hybrid_clock.cc:648] HybridClock initialized: now 1786474255912564 us; error 44 us; skew 500 ppm
I20260811 18:50:55.912994 19884 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:50:55 dist-test-slave-lgr5 krb5kdc[17873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474255, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:50:55.916522 19884 init.cc:377] Logged in from keytab as kudu/127.25.25.1@KRBTEST.COM (short username kudu)
I20260811 18:50:55.918213 19884 webserver.cc:460] Webserver started at http://127.25.25.1:35461/ using document root <none> and password file <none>
I20260811 18:50:55.918999 19884 fs_manager.cc:359] Metadata directory not provided
I20260811 18:50:55.919134 19884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:50:55.925311 19884 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 18:50:55.928786 19980 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:55.930442 19884 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260811 18:50:55.930629 19884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "6cc791c6040c468491720b1d49ab2eab"
format_stamp: "Formatted at 2026-08-11 18:50:49 on dist-test-slave-lgr5"
server_key: "ec3d38c8aeb17709c9b0ca84982359a7"
server_key_iv: "fdba48f9de9e3c90865a54bd5ce0fd16"
server_key_version: "encryptionkey@0"
I20260811 18:50:55.931734 19884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:50:55.953915 19884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:50:55.958455 19884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:50:55.958714 19884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:50:55.959794 19884 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:50:55.961820 19988 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260811 18:50:55.968039 19884 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 18:50:55.968235 19884 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260811 18:50:55.968384 19884 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 18:50:55.972271 19884 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 18:50:55.972409 19884 ts_tablet_manager.cc:589] Time spent register tablets: real 0.004s user 0.004s sys 0.000s
I20260811 18:50:55.972867 19988 tablet_bootstrap.cc:492] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab: Bootstrap starting.
I20260811 18:50:55.983989 19988 log.cc:824] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab: Log is configured to *not* fsync() on all Append() calls
I20260811 18:50:55.998387 19988 tablet_bootstrap.cc:492] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:50:55.999219 19988 tablet_bootstrap.cc:492] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab: Bootstrap complete.
I20260811 18:50:55.999871 19988 ts_tablet_manager.cc:1397] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab: Time spent bootstrapping tablet: real 0.027s user 0.026s sys 0.000s
I20260811 18:50:56.010579 19988 raft_consensus.cc:348] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 } } peers { permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 } } peers { permanent_uuid: "6cc791c6040c468491720b1d49ab2eab" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 43305 } }
I20260811 18:50:56.012595 19988 raft_consensus.cc:729] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc791c6040c468491720b1d49ab2eab, State: Initialized, Role: FOLLOWER
I20260811 18:50:56.014091 19988 consensus_queue.cc:260] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 } } peers { permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 } } peers { permanent_uuid: "6cc791c6040c468491720b1d49ab2eab" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 43305 } }
I20260811 18:50:56.016489 19988 ts_tablet_manager.cc:1428] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab: Time spent starting tablet: real 0.016s user 0.016s sys 0.000s
I20260811 18:50:56.022433 19884 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:43305
I20260811 18:50:56.022471 20179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:43305 every 8 connection(s)
I20260811 18:50:56.023686 19884 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:50:56.029241 20183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:56.027008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.1:58777)
0811 18:50:56.027923 (+ 915us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:56.028227 (+ 304us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":409,"threads_started":1}
W20260811 18:50:56.030000 20180 heartbeater.cc:644] Failed to heartbeat to 127.25.25.62:42917 (0 consecutive failures): Network error: Failed to ping master at 127.25.25.62:42917: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
I20260811 18:50:56.031028 20183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:56.030634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.1:53985)
0811 18:50:56.030824 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:56.030905 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260811 18:50:56.032150 20183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:56.031725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.1:47603)
0811 18:50:56.031889 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:56.031970 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 18:50:56.032505 20180 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 18:50:56.032753 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 19884
I20260811 18:50:56.033408 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:45615
--local_ip_for_outbound_sockets=127.25.25.2
--tserver_master_addrs=127.25.25.62:42917
--webserver_port=35699
--webserver_interface=127.25.25.2
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:44237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:50:56.400061 20184 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:50:56.400460 20184 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:50:56.400609 20184 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:50:56.408385 20184 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:50:56.408535 20184 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:50:56.408695 20184 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:50:56.419148 20184 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:44237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:45615
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=35699
--tserver_master_addrs=127.25.25.62:42917
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:50:56.420619 20184 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:50:56.422030 20184 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:50:56.436484 20193 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:56.436434 20200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:56.436448 20196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:50:56.437345 20184 server_base.cc:1034] running on GCE node
I20260811 18:50:56.438098 20184 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:50:56.439147 20184 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:50:56.440341 20184 hybrid_clock.cc:648] HybridClock initialized: now 1786474256440276 us; error 66 us; skew 500 ppm
I20260811 18:50:56.440673 20184 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:50:56 dist-test-slave-lgr5 krb5kdc[17873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474256, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:50:56.443974 20184 init.cc:377] Logged in from keytab as kudu/127.25.25.2@KRBTEST.COM (short username kudu)
I20260811 18:50:56.445771 20184 webserver.cc:460] Webserver started at http://127.25.25.2:35699/ using document root <none> and password file <none>
I20260811 18:50:56.446527 20184 fs_manager.cc:359] Metadata directory not provided
I20260811 18:50:56.446642 20184 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:50:56.452747 20184 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 18:50:56.455899 20209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:56.457634 20184 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:50:56.457824 20184 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "f67291534f6e47de982937436b0bc4f1"
format_stamp: "Formatted at 2026-08-11 18:50:50 on dist-test-slave-lgr5"
server_key: "df988355afc2a5d05b6303d3f7eec4ff"
server_key_iv: "7c8e18291c31c247899436c315aeaf1b"
server_key_version: "encryptionkey@0"
I20260811 18:50:56.458953 20184 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:50:56.479553 20184 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:50:56.484815 20184 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:50:56.485126 20184 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:50:56.486342 20184 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:50:56.487979 20184 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:50:56.488102 20184 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:56.488230 20184 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:50:56.488294 20184 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:56.521994 20184 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:45615
I20260811 18:50:56.522068 20389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:45615 every 8 connection(s)
I20260811 18:50:56.523556 20184 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:50:56.525323 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 20184
I20260811 18:50:56.526122 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:43177
--local_ip_for_outbound_sockets=127.25.25.3
--tserver_master_addrs=127.25.25.62:42917
--webserver_port=39473
--webserver_interface=127.25.25.3
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:44237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:50:56.529513 20392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:56.527034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.2:50839)
0811 18:50:56.527934 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:56.528231 (+ 297us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":334,"threads_started":1}
W20260811 18:50:56.530344 20390 heartbeater.cc:644] Failed to heartbeat to 127.25.25.62:42917 (0 consecutive failures): Network error: Failed to ping master at 127.25.25.62:42917: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
I20260811 18:50:56.531389 20392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:56.530992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.2:46083)
0811 18:50:56.531164 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:56.531249 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 18:50:56.532457 20392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:56.532065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.2:52651)
0811 18:50:56.532225 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:56.532313 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260811 18:50:56.532990 20390 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 18:50:56.888875 20393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:50:56.889197 20393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:50:56.889293 20393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:50:56.896921 20393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:50:56.897091 20393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:50:56.897287 20393 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:50:56.907851 20393 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:44237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:43177
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=39473
--tserver_master_addrs=127.25.25.62:42917
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:50:56.909281 20393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:50:56.910763 20393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:50:56.925580 20407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:56.925875 20405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:50:56.925658 20402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:50:56.926616 20393 server_base.cc:1034] running on GCE node
I20260811 18:50:56.927346 20393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:50:56.928493 20393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:50:56.929733 20393 hybrid_clock.cc:648] HybridClock initialized: now 1786474256929671 us; error 88 us; skew 500 ppm
I20260811 18:50:56.930119 20393 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:50:56 dist-test-slave-lgr5 krb5kdc[17873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474256, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:50:56.933868 20393 init.cc:377] Logged in from keytab as kudu/127.25.25.3@KRBTEST.COM (short username kudu)
I20260811 18:50:56.935673 20393 webserver.cc:460] Webserver started at http://127.25.25.3:39473/ using document root <none> and password file <none>
I20260811 18:50:56.936580 20393 fs_manager.cc:359] Metadata directory not provided
I20260811 18:50:56.936723 20393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:50:56.943033 20393 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.002s
I20260811 18:50:56.946517 20417 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:56.948269 20393 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 18:50:56.948489 20393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "9ff9454f802e4ba5ac0de34f20f5ece1"
format_stamp: "Formatted at 2026-08-11 18:50:50 on dist-test-slave-lgr5"
server_key: "4107bc072c322422b10624eb94849169"
server_key_iv: "d7105739568a35874e13a9a8c3ca8d5d"
server_key_version: "encryptionkey@0"
I20260811 18:50:56.949726 20393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:50:56.979445 20393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:50:56.984706 20393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:50:56.985061 20393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:50:56.986218 20393 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:50:56.987862 20393 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:50:56.987987 20393 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:56.988142 20393 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:50:56.988220 20393 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:50:57.023253 20393 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:43177
I20260811 18:50:57.023301 20596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:43177 every 8 connection(s)
I20260811 18:50:57.024799 20393 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:50:57.029356 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 20393
I20260811 18:50:57.030326 20600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:57.027817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.3:43467)
0811 18:50:57.028749 (+ 932us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:57.029117 (+ 368us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":390,"threads_started":1}
W20260811 18:50:57.031315 20597 heartbeater.cc:644] Failed to heartbeat to 127.25.25.62:42917 (0 consecutive failures): Network error: Failed to ping master at 127.25.25.62:42917: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
I20260811 18:50:57.032370 20600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:57.031926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.3:47027)
0811 18:50:57.032140 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:57.032234 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260811 18:50:57.033490 20600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:57.033091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.3:53171)
0811 18:50:57.033244 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:57.033364 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 18:50:57.033748 20597 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 18:50:57.033900 20605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:57.033036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.1:41563)
0811 18:50:57.033508 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:57.033644 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":219,"threads_started":1}
I20260811 18:50:57.534695 20608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:57.533711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.2:52523)
0811 18:50:57.534307 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:57.534451 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":286,"threads_started":1}
I20260811 18:50:57.793612 20609 raft_consensus.cc:482] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:50:57.793977 20609 raft_consensus.cc:504] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 } } peers { permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 } } peers { permanent_uuid: "6cc791c6040c468491720b1d49ab2eab" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 43305 } }
I20260811 18:50:57.795720 20609 leader_election.cc:288] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f67291534f6e47de982937436b0bc4f1 (127.25.25.2:45615), 9ff9454f802e4ba5ac0de34f20f5ece1 (127.25.25.3:43177)
Aug 11 18:50:57 dist-test-slave-lgr5 krb5kdc[17873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474255, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for kudu/127.25.25.3@KRBTEST.COM
Aug 11 18:50:57 dist-test-slave-lgr5 krb5kdc[17873](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474255, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for kudu/127.25.25.2@KRBTEST.COM
I20260811 18:50:57.836678 20615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:57.796489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:59547 (local address 127.25.25.3:43177)
0811 18:50:57.807390 (+ 10901us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:57.807415 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:57.809003 (+ 1588us) server_negotiation.cc:407] Connection header received
0811 18:50:57.811143 (+ 2140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:57.811153 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:57.811593 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:57.811937 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:57.814471 (+ 2534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:57.815989 (+ 1518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:57.817987 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:57.818719 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:57.818908 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:57.828988 (+ 10080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:57.829005 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:57.829026 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:57.829079 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:57.832236 (+ 3157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:57.833334 (+ 1098us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:57.833342 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:57.833347 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:57.833545 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:57.834037 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:57.834041 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:57.834043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:57.834625 (+ 582us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:57.834819 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:57.835741 (+ 922us) server_negotiation.cc:299] Negotiation successful
0811 18:50:57.836213 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10644,"thread_start_us":10955,"threads_started":1}
I20260811 18:50:57.836663 20612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:57.796282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:43177 (local address 127.25.25.1:59547)
0811 18:50:57.808842 (+ 12560us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:57.808858 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:57.809361 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:57.812183 (+ 2822us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:57.812195 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:57.813176 (+ 981us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:50:57.814142 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:57.814161 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:57.816235 (+ 2074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:57.816240 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:57.817805 (+ 1565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:57.817824 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:57.819007 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:57.819016 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:57.819262 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:57.825126 (+ 5864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:50:57.825167 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:50:57.828544 (+ 3377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:50:57.832458 (+ 3914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:57.832470 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:57.832488 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:57.833160 (+ 672us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:57.833665 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:57.833670 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:57.833674 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:57.833911 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:57.834767 (+ 856us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:50:57.834776 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:50:57.835123 (+ 347us) client_negotiation.cc:769] Sending connection context
0811 18:50:57.835403 (+ 280us) client_negotiation.cc:240] Negotiation successful
0811 18:50:57.836050 (+ 647us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12446,"mutex_wait_us":213,"spinlock_wait_cycles":113024,"thread_start_us":12202,"threads_started":1}
I20260811 18:50:57.836725 20611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:57.796047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:45615 (local address 127.25.25.1:55935)
0811 18:50:57.808677 (+ 12630us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:57.808747 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0811 18:50:57.809376 (+ 629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:50:57.812184 (+ 2808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:50:57.812195 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:50:57.813175 (+ 980us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:50:57.814047 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:57.814108 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:57.816233 (+ 2125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:57.816238 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:57.817811 (+ 1573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:50:57.817827 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:50:57.818947 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:50:57.818955 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:50:57.819259 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:57.825127 (+ 5868us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:50:57.825173 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:50:57.828683 (+ 3510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:50:57.832506 (+ 3823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:57.832512 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:57.832516 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:57.833151 (+ 635us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:57.833655 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:50:57.833660 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:50:57.833664 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:50:57.833910 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:50:57.834768 (+ 858us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:50:57.834776 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:50:57.835123 (+ 347us) client_negotiation.cc:769] Sending connection context
0811 18:50:57.835402 (+ 279us) client_negotiation.cc:240] Negotiation successful
0811 18:50:57.836249 (+ 847us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12464,"mutex_wait_us":472,"spinlock_wait_cycles":90624,"thread_start_us":12239,"threads_started":1}
I20260811 18:50:57.836730 20613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:57.796346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:55935 (local address 127.25.25.2:45615)
0811 18:50:57.808299 (+ 11953us) server_negotiation.cc:206] Beginning negotiation
0811 18:50:57.808316 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 18:50:57.808926 (+ 610us) server_negotiation.cc:407] Connection header received
0811 18:50:57.811206 (+ 2280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:50:57.811215 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:50:57.811594 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:50:57.812026 (+ 432us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:50:57.814425 (+ 2399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:57.815989 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:57.817993 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:50:57.818693 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:50:57.818872 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:50:57.829072 (+ 10200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:50:57.829081 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:50:57.829096 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:50:57.829143 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:50:57.832343 (+ 3200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:57.833323 (+ 980us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:57.833331 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:57.833338 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:57.833538 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:50:57.834041 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:50:57.834045 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:50:57.834047 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:50:57.834624 (+ 577us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:50:57.834814 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 18:50:57.835814 (+ 1000us) server_negotiation.cc:299] Negotiation successful
0811 18:50:57.836256 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11706,"thread_start_us":11512,"threads_started":1}
W20260811 18:50:57.841215 19981 leader_election.cc:341] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9ff9454f802e4ba5ac0de34f20f5ece1 (127.25.25.3:43177): Not found: Tablet not found: 2c2d24cefec744318f9e40b50def82d5
W20260811 18:50:57.841562 19985 leader_election.cc:341] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f67291534f6e47de982937436b0bc4f1 (127.25.25.2:45615): Not found: Tablet not found: 2c2d24cefec744318f9e40b50def82d5
I20260811 18:50:57.841734 19985 leader_election.cc:302] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cc791c6040c468491720b1d49ab2eab; no voters: 9ff9454f802e4ba5ac0de34f20f5ece1, f67291534f6e47de982937436b0bc4f1
I20260811 18:50:57.842196 20609 raft_consensus.cc:2726] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 18:50:58.035310 20612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:58.034843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.1:34265)
0811 18:50:58.035060 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:58.035158 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260811 18:50:58.035413 20616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:58.034407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.3:41967)
0811 18:50:58.034914 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:58.035152 (+ 238us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":241,"threads_started":1}
I20260811 18:50:58.536507 20617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:58.535718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.2:33857)
0811 18:50:58.536231 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:58.536320 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":269,"threads_started":1}
I20260811 18:50:59.037497 20620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:59.036538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.3:39629)
0811 18:50:59.037128 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:59.037247 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":312,"threads_started":1}
I20260811 18:50:59.037853 20619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:59.036538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.1:41449)
0811 18:50:59.037548 (+ 1010us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:59.037656 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":896,"thread_start_us":744,"threads_started":1}
I20260811 18:50:59.538504 20621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:50:59.537553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.2:52987)
0811 18:50:59.538175 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0811 18:50:59.538286 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":317,"threads_started":1}
I20260811 18:50:59.639132 20622 raft_consensus.cc:482] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:50:59.639344 20622 raft_consensus.cc:504] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 } } peers { permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 } } peers { permanent_uuid: "6cc791c6040c468491720b1d49ab2eab" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 43305 } }
I20260811 18:50:59.640024 20622 leader_election.cc:288] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f67291534f6e47de982937436b0bc4f1 (127.25.25.2:45615), 9ff9454f802e4ba5ac0de34f20f5ece1 (127.25.25.3:43177)
W20260811 18:50:59.641139 19985 leader_election.cc:341] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f67291534f6e47de982937436b0bc4f1 (127.25.25.2:45615): Not found: Tablet not found: 2c2d24cefec744318f9e40b50def82d5
W20260811 18:50:59.641314 19981 leader_election.cc:341] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9ff9454f802e4ba5ac0de34f20f5ece1 (127.25.25.3:43177): Not found: Tablet not found: 2c2d24cefec744318f9e40b50def82d5
I20260811 18:50:59.641544 19981 leader_election.cc:302] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cc791c6040c468491720b1d49ab2eab; no voters: 9ff9454f802e4ba5ac0de34f20f5ece1, f67291534f6e47de982937436b0bc4f1
I20260811 18:50:59.641834 20622 raft_consensus.cc:2726] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 18:51:00.039408 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:00.038564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.3:51309)
0811 18:51:00.039111 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:00.039215 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":262,"threads_started":1}
I20260811 18:51:00.039660 20625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:00.038829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.1:45411)
0811 18:51:00.039327 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:00.039437 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":261,"threads_started":1}
I20260811 18:51:00.540516 20626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:00.539628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.2:33445)
0811 18:51:00.540214 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:00.540310 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":303,"threads_started":1}
I20260811 18:51:01.041317 20627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:01.040458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.3:39241)
0811 18:51:01.041035 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:01.041124 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":301,"threads_started":1}
I20260811 18:51:01.042007 20628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:01.040867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.1:54805)
0811 18:51:01.041710 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:01.041800 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":713,"thread_start_us":416,"threads_started":1}
I20260811 18:51:01.542613 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:01.541710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.2:53463)
0811 18:51:01.542297 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:01.542402 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":285,"threads_started":1}
I20260811 18:51:02.043313 20632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:02.042491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.3:51927)
0811 18:51:02.043040 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:02.043134 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":292,"threads_started":1}
I20260811 18:51:02.044129 20635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:02.043010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.1:33431)
0811 18:51:02.043837 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:02.043939 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":716,"thread_start_us":601,"threads_started":1}
I20260811 18:51:02.544732 20637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:02.543702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.2:33815)
0811 18:51:02.544365 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:02.544512 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":357,"threads_started":1}
I20260811 18:51:02.711634 20639 raft_consensus.cc:482] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:51:02.711853 20639 raft_consensus.cc:504] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 } } peers { permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 } } peers { permanent_uuid: "6cc791c6040c468491720b1d49ab2eab" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 43305 } }
I20260811 18:51:02.712602 20639 leader_election.cc:288] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f67291534f6e47de982937436b0bc4f1 (127.25.25.2:45615), 9ff9454f802e4ba5ac0de34f20f5ece1 (127.25.25.3:43177)
W20260811 18:51:02.713670 19985 leader_election.cc:341] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f67291534f6e47de982937436b0bc4f1 (127.25.25.2:45615): Not found: Tablet not found: 2c2d24cefec744318f9e40b50def82d5
W20260811 18:51:02.713865 19981 leader_election.cc:341] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9ff9454f802e4ba5ac0de34f20f5ece1 (127.25.25.3:43177): Not found: Tablet not found: 2c2d24cefec744318f9e40b50def82d5
I20260811 18:51:02.714110 19981 leader_election.cc:302] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cc791c6040c468491720b1d49ab2eab; no voters: 9ff9454f802e4ba5ac0de34f20f5ece1, f67291534f6e47de982937436b0bc4f1
I20260811 18:51:02.714398 20639 raft_consensus.cc:2726] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 18:51:03.045356 20642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:03.044407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.3:35647)
0811 18:51:03.045030 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:03.045146 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":325,"threads_started":1}
I20260811 18:51:03.046041 20643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:03.045122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.1:41019)
0811 18:51:03.045739 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:03.045829 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":291,"threads_started":1}
I20260811 18:51:03.547152 20644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:03.546083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.2:50459)
0811 18:51:03.546832 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:03.546931 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":647,"thread_start_us":449,"threads_started":1}
I20260811 18:51:04.047406 20646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:04.046421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.3:39555)
0811 18:51:04.047034 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:04.047134 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":292,"threads_started":1}
I20260811 18:51:04.047699 20647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:04.046922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.1:40401)
0811 18:51:04.047410 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:04.047513 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":270,"threads_started":1}
I20260811 18:51:04.549255 20650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:04.548485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.2:47671)
0811 18:51:04.548953 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:04.549057 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":211,"threads_started":1}
I20260811 18:51:05.049525 20652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:05.048664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.3:51125)
0811 18:51:05.049168 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:05.049265 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":262,"threads_started":1}
I20260811 18:51:05.049592 20653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:05.048759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.1:50213)
0811 18:51:05.049284 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:05.049390 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":284,"threads_started":1}
I20260811 18:51:05.551326 20654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:05.550520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.2:54733)
0811 18:51:05.551058 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:05.551156 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":273,"threads_started":1}
I20260811 18:51:06.051791 20655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:06.050847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.1:41567)
0811 18:51:06.051460 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:06.051567 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":297,"threads_started":1}
I20260811 18:51:06.052528 20657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:06.050903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.3:40637)
0811 18:51:06.052273 (+ 1370us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:06.052373 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":801,"thread_start_us":633,"threads_started":1}
I20260811 18:51:06.553524 20658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:06.552612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.2:35449)
0811 18:51:06.553179 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:06.553278 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":306,"threads_started":1}
I20260811 18:51:07.053998 20659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:07.053000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.1:44317)
0811 18:51:07.053587 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:07.053680 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":318,"threads_started":1}
I20260811 18:51:07.054448 20661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:07.053650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.3:39379)
0811 18:51:07.054133 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:07.054235 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":272,"threads_started":1}
I20260811 18:51:07.327549 20662 raft_consensus.cc:482] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:51:07.327836 20662 raft_consensus.cc:504] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67291534f6e47de982937436b0bc4f1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 45615 } } peers { permanent_uuid: "9ff9454f802e4ba5ac0de34f20f5ece1" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 43177 } } peers { permanent_uuid: "6cc791c6040c468491720b1d49ab2eab" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 43305 } }
I20260811 18:51:07.328644 20662 leader_election.cc:288] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f67291534f6e47de982937436b0bc4f1 (127.25.25.2:45615), 9ff9454f802e4ba5ac0de34f20f5ece1 (127.25.25.3:43177)
W20260811 18:51:07.329800 19981 leader_election.cc:341] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9ff9454f802e4ba5ac0de34f20f5ece1 (127.25.25.3:43177): Not found: Tablet not found: 2c2d24cefec744318f9e40b50def82d5
W20260811 18:51:07.329998 19985 leader_election.cc:341] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f67291534f6e47de982937436b0bc4f1 (127.25.25.2:45615): Not found: Tablet not found: 2c2d24cefec744318f9e40b50def82d5
I20260811 18:51:07.330102 19985 leader_election.cc:302] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cc791c6040c468491720b1d49ab2eab; no voters: 9ff9454f802e4ba5ac0de34f20f5ece1, f67291534f6e47de982937436b0bc4f1
I20260811 18:51:07.330353 20662 raft_consensus.cc:2726] T 2c2d24cefec744318f9e40b50def82d5 P 6cc791c6040c468491720b1d49ab2eab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 18:51:07.555490 20663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:07.554555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.2:53641)
0811 18:51:07.555209 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:07.555304 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":337,"threads_started":1}
I20260811 18:51:08.055876 20664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:08.055090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.1:33943)
0811 18:51:08.055577 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:08.055660 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":270,"threads_started":1}
I20260811 18:51:08.056115 20666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:08.055308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.3:41503)
0811 18:51:08.055818 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:08.055908 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":270,"threads_started":1}
I20260811 18:51:08.557536 20667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:08.556721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.2:38983)
0811 18:51:08.557239 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:08.557343 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":253,"threads_started":1}
I20260811 18:51:09.057934 20671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:09.056948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.1:42337)
0811 18:51:09.057575 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:09.057695 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":340,"threads_started":1}
I20260811 18:51:09.058199 20674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:09.057049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.3:37961)
0811 18:51:09.057915 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:09.057997 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":752,"thread_start_us":604,"threads_started":1}
I20260811 18:51:09.559548 20675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:09.558699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.2:51791)
0811 18:51:09.559225 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:09.559339 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":255,"threads_started":1}
I20260811 18:51:10.059962 20676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:10.059061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.1:51593)
0811 18:51:10.059645 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:10.059754 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":299,"threads_started":1}
I20260811 18:51:10.060051 20678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:10.059185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.3:33537)
0811 18:51:10.059722 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:10.059837 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":285,"threads_started":1}
I20260811 18:51:10.561551 20679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:10.560631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.2:46119)
0811 18:51:10.561180 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:10.561279 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":294,"threads_started":1}
I20260811 18:51:11.062239 20681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:11.061422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.1:43793)
0811 18:51:11.061947 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:11.062047 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":253,"threads_started":1}
I20260811 18:51:11.062614 20680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:11.061243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.3:55107)
0811 18:51:11.062184 (+ 941us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:11.062328 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":363,"threads_started":1}
I20260811 18:51:11.564044 20683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:11.563134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.2:55077)
0811 18:51:11.563691 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:11.563826 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":258,"threads_started":1}
I20260811 18:51:12.036723 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 19884
I20260811 18:51:12.058562 20686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:12.038003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39836 (local address 127.25.25.1:43305)
0811 18:51:12.038643 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:12.038653 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:12.038690 (+ 37us) server_negotiation.cc:407] Connection header received
0811 18:51:12.038767 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:12.038777 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:12.039105 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:12.039294 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:51:12.041288 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:12.042309 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:12.043795 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:12.044542 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:12.044680 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:12.051886 (+ 7206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:51:12.051915 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:51:12.051934 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:51:12.051990 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:51:12.055310 (+ 3320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:12.056159 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:12.056167 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:12.056170 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:12.056334 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:12.056768 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:12.056772 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:12.056774 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:12.057201 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:51:12.057501 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:12.057905 (+ 404us) server_negotiation.cc:299] Negotiation successful
0811 18:51:12.058228 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":453,"thread_start_us":259,"threads_started":1}
I20260811 18:51:12.060057 20173 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:51:12.065455 20689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:12.063951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.3:49837)
0811 18:51:12.065113 (+ 1162us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:12.065244 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1028,"thread_start_us":322,"threads_started":1}
I20260811 18:51:12.155575 20690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:12.152826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42917 (local address 127.25.25.1:53811)
0811 18:51:12.155124 (+ 2298us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:12.155253 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:42917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2129,"thread_start_us":1949,"threads_started":1}
I20260811 18:51:12.156113 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 19884
I20260811 18:51:12.189297 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 20184
I20260811 18:51:12.203198 20691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:12.190076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58192 (local address 127.25.25.2:45615)
0811 18:51:12.190617 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:12.190621 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:12.190639 (+ 18us) server_negotiation.cc:407] Connection header received
0811 18:51:12.190695 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:12.190698 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:12.190766 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:12.190857 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:51:12.192342 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:12.193171 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:12.194505 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:12.194943 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:12.195056 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:12.197800 (+ 2744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:51:12.197805 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:51:12.197809 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:51:12.197859 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:51:12.200612 (+ 2753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:12.201406 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:12.201410 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:12.201413 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:12.201590 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:12.201939 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:12.201941 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:12.201943 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:12.202218 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:51:12.202425 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:12.202677 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 18:51:12.202874 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":298,"threads_started":1}
I20260811 18:51:12.203955 20380 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:51:12.289831 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 20184
I20260811 18:51:12.317672 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 20393
I20260811 18:51:12.332592 20696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:12.318705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58992 (local address 127.25.25.3:43177)
0811 18:51:12.319310 (+ 605us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:12.319316 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:12.319333 (+ 17us) server_negotiation.cc:407] Connection header received
0811 18:51:12.319395 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:12.319399 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:12.319472 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:12.319582 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:51:12.321158 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:12.321975 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:12.323291 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:12.323721 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:12.323837 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:12.326629 (+ 2792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:51:12.326635 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:51:12.326639 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:51:12.326679 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:51:12.329518 (+ 2839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:12.330339 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:12.330344 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:12.330348 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:12.330520 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:12.330924 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:12.330928 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:12.330930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:12.331229 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:51:12.331503 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:12.331829 (+ 326us) server_negotiation.cc:299] Negotiation successful
0811 18:51:12.332227 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":298,"threads_started":1}
I20260811 18:51:12.333345 20586 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:51:12.419234 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 20393
2026-08-11T18:51:12Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (25436 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:51:12 dist-test-slave-lgr5 krb5kdc[20700](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:51:12 dist-test-slave-lgr5 krb5kdc[20700](info): set up 2 sockets
Aug 11 18:51:12 dist-test-slave-lgr5 krb5kdc[20700](info): commencing operation
krb5kdc: starting...
W20260811 18:51:13.766357 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.291s user 0.004s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:51:13 dist-test-slave-lgr5 krb5kdc[20700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:51:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:51:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:51:14.117408 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:43223
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:39481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:43223
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:51:14.505326 20727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:51:14.505663 20727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:51:14.505759 20727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:51:14.514403 20727 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 18:51:14.514578 20727 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 18:51:14.514627 20727 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 18:51:14.514690 20727 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:51:14.514760 20727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:51:14.514834 20727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:51:14.514886 20727 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:51:14.514950 20727 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:51:14.526887 20727 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:39481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:43223
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:43223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:51:14.528565 20727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:51:14.530171 20727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:51:14.544814 20733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:51:14.544723 20736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:51:14.544773 20732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:51:14.545145 20727 server_base.cc:1034] running on GCE node
I20260811 18:51:14.546066 20727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:51:14.547607 20727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:51:14.548877 20727 hybrid_clock.cc:648] HybridClock initialized: now 1786474274548754 us; error 62 us; skew 500 ppm
I20260811 18:51:14.549252 20727 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:51:14 dist-test-slave-lgr5 krb5kdc[20700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474274, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:51:14.552713 20727 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:51:14.554411 20727 webserver.cc:460] Webserver started at http://127.25.25.62:44913/ using document root <none> and password file <none>
I20260811 18:51:14.555210 20727 fs_manager.cc:359] Metadata directory not provided
I20260811 18:51:14.555328 20727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:51:14.555668 20727 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:51:14.558984 20727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "426a58507c7c40caaf404880a5e07040"
format_stamp: "Formatted at 2026-08-11 18:51:14 on dist-test-slave-lgr5"
server_key: "dfa04aa47fbaf162f674d46eac4e310d"
server_key_iv: "1482c5b99c007af69de29558f7725bac"
server_key_version: "encryptionkey@0"
I20260811 18:51:14.559847 20727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "426a58507c7c40caaf404880a5e07040"
format_stamp: "Formatted at 2026-08-11 18:51:14 on dist-test-slave-lgr5"
server_key: "dfa04aa47fbaf162f674d46eac4e310d"
server_key_iv: "1482c5b99c007af69de29558f7725bac"
server_key_version: "encryptionkey@0"
I20260811 18:51:14.565711 20727 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260811 18:51:14.570068 20752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:51:14.571724 20727 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 18:51:14.571956 20727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "426a58507c7c40caaf404880a5e07040"
format_stamp: "Formatted at 2026-08-11 18:51:14 on dist-test-slave-lgr5"
server_key: "dfa04aa47fbaf162f674d46eac4e310d"
server_key_iv: "1482c5b99c007af69de29558f7725bac"
server_key_version: "encryptionkey@0"
I20260811 18:51:14.572257 20727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:51:14.594077 20727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:51:14.598758 20727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:51:14.599056 20727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:51:14.622738 20727 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:43223
I20260811 18:51:14.622761 20833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:43223 every 8 connection(s)
I20260811 18:51:14.624481 20727 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:51:14.628741 20836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:51:14.633576 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 20727
I20260811 18:51:14.633797 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:51:14.634469 25700 external_mini_cluster.cc:1428] Setting key f58a608e5590db48dc5efe4486641b27
I20260811 18:51:14.641616 20836 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040: Bootstrap starting.
I20260811 18:51:14.645920 20836 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040: Neither blocks nor log segments found. Creating new log.
I20260811 18:51:14.647377 20836 log.cc:824] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040: Log is configured to *not* fsync() on all Append() calls
I20260811 18:51:14.650695 20836 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040: No bootstrap required, opened a new log
Aug 11 18:51:14 dist-test-slave-lgr5 krb5kdc[20700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:51:14.660246 20836 raft_consensus.cc:348] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426a58507c7c40caaf404880a5e07040" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43223 } }
I20260811 18:51:14.660944 20836 raft_consensus.cc:374] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:51:14.661090 20836 raft_consensus.cc:729] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 426a58507c7c40caaf404880a5e07040, State: Initialized, Role: FOLLOWER
I20260811 18:51:14.661814 20836 consensus_queue.cc:260] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426a58507c7c40caaf404880a5e07040" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43223 } }
I20260811 18:51:14.661971 20839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:14.636655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56256 (local address 127.25.25.62:43223)
0811 18:51:14.637635 (+ 980us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:14.637648 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:14.637697 (+ 49us) server_negotiation.cc:407] Connection header received
0811 18:51:14.640045 (+ 2348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:14.640119 (+ 74us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:14.640636 (+ 517us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:14.641049 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:51:14.643195 (+ 2146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:14.644772 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:14.646808 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:14.647776 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:14.647948 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:14.652366 (+ 4418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:51:14.652376 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:51:14.652399 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:51:14.652452 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:51:14.656626 (+ 4174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:14.657595 (+ 969us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:14.657605 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:14.657613 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:14.657857 (+ 244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:14.658348 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:14.658357 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:14.658359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:14.659131 (+ 772us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:51:14.659481 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:14.660042 (+ 561us) server_negotiation.cc:299] Negotiation successful
0811 18:51:14.660607 (+ 565us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":719,"thread_start_us":475,"threads_started":1}
I20260811 18:51:14.662132 20836 raft_consensus.cc:388] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:51:14.662335 20836 raft_consensus.cc:482] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:51:14.662567 20836 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:51:14.665709 20836 raft_consensus.cc:504] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426a58507c7c40caaf404880a5e07040" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43223 } }
I20260811 18:51:14.666326 20836 leader_election.cc:302] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 426a58507c7c40caaf404880a5e07040; no voters:
I20260811 18:51:14.666920 20836 leader_election.cc:288] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:51:14.667107 20845 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:51:14.667825 20845 raft_consensus.cc:686] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [term 1 LEADER]: Becoming Leader. State: Replica: 426a58507c7c40caaf404880a5e07040, State: Running, Role: LEADER
I20260811 18:51:14.668495 20845 consensus_queue.cc:237] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426a58507c7c40caaf404880a5e07040" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43223 } }
I20260811 18:51:14.669222 20836 sys_catalog.cc:564] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:51:14.671698 20846 sys_catalog.cc:455] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "426a58507c7c40caaf404880a5e07040" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426a58507c7c40caaf404880a5e07040" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43223 } } }
I20260811 18:51:14.672055 20846 sys_catalog.cc:458] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [sys.catalog]: This master's current role is: LEADER
I20260811 18:51:14.672516 20849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 426a58507c7c40caaf404880a5e07040. Latest consensus state: current_term: 1 leader_uuid: "426a58507c7c40caaf404880a5e07040" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426a58507c7c40caaf404880a5e07040" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43223 } } }
I20260811 18:51:14.672832 20849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [sys.catalog]: This master's current role is: LEADER
I20260811 18:51:14.673128 20863 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:51:14.678475 20863 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:51:14.689014 20863 catalog_manager.cc:1347] Generated new cluster ID: eefc3ddfe4ec4f26876d2b00edd5a421
I20260811 18:51:14.689146 20863 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:51:14.702826 20863 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:51:14.704331 20863 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:51:14.714171 20863 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040: Generated new TSK 0
I20260811 18:51:14.715176 20863 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.25.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
I20260811 18:51:14.801348 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:0
--local_ip_for_outbound_sockets=127.25.25.1
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:43223
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:39481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:51:15.184832 20886 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:51:15.185166 20886 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:51:15.185297 20886 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:51:15.193977 20886 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:51:15.194140 20886 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:51:15.194320 20886 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:51:15.205682 20886 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:39481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:43223
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:51:15.207098 20886 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:51:15.208588 20886 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:51:15.224268 20898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:51:15.224272 20893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:51:15.224272 20895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:51:15.225220 20886 server_base.cc:1034] running on GCE node
I20260811 18:51:15.225910 20886 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:51:15.226999 20886 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:51:15.228217 20886 hybrid_clock.cc:648] HybridClock initialized: now 1786474275228139 us; error 57 us; skew 500 ppm
I20260811 18:51:15.228566 20886 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:51:15 dist-test-slave-lgr5 krb5kdc[20700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474275, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:51:15.232040 20886 init.cc:377] Logged in from keytab as kudu/127.25.25.1@KRBTEST.COM (short username kudu)
I20260811 18:51:15.233831 20886 webserver.cc:460] Webserver started at http://127.25.25.1:46449/ using document root <none> and password file <none>
I20260811 18:51:15.234653 20886 fs_manager.cc:359] Metadata directory not provided
I20260811 18:51:15.234772 20886 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:51:15.235118 20886 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:51:15.238605 20886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/data/instance:
uuid: "2847cd691e2945cd83691bf2dd76bbc6"
format_stamp: "Formatted at 2026-08-11 18:51:15 on dist-test-slave-lgr5"
server_key: "b8c98aa9f96308863d3c315952f6b14c"
server_key_iv: "0e53f024d1acd674a9ec258bb5a2ed78"
server_key_version: "encryptionkey@0"
I20260811 18:51:15.239459 20886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance:
uuid: "2847cd691e2945cd83691bf2dd76bbc6"
format_stamp: "Formatted at 2026-08-11 18:51:15 on dist-test-slave-lgr5"
server_key: "b8c98aa9f96308863d3c315952f6b14c"
server_key_iv: "0e53f024d1acd674a9ec258bb5a2ed78"
server_key_version: "encryptionkey@0"
I20260811 18:51:15.245472 20886 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260811 18:51:15.249366 20909 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:51:15.250873 20886 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 18:51:15.251034 20886 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "2847cd691e2945cd83691bf2dd76bbc6"
format_stamp: "Formatted at 2026-08-11 18:51:15 on dist-test-slave-lgr5"
server_key: "b8c98aa9f96308863d3c315952f6b14c"
server_key_iv: "0e53f024d1acd674a9ec258bb5a2ed78"
server_key_version: "encryptionkey@0"
I20260811 18:51:15.251231 20886 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:51:15.263032 20886 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:51:15.267584 20886 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:51:15.267902 20886 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:51:15.269047 20886 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:51:15.270730 20886 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:51:15.270825 20886 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:51:15.270958 20886 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:51:15.271018 20886 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:51:15.306120 20886 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:33565
I20260811 18:51:15.306180 21110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:33565 every 8 connection(s)
I20260811 18:51:15.307627 20886 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:51:15.317433 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 20886
I20260811 18:51:15.317647 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance
I20260811 18:51:15.318315 25700 external_mini_cluster.cc:1428] Setting key 92e3a083d34922ac17161b7378dc9b66
Aug 11 18:51:15 dist-test-slave-lgr5 krb5kdc[20700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474275, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:51:15.331650 21115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:15.310807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:41513 (local address 127.25.25.62:43223)
0811 18:51:15.311309 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:15.311314 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:15.312410 (+ 1096us) server_negotiation.cc:407] Connection header received
0811 18:51:15.314600 (+ 2190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:15.314607 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:15.314704 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:15.314808 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:51:15.316789 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:15.317593 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:15.319598 (+ 2005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:15.320176 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:15.320330 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:15.324666 (+ 4336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:51:15.324674 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:51:15.324679 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:51:15.324725 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:51:15.327903 (+ 3178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:15.328921 (+ 1018us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:15.328928 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:15.328931 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:15.329119 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:15.329659 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:15.329664 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:15.329667 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:15.330051 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:51:15.330201 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:15.331031 (+ 830us) server_negotiation.cc:299] Negotiation successful
0811 18:51:15.331296 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":18,"server-negotiator.queue_time_us":378,"thread_start_us":261,"threads_started":1}
I20260811 18:51:15.332716 21116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:15.311281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.1:41513)
0811 18:51:15.312219 (+ 938us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:15.312267 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 18:51:15.314213 (+ 1946us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:51:15.315143 (+ 930us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:51:15.315154 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:51:15.315774 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:51:15.316553 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:15.316578 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:15.317791 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:15.317796 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:15.319364 (+ 1568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:15.319389 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:15.320482 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:15.320492 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:15.320800 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:15.321630 (+ 830us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:51:15.321657 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:51:15.324336 (+ 2679us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:51:15.328170 (+ 3834us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:51:15.328181 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:51:15.328199 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:51:15.328745 (+ 546us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:51:15.329240 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:51:15.329244 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:51:15.329246 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:51:15.329524 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:51:15.330172 (+ 648us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:51:15.330179 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:51:15.330580 (+ 401us) client_negotiation.cc:769] Sending connection context
0811 18:51:15.330838 (+ 258us) client_negotiation.cc:240] Negotiation successful
0811 18:51:15.331346 (+ 508us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":611,"thread_start_us":352,"threads_started":1}
I20260811 18:51:15.334362 21111 heartbeater.cc:347] Connected to a master server at 127.25.25.62:43223
I20260811 18:51:15.334753 21111 heartbeater.cc:464] Registering TS with master...
I20260811 18:51:15.335625 21111 heartbeater.cc:511] Master 127.25.25.62:43223 requested a full tablet report, sending...
I20260811 18:51:15.337862 20776 ts_manager.cc:194] Registered new tserver with Master: 2847cd691e2945cd83691bf2dd76bbc6 (127.25.25.1:33565)
I20260811 18:51:15.339514 20776 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.1@KRBTEST.COM'} at 127.25.25.1:41513
WARNING: no policy specified for kudu/127.25.25.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
I20260811 18:51:15.392596 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:0
--local_ip_for_outbound_sockets=127.25.25.2
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:43223
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:39481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:51:15.756495 21122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:51:15.756850 21122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:51:15.756963 21122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:51:15.764691 21122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:51:15.764820 21122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:51:15.764945 21122 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:51:15.775347 21122 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:39481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:43223
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:51:15.776877 21122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:51:15.778398 21122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:51:15.792394 21134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:51:15.792433 21136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:51:15.792363 21133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:51:15.793118 21122 server_base.cc:1034] running on GCE node
I20260811 18:51:15.793731 21122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:51:15.794718 21122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:51:15.795917 21122 hybrid_clock.cc:648] HybridClock initialized: now 1786474275795872 us; error 42 us; skew 500 ppm
I20260811 18:51:15.796288 21122 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:51:15 dist-test-slave-lgr5 krb5kdc[20700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474275, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:51:15.803220 21122 init.cc:377] Logged in from keytab as kudu/127.25.25.2@KRBTEST.COM (short username kudu)
I20260811 18:51:15.805212 21122 webserver.cc:460] Webserver started at http://127.25.25.2:39371/ using document root <none> and password file <none>
I20260811 18:51:15.806054 21122 fs_manager.cc:359] Metadata directory not provided
I20260811 18:51:15.806191 21122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:51:15.806572 21122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:51:15.810179 21122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/data/instance:
uuid: "9c47b8ca998d45dc81fdca86bc19ca80"
format_stamp: "Formatted at 2026-08-11 18:51:15 on dist-test-slave-lgr5"
server_key: "fb2924d77489640e4a8c5ed61dfc445b"
server_key_iv: "634f694904db72213ea222a45f4f41c9"
server_key_version: "encryptionkey@0"
I20260811 18:51:15.811143 21122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance:
uuid: "9c47b8ca998d45dc81fdca86bc19ca80"
format_stamp: "Formatted at 2026-08-11 18:51:15 on dist-test-slave-lgr5"
server_key: "fb2924d77489640e4a8c5ed61dfc445b"
server_key_iv: "634f694904db72213ea222a45f4f41c9"
server_key_version: "encryptionkey@0"
I20260811 18:51:15.820974 21122 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.011s sys 0.000s
I20260811 18:51:15.826851 21150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:51:15.829135 21122 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 18:51:15.829406 21122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "9c47b8ca998d45dc81fdca86bc19ca80"
format_stamp: "Formatted at 2026-08-11 18:51:15 on dist-test-slave-lgr5"
server_key: "fb2924d77489640e4a8c5ed61dfc445b"
server_key_iv: "634f694904db72213ea222a45f4f41c9"
server_key_version: "encryptionkey@0"
I20260811 18:51:15.829718 21122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:51:15.871747 21122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:51:15.877064 21122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:51:15.877409 21122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:51:15.878721 21122 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:51:15.880520 21122 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:51:15.880631 21122 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:51:15.880805 21122 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:51:15.880879 21122 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:51:15.916859 21122 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:40373
I20260811 18:51:15.916903 21344 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:40373 every 8 connection(s)
I20260811 18:51:15.918422 21122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:51:15.920012 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 21122
I20260811 18:51:15.920289 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance
I20260811 18:51:15.920917 25700 external_mini_cluster.cc:1428] Setting key d1030efd5ea34e2460a674fc37d66e71
Aug 11 18:51:15 dist-test-slave-lgr5 krb5kdc[20700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474275, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:51:15.943292 21350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:15.922275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:55653 (local address 127.25.25.62:43223)
0811 18:51:15.922810 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:15.922816 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:15.923959 (+ 1143us) server_negotiation.cc:407] Connection header received
0811 18:51:15.926090 (+ 2131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:15.926097 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:15.926189 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:15.926289 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:51:15.928215 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:15.929015 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:15.930803 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:15.931267 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:15.931393 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:15.936021 (+ 4628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:51:15.936030 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:51:15.936036 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:51:15.936125 (+ 89us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:51:15.939346 (+ 3221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:15.940432 (+ 1086us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:15.940438 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:15.940440 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:15.940594 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:15.941194 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:15.941200 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:15.941203 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:15.941606 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:51:15.941778 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:15.942682 (+ 904us) server_negotiation.cc:299] Negotiation successful
0811 18:51:15.942924 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":270,"threads_started":1}
I20260811 18:51:15.944363 21353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:15.922827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.2:55653)
0811 18:51:15.923800 (+ 973us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:15.923845 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 18:51:15.925732 (+ 1887us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:51:15.926618 (+ 886us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:51:15.926628 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:51:15.927255 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:51:15.927969 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:15.927993 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:15.929219 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:15.929223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:15.930610 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:15.930629 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:15.931565 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:15.931574 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:15.931830 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:15.932789 (+ 959us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:51:15.932818 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:51:15.935631 (+ 2813us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:51:15.939550 (+ 3919us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:51:15.939563 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:51:15.939582 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:51:15.940266 (+ 684us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:51:15.940721 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:51:15.940727 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:51:15.940732 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:51:15.941020 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:51:15.941787 (+ 767us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:51:15.941797 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:51:15.942201 (+ 404us) client_negotiation.cc:769] Sending connection context
0811 18:51:15.942532 (+ 331us) client_negotiation.cc:240] Negotiation successful
0811 18:51:15.942995 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"thread_start_us":364,"threads_started":1}
I20260811 18:51:15.946265 21345 heartbeater.cc:347] Connected to a master server at 127.25.25.62:43223
I20260811 18:51:15.946718 21345 heartbeater.cc:464] Registering TS with master...
I20260811 18:51:15.947705 21345 heartbeater.cc:511] Master 127.25.25.62:43223 requested a full tablet report, sending...
I20260811 18:51:15.949731 20776 ts_manager.cc:194] Registered new tserver with Master: 9c47b8ca998d45dc81fdca86bc19ca80 (127.25.25.2:40373)
I20260811 18:51:15.950663 20776 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.2@KRBTEST.COM'} at 127.25.25.2:55653
WARNING: no policy specified for kudu/127.25.25.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
I20260811 18:51:15.995342 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:0
--local_ip_for_outbound_sockets=127.25.25.3
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:43223
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:39481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:51:16.342861 21111 heartbeater.cc:503] Master 127.25.25.62:43223 was elected leader, sending a full tablet report...
W20260811 18:51:16.367009 21357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:51:16.367322 21357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:51:16.367460 21357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:51:16.375264 21357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:51:16.375406 21357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:51:16.375554 21357 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:51:16.386121 21357 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:39481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:43223
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:51:16.387495 21357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:51:16.388962 21357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:51:16.402971 21363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:51:16.403026 21364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:51:16.403059 21368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:51:16.403998 21357 server_base.cc:1034] running on GCE node
I20260811 18:51:16.404781 21357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:51:16.405889 21357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:51:16.407178 21357 hybrid_clock.cc:648] HybridClock initialized: now 1786474276407117 us; error 44 us; skew 500 ppm
I20260811 18:51:16.407588 21357 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:51:16 dist-test-slave-lgr5 krb5kdc[20700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474276, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:51:16.411096 21357 init.cc:377] Logged in from keytab as kudu/127.25.25.3@KRBTEST.COM (short username kudu)
I20260811 18:51:16.412798 21357 webserver.cc:460] Webserver started at http://127.25.25.3:45009/ using document root <none> and password file <none>
I20260811 18:51:16.413540 21357 fs_manager.cc:359] Metadata directory not provided
I20260811 18:51:16.413671 21357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:51:16.413991 21357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:51:16.417356 21357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/data/instance:
uuid: "24cc1175c4774e1592f062cfd0dbbc95"
format_stamp: "Formatted at 2026-08-11 18:51:16 on dist-test-slave-lgr5"
server_key: "1b32b9b541032a17797fb87824afb841"
server_key_iv: "b96fd36efad32d9a5b18c79b9e8292c6"
server_key_version: "encryptionkey@0"
I20260811 18:51:16.418269 21357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance:
uuid: "24cc1175c4774e1592f062cfd0dbbc95"
format_stamp: "Formatted at 2026-08-11 18:51:16 on dist-test-slave-lgr5"
server_key: "1b32b9b541032a17797fb87824afb841"
server_key_iv: "b96fd36efad32d9a5b18c79b9e8292c6"
server_key_version: "encryptionkey@0"
I20260811 18:51:16.424613 21357 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.002s
I20260811 18:51:16.428889 21378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:51:16.430581 21357 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:51:16.430791 21357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "24cc1175c4774e1592f062cfd0dbbc95"
format_stamp: "Formatted at 2026-08-11 18:51:16 on dist-test-slave-lgr5"
server_key: "1b32b9b541032a17797fb87824afb841"
server_key_iv: "b96fd36efad32d9a5b18c79b9e8292c6"
server_key_version: "encryptionkey@0"
I20260811 18:51:16.431018 21357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:51:16.466374 21357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:51:16.471901 21357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:51:16.472252 21357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:51:16.473376 21357 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:51:16.474936 21357 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:51:16.475040 21357 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:51:16.475175 21357 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:51:16.475238 21357 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:51:16.508457 21357 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:35735
I20260811 18:51:16.508507 21571 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:35735 every 8 connection(s)
I20260811 18:51:16.509840 21357 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:51:16.518689 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 21357
I20260811 18:51:16.518965 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance
I20260811 18:51:16.519526 25700 external_mini_cluster.cc:1428] Setting key 3118939f6b29003d535592520e85926b
Aug 11 18:51:16 dist-test-slave-lgr5 krb5kdc[20700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474276, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:51:16.533623 21580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:16.512758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:43013 (local address 127.25.25.62:43223)
0811 18:51:16.513270 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:16.513276 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:16.514381 (+ 1105us) server_negotiation.cc:407] Connection header received
0811 18:51:16.516575 (+ 2194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:16.516580 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:16.516676 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:16.516783 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:51:16.518634 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.519803 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.522117 (+ 2314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.522781 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.522924 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:16.527100 (+ 4176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:51:16.527106 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:51:16.527110 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:51:16.527149 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:51:16.529933 (+ 2784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:16.530839 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:16.530846 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:16.530850 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:16.531020 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:16.531597 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:16.531603 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:16.531606 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:16.532008 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:51:16.532216 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:16.532978 (+ 762us) server_negotiation.cc:299] Negotiation successful
0811 18:51:16.533228 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":236,"threads_started":1}
I20260811 18:51:16.534914 21581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:16.513305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.3:43013)
0811 18:51:16.514142 (+ 837us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:16.514209 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 18:51:16.516236 (+ 2027us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:51:16.517040 (+ 804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:51:16.517049 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:51:16.517692 (+ 643us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:51:16.518394 (+ 702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:16.518421 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.520024 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.520029 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:16.521954 (+ 1925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:16.521971 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.523073 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.523083 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:16.523463 (+ 380us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:16.524231 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:51:16.524258 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:51:16.526787 (+ 2529us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:51:16.530123 (+ 3336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:51:16.530133 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:51:16.530150 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:51:16.530677 (+ 527us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:51:16.531173 (+ 496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:51:16.531177 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:51:16.531180 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:51:16.531444 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:51:16.532172 (+ 728us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:51:16.532181 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:51:16.532574 (+ 393us) client_negotiation.cc:769] Sending connection context
0811 18:51:16.532856 (+ 282us) client_negotiation.cc:240] Negotiation successful
0811 18:51:16.533444 (+ 588us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":329,"threads_started":1}
I20260811 18:51:16.536594 21577 heartbeater.cc:347] Connected to a master server at 127.25.25.62:43223
I20260811 18:51:16.536901 21577 heartbeater.cc:464] Registering TS with master...
I20260811 18:51:16.537684 21577 heartbeater.cc:511] Master 127.25.25.62:43223 requested a full tablet report, sending...
I20260811 18:51:16.539161 20776 ts_manager.cc:194] Registered new tserver with Master: 24cc1175c4774e1592f062cfd0dbbc95 (127.25.25.3:35735)
I20260811 18:51:16.540011 20776 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.3@KRBTEST.COM'} at 127.25.25.3:43013
I20260811 18:51:16.549187 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:51:16.568689 21580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:16.554238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56272 (local address 127.25.25.62:43223)
0811 18:51:16.554439 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:16.554444 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:16.555010 (+ 566us) server_negotiation.cc:407] Connection header received
0811 18:51:16.555240 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:16.555244 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:16.555330 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:16.555468 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:51:16.557183 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.557946 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.559441 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.559913 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.560027 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:16.562716 (+ 2689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:51:16.562722 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:51:16.562725 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:51:16.562767 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:51:16.565520 (+ 2753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:16.566425 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:16.566430 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:16.566433 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:16.566593 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:16.567131 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:16.567135 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:16.567137 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:16.567556 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:51:16.567773 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:16.568218 (+ 445us) server_negotiation.cc:299] Negotiation successful
0811 18:51:16.568460 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 18:51:16.573150 20776 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56272:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:51:16.580763 20776 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:51:16.605666 21602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:16.594275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:33565 (local address 127.0.0.1:60472)
0811 18:51:16.596246 (+ 1971us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:16.596262 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:51:16.596366 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:51:16.597946 (+ 1580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:51:16.597953 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:51:16.597980 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:51:16.598438 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:16.598456 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.600618 (+ 2162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.600624 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:16.602694 (+ 2070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:16.602707 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.604541 (+ 1834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.604547 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:16.604755 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:16.604822 (+ 67us) client_negotiation.cc:769] Sending connection context
0811 18:51:16.604967 (+ 145us) client_negotiation.cc:240] Negotiation successful
0811 18:51:16.605192 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1859,"mutex_wait_us":55,"thread_start_us":1689,"threads_started":1}
I20260811 18:51:16.605844 21596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:16.593926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:40373 (local address 127.0.0.1:50956)
0811 18:51:16.595406 (+ 1480us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:16.595465 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 18:51:16.595668 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:51:16.598245 (+ 2577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:51:16.598250 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:51:16.598284 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:51:16.598711 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:16.598727 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.600835 (+ 2108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.600841 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:16.603054 (+ 2213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:16.603070 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.605017 (+ 1947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.605023 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:16.605197 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:16.605228 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 18:51:16.605332 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 18:51:16.605470 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1224,"mutex_wait_us":22,"thread_start_us":935,"threads_started":1}
I20260811 18:51:16.606393 21599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:16.594209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50956 (local address 127.25.25.2:40373)
0811 18:51:16.594819 (+ 610us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:16.594828 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:16.597613 (+ 2785us) server_negotiation.cc:407] Connection header received
0811 18:51:16.597746 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:16.597754 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:16.597996 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:16.598954 (+ 958us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:51:16.599203 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.600708 (+ 1505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.603257 (+ 2549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.604796 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.604939 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:16.605150 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:16.605396 (+ 246us) server_negotiation.cc:299] Negotiation successful
0811 18:51:16.605591 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":296,"threads_started":1}
I20260811 18:51:16.606577 21603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:16.594883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60472 (local address 127.25.25.1:33565)
0811 18:51:16.597456 (+ 2573us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:16.597462 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:16.597486 (+ 24us) server_negotiation.cc:407] Connection header received
0811 18:51:16.597563 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:16.597568 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:16.597751 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:16.597918 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:51:16.598641 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.600483 (+ 1842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.602876 (+ 2393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.604357 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.604483 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:16.604748 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:16.606173 (+ 1425us) server_negotiation.cc:299] Negotiation successful
0811 18:51:16.606343 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2431,"thread_start_us":2293,"threads_started":1}
I20260811 18:51:16.608418 21604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:16.596050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:35735 (local address 127.0.0.1:43756)
0811 18:51:16.596798 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:16.596821 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:51:16.596918 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:51:16.599024 (+ 2106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:51:16.599028 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:51:16.599052 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:51:16.599484 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:16.599498 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.601694 (+ 2196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.601699 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:16.603855 (+ 2156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:16.603870 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.606611 (+ 2741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.606617 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:16.607697 (+ 1080us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:16.607734 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 18:51:16.607826 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 18:51:16.607969 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"mutex_wait_us":1,"thread_start_us":1316,"threads_started":1}
I20260811 18:51:16.609108 21607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:16.597652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43756 (local address 127.25.25.3:35735)
0811 18:51:16.598606 (+ 954us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:16.598613 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:16.598639 (+ 26us) server_negotiation.cc:407] Connection header received
0811 18:51:16.598712 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:16.598717 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:16.598860 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:16.599019 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:51:16.599973 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.601537 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.604051 (+ 2514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.605896 (+ 1845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.606203 (+ 307us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:16.606449 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:16.608692 (+ 2243us) server_negotiation.cc:299] Negotiation successful
0811 18:51:16.608857 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":780,"thread_start_us":618,"threads_started":1}
I20260811 18:51:16.610973 21229 tablet_service.cc:1467] Processing CreateTablet for tablet 7adaf2c94e8341bcbda7b9103eaeb2f9 (DEFAULT_TABLE table=test-table [id=3dbc7bea4612403fb1062d15b79899f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:51:16.610973 20994 tablet_service.cc:1467] Processing CreateTablet for tablet 7adaf2c94e8341bcbda7b9103eaeb2f9 (DEFAULT_TABLE table=test-table [id=3dbc7bea4612403fb1062d15b79899f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:51:16.612646 20994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7adaf2c94e8341bcbda7b9103eaeb2f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:51:16.612648 21229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7adaf2c94e8341bcbda7b9103eaeb2f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:51:16.612530 21469 tablet_service.cc:1467] Processing CreateTablet for tablet 7adaf2c94e8341bcbda7b9103eaeb2f9 (DEFAULT_TABLE table=test-table [id=3dbc7bea4612403fb1062d15b79899f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:51:16.614109 21469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7adaf2c94e8341bcbda7b9103eaeb2f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:51:16.631187 21612 tablet_bootstrap.cc:492] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80: Bootstrap starting.
I20260811 18:51:16.638774 21609 tablet_bootstrap.cc:492] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 24cc1175c4774e1592f062cfd0dbbc95: Bootstrap starting.
I20260811 18:51:16.643587 21609 tablet_bootstrap.cc:654] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 24cc1175c4774e1592f062cfd0dbbc95: Neither blocks nor log segments found. Creating new log.
I20260811 18:51:16.645009 21612 tablet_bootstrap.cc:654] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80: Neither blocks nor log segments found. Creating new log.
I20260811 18:51:16.645412 21609 log.cc:824] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 24cc1175c4774e1592f062cfd0dbbc95: Log is configured to *not* fsync() on all Append() calls
I20260811 18:51:16.646093 21610 tablet_bootstrap.cc:492] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 2847cd691e2945cd83691bf2dd76bbc6: Bootstrap starting.
I20260811 18:51:16.647753 21612 log.cc:824] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80: Log is configured to *not* fsync() on all Append() calls
I20260811 18:51:16.650210 21610 tablet_bootstrap.cc:654] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 2847cd691e2945cd83691bf2dd76bbc6: Neither blocks nor log segments found. Creating new log.
I20260811 18:51:16.651437 21612 tablet_bootstrap.cc:492] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80: No bootstrap required, opened a new log
I20260811 18:51:16.651566 21609 tablet_bootstrap.cc:492] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 24cc1175c4774e1592f062cfd0dbbc95: No bootstrap required, opened a new log
I20260811 18:51:16.651587 21610 log.cc:824] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 2847cd691e2945cd83691bf2dd76bbc6: Log is configured to *not* fsync() on all Append() calls
I20260811 18:51:16.651831 21612 ts_tablet_manager.cc:1397] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80: Time spent bootstrapping tablet: real 0.021s user 0.010s sys 0.000s
I20260811 18:51:16.651862 21609 ts_tablet_manager.cc:1397] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 24cc1175c4774e1592f062cfd0dbbc95: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.004s
I20260811 18:51:16.655148 21610 tablet_bootstrap.cc:492] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 2847cd691e2945cd83691bf2dd76bbc6: No bootstrap required, opened a new log
I20260811 18:51:16.655468 21610 ts_tablet_manager.cc:1397] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 2847cd691e2945cd83691bf2dd76bbc6: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.004s
I20260811 18:51:16.659936 21612 raft_consensus.cc:348] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 40373 } } peers { permanent_uuid: "2847cd691e2945cd83691bf2dd76bbc6" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33565 } } peers { permanent_uuid: "24cc1175c4774e1592f062cfd0dbbc95" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35735 } }
I20260811 18:51:16.660537 21612 raft_consensus.cc:374] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:51:16.660666 21612 raft_consensus.cc:729] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c47b8ca998d45dc81fdca86bc19ca80, State: Initialized, Role: FOLLOWER
I20260811 18:51:16.661603 21612 consensus_queue.cc:260] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 40373 } } peers { permanent_uuid: "2847cd691e2945cd83691bf2dd76bbc6" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33565 } } peers { permanent_uuid: "24cc1175c4774e1592f062cfd0dbbc95" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35735 } }
I20260811 18:51:16.662699 21609 raft_consensus.cc:348] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 24cc1175c4774e1592f062cfd0dbbc95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 40373 } } peers { permanent_uuid: "2847cd691e2945cd83691bf2dd76bbc6" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33565 } } peers { permanent_uuid: "24cc1175c4774e1592f062cfd0dbbc95" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35735 } }
I20260811 18:51:16.663211 21609 raft_consensus.cc:374] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 24cc1175c4774e1592f062cfd0dbbc95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:51:16.663251 21345 heartbeater.cc:503] Master 127.25.25.62:43223 was elected leader, sending a full tablet report...
I20260811 18:51:16.663322 21609 raft_consensus.cc:729] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 24cc1175c4774e1592f062cfd0dbbc95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24cc1175c4774e1592f062cfd0dbbc95, State: Initialized, Role: FOLLOWER
I20260811 18:51:16.664103 21612 ts_tablet_manager.cc:1428] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260811 18:51:16.664003 21609 consensus_queue.cc:260] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 24cc1175c4774e1592f062cfd0dbbc95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 40373 } } peers { permanent_uuid: "2847cd691e2945cd83691bf2dd76bbc6" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33565 } } peers { permanent_uuid: "24cc1175c4774e1592f062cfd0dbbc95" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35735 } }
I20260811 18:51:16.665271 21577 heartbeater.cc:503] Master 127.25.25.62:43223 was elected leader, sending a full tablet report...
I20260811 18:51:16.666019 21609 ts_tablet_manager.cc:1428] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 24cc1175c4774e1592f062cfd0dbbc95: Time spent starting tablet: real 0.014s user 0.011s sys 0.004s
I20260811 18:51:16.667284 21610 raft_consensus.cc:348] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 2847cd691e2945cd83691bf2dd76bbc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 40373 } } peers { permanent_uuid: "2847cd691e2945cd83691bf2dd76bbc6" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33565 } } peers { permanent_uuid: "24cc1175c4774e1592f062cfd0dbbc95" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35735 } }
I20260811 18:51:16.667696 21610 raft_consensus.cc:374] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 2847cd691e2945cd83691bf2dd76bbc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:51:16.667802 21610 raft_consensus.cc:729] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 2847cd691e2945cd83691bf2dd76bbc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2847cd691e2945cd83691bf2dd76bbc6, State: Initialized, Role: FOLLOWER
I20260811 18:51:16.668493 21610 consensus_queue.cc:260] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 2847cd691e2945cd83691bf2dd76bbc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 40373 } } peers { permanent_uuid: "2847cd691e2945cd83691bf2dd76bbc6" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33565 } } peers { permanent_uuid: "24cc1175c4774e1592f062cfd0dbbc95" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35735 } }
W20260811 18:51:16.670881 21346 tablet.cc:2369] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:51:16.672016 21610 ts_tablet_manager.cc:1428] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 2847cd691e2945cd83691bf2dd76bbc6: Time spent starting tablet: real 0.016s user 0.016s sys 0.000s
W20260811 18:51:16.761699 21579 tablet.cc:2369] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 24cc1175c4774e1592f062cfd0dbbc95: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:51:16.810776 21112 tablet.cc:2369] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 2847cd691e2945cd83691bf2dd76bbc6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:51:16.865458 21622 raft_consensus.cc:482] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:51:16.865789 21622 raft_consensus.cc:504] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 40373 } } peers { permanent_uuid: "2847cd691e2945cd83691bf2dd76bbc6" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33565 } } peers { permanent_uuid: "24cc1175c4774e1592f062cfd0dbbc95" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35735 } }
I20260811 18:51:16.867589 21622 leader_election.cc:288] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2847cd691e2945cd83691bf2dd76bbc6 (127.25.25.1:33565), 24cc1175c4774e1592f062cfd0dbbc95 (127.25.25.3:35735)
I20260811 18:51:16.875254 21607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:16.868236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:43735 (local address 127.25.25.3:35735)
0811 18:51:16.868520 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:16.868528 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:16.869652 (+ 1124us) server_negotiation.cc:407] Connection header received
0811 18:51:16.869820 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:16.869824 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:16.869887 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:16.869987 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:51:16.870677 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.871437 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.873403 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.874215 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.874375 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:16.874495 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:16.874850 (+ 355us) server_negotiation.cc:299] Negotiation successful
0811 18:51:16.874989 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260811 18:51:16.875355 21603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:16.868234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:43067 (local address 127.25.25.1:33565)
0811 18:51:16.868564 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:16.868570 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:16.869592 (+ 1022us) server_negotiation.cc:407] Connection header received
0811 18:51:16.869801 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:16.869807 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:16.869874 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:16.869942 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:51:16.870610 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.871378 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.873409 (+ 2031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.874292 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.874435 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:16.874544 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:16.874959 (+ 415us) server_negotiation.cc:299] Negotiation successful
0811 18:51:16.875113 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166}
I20260811 18:51:16.875535 21626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:16.868314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:33565 (local address 127.25.25.2:43067)
0811 18:51:16.869427 (+ 1113us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:16.869451 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 18:51:16.869647 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:51:16.869984 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:51:16.869989 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:51:16.870012 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:51:16.870437 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:16.870455 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.871518 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.871524 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:16.873223 (+ 1699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:16.873239 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.874674 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.874680 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:16.874796 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:16.874821 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 18:51:16.874904 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 18:51:16.875055 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":953,"mutex_wait_us":43,"thread_start_us":661,"threads_started":1}
I20260811 18:51:16.875602 21625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:16.868371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:35735 (local address 127.25.25.2:43735)
0811 18:51:16.869529 (+ 1158us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:16.869547 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:51:16.869693 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:51:16.870016 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:51:16.870021 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:51:16.870044 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:51:16.870487 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:16.870500 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.871605 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.871609 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:16.873223 (+ 1614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:16.873239 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.874484 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.874491 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:16.874677 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:16.874704 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 18:51:16.874789 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 18:51:16.874931 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1024,"mutex_wait_us":115,"spinlock_wait_cycles":79616,"thread_start_us":545,"threads_started":1}
I20260811 18:51:16.876909 21505 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7adaf2c94e8341bcbda7b9103eaeb2f9" candidate_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cc1175c4774e1592f062cfd0dbbc95" is_pre_election: true
I20260811 18:51:16.876909 21025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7adaf2c94e8341bcbda7b9103eaeb2f9" candidate_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2847cd691e2945cd83691bf2dd76bbc6" is_pre_election: true
I20260811 18:51:16.877569 21505 raft_consensus.cc:2454] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 24cc1175c4774e1592f062cfd0dbbc95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c47b8ca998d45dc81fdca86bc19ca80 in term 0.
I20260811 18:51:16.877569 21025 raft_consensus.cc:2454] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 2847cd691e2945cd83691bf2dd76bbc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c47b8ca998d45dc81fdca86bc19ca80 in term 0.
I20260811 18:51:16.878386 21154 leader_election.cc:302] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2847cd691e2945cd83691bf2dd76bbc6, 9c47b8ca998d45dc81fdca86bc19ca80; no voters:
I20260811 18:51:16.878795 21622 raft_consensus.cc:2781] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:51:16.878970 21622 raft_consensus.cc:482] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:51:16.879081 21622 raft_consensus.cc:3037] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:51:16.881438 21622 raft_consensus.cc:504] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 40373 } } peers { permanent_uuid: "2847cd691e2945cd83691bf2dd76bbc6" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33565 } } peers { permanent_uuid: "24cc1175c4774e1592f062cfd0dbbc95" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35735 } }
I20260811 18:51:16.882136 21622 leader_election.cc:288] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80 [CANDIDATE]: Term 1 election: Requested vote from peers 2847cd691e2945cd83691bf2dd76bbc6 (127.25.25.1:33565), 24cc1175c4774e1592f062cfd0dbbc95 (127.25.25.3:35735)
I20260811 18:51:16.882766 21025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7adaf2c94e8341bcbda7b9103eaeb2f9" candidate_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2847cd691e2945cd83691bf2dd76bbc6"
I20260811 18:51:16.882777 21505 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7adaf2c94e8341bcbda7b9103eaeb2f9" candidate_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cc1175c4774e1592f062cfd0dbbc95"
I20260811 18:51:16.882982 21025 raft_consensus.cc:3037] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 2847cd691e2945cd83691bf2dd76bbc6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:51:16.883049 21505 raft_consensus.cc:3037] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 24cc1175c4774e1592f062cfd0dbbc95 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:51:16.885545 21505 raft_consensus.cc:2454] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 24cc1175c4774e1592f062cfd0dbbc95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c47b8ca998d45dc81fdca86bc19ca80 in term 1.
I20260811 18:51:16.885545 21025 raft_consensus.cc:2454] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 2847cd691e2945cd83691bf2dd76bbc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c47b8ca998d45dc81fdca86bc19ca80 in term 1.
I20260811 18:51:16.886135 21154 leader_election.cc:302] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2847cd691e2945cd83691bf2dd76bbc6, 9c47b8ca998d45dc81fdca86bc19ca80; no voters:
I20260811 18:51:16.886482 21622 raft_consensus.cc:2781] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:51:16.886938 21622 raft_consensus.cc:686] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80 [term 1 LEADER]: Becoming Leader. State: Replica: 9c47b8ca998d45dc81fdca86bc19ca80, State: Running, Role: LEADER
I20260811 18:51:16.887528 21622 consensus_queue.cc:237] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 40373 } } peers { permanent_uuid: "2847cd691e2945cd83691bf2dd76bbc6" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33565 } } peers { permanent_uuid: "24cc1175c4774e1592f062cfd0dbbc95" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35735 } }
I20260811 18:51:16.892513 20776 catalog_manager.cc:5495] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c47b8ca998d45dc81fdca86bc19ca80 (127.25.25.2). New cstate: current_term: 1 leader_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 40373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2847cd691e2945cd83691bf2dd76bbc6" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24cc1175c4774e1592f062cfd0dbbc95" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35735 } health_report { overall_health: UNKNOWN } } }
I20260811 18:51:16.979203 21599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:16.973260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50962 (local address 127.25.25.2:40373)
0811 18:51:16.973490 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:16.973495 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:16.973516 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:51:16.973739 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:16.973744 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:16.973833 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:16.973973 (+ 140us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:51:16.974304 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.975054 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.976627 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:16.977179 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:16.977356 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:16.977894 (+ 538us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:51:16.978550 (+ 656us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:51:16.978701 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:16.978819 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 18:51:16.978910 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260811 18:51:16.988909 21025 raft_consensus.cc:1261] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 2847cd691e2945cd83691bf2dd76bbc6 [term 1 FOLLOWER]: Refusing update from remote peer 9c47b8ca998d45dc81fdca86bc19ca80: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:51:16.988945 21505 raft_consensus.cc:1261] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 24cc1175c4774e1592f062cfd0dbbc95 [term 1 FOLLOWER]: Refusing update from remote peer 9c47b8ca998d45dc81fdca86bc19ca80: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:51:16.989962 21622 consensus_queue.cc:1035] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24cc1175c4774e1592f062cfd0dbbc95" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:51:16.990286 21628 consensus_queue.cc:1035] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2847cd691e2945cd83691bf2dd76bbc6" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:51:17.020619 20776 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56272:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:51:17.020931 20776 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56272:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:51:17.025776 20776 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040: Sending DeleteTablet for 3 replicas of tablet 7adaf2c94e8341bcbda7b9103eaeb2f9
I20260811 18:51:17.027307 20994 tablet_service.cc:1514] Processing DeleteTablet for tablet 7adaf2c94e8341bcbda7b9103eaeb2f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:51:17 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:60472
I20260811 18:51:17.027288 21469 tablet_service.cc:1514] Processing DeleteTablet for tablet 7adaf2c94e8341bcbda7b9103eaeb2f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:51:17 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:43756
I20260811 18:51:17.027565 21229 tablet_service.cc:1514] Processing DeleteTablet for tablet 7adaf2c94e8341bcbda7b9103eaeb2f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:51:17 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:50956
I20260811 18:51:17.028775 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 20886
I20260811 18:51:17.042927 21650 tablet_replica.cc:330] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80: stopping tablet replica
I20260811 18:51:17.042989 21649 tablet_replica.cc:330] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 24cc1175c4774e1592f062cfd0dbbc95: stopping tablet replica
I20260811 18:51:17.043535 21649 raft_consensus.cc:2229] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 24cc1175c4774e1592f062cfd0dbbc95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:51:17.043771 21650 raft_consensus.cc:2229] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:51:17.044245 21649 raft_consensus.cc:2258] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 24cc1175c4774e1592f062cfd0dbbc95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:51:17.044924 21650 raft_consensus.cc:2258] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:51:17.045207 21646 tablet_replica.cc:330] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 2847cd691e2945cd83691bf2dd76bbc6: stopping tablet replica
I20260811 18:51:17.045787 21646 raft_consensus.cc:2229] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 2847cd691e2945cd83691bf2dd76bbc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:51:17.046506 21646 raft_consensus.cc:2258] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 2847cd691e2945cd83691bf2dd76bbc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:51:17.048234 21650 ts_tablet_manager.cc:1905] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:51:17.049355 21649 ts_tablet_manager.cc:1905] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 24cc1175c4774e1592f062cfd0dbbc95: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:51:17.054214 21646 ts_tablet_manager.cc:1905] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 2847cd691e2945cd83691bf2dd76bbc6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:51:17.057829 21649 ts_tablet_manager.cc:1918] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 24cc1175c4774e1592f062cfd0dbbc95: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:51:17.058080 21649 log.cc:1196] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 24cc1175c4774e1592f062cfd0dbbc95: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/wal/wals/7adaf2c94e8341bcbda7b9103eaeb2f9
I20260811 18:51:17.058671 21649 ts_tablet_manager.cc:1939] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 24cc1175c4774e1592f062cfd0dbbc95: Deleting consensus metadata
I20260811 18:51:17.059628 21650 ts_tablet_manager.cc:1918] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:51:17.059866 21650 log.cc:1196] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/wal/wals/7adaf2c94e8341bcbda7b9103eaeb2f9
I20260811 18:51:17.060603 21650 ts_tablet_manager.cc:1939] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 9c47b8ca998d45dc81fdca86bc19ca80: Deleting consensus metadata
I20260811 18:51:17.061131 20759 catalog_manager.cc:4841] TS 24cc1175c4774e1592f062cfd0dbbc95 (127.25.25.3:35735): tablet 7adaf2c94e8341bcbda7b9103eaeb2f9 (table test-table [id=3dbc7bea4612403fb1062d15b79899f7]) successfully deleted
I20260811 18:51:17.062105 21646 ts_tablet_manager.cc:1918] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 2847cd691e2945cd83691bf2dd76bbc6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:51:17.062323 21646 log.cc:1196] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 2847cd691e2945cd83691bf2dd76bbc6: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/wal/wals/7adaf2c94e8341bcbda7b9103eaeb2f9
I20260811 18:51:17.062918 21646 ts_tablet_manager.cc:1939] T 7adaf2c94e8341bcbda7b9103eaeb2f9 P 2847cd691e2945cd83691bf2dd76bbc6: Deleting consensus metadata
I20260811 18:51:17.063764 20759 catalog_manager.cc:4841] TS 9c47b8ca998d45dc81fdca86bc19ca80 (127.25.25.2:40373): tablet 7adaf2c94e8341bcbda7b9103eaeb2f9 (table test-table [id=3dbc7bea4612403fb1062d15b79899f7]) successfully deleted
Aug 11 18:51:17 dist-test-slave-lgr5 krb5kdc[20700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.1@KRBTEST.COM
I20260811 18:51:17.065361 20755 catalog_manager.cc:4841] TS 2847cd691e2945cd83691bf2dd76bbc6 (127.25.25.1:33565): tablet 7adaf2c94e8341bcbda7b9103eaeb2f9 (table test-table [id=3dbc7bea4612403fb1062d15b79899f7]) successfully deleted
I20260811 18:51:17.074476 21603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:17.030162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60486 (local address 127.25.25.1:33565)
0811 18:51:17.030363 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:17.030369 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:17.039138 (+ 8769us) server_negotiation.cc:407] Connection header received
0811 18:51:17.039355 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:17.039361 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:17.039492 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:17.039632 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:51:17.045944 (+ 6312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:17.047265 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:17.049870 (+ 2605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:17.050583 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:17.050712 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:17.066758 (+ 16046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:51:17.066779 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:51:17.066803 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:51:17.066873 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:51:17.071048 (+ 4175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:17.071991 (+ 943us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:17.072002 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:17.072004 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:17.072229 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:17.072712 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:17.072717 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:17.072719 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:17.073160 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:51:17.073485 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:17.073850 (+ 365us) server_negotiation.cc:299] Negotiation successful
0811 18:51:17.074108 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 18:51:17.075325 21102 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:51:17.169552 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 20886
I20260811 18:51:17.206429 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 21122
Aug 11 18:51:17 dist-test-slave-lgr5 krb5kdc[20700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.2@KRBTEST.COM
I20260811 18:51:17.226378 21599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:17.207205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50968 (local address 127.25.25.2:40373)
0811 18:51:17.207440 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:17.207445 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:17.207464 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:51:17.207657 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:17.207661 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:17.207737 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:17.207822 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:51:17.209657 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:17.210555 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:17.212863 (+ 2308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:17.213434 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:17.213708 (+ 274us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:17.219355 (+ 5647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:51:17.219375 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:51:17.219396 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:51:17.219491 (+ 95us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:51:17.222693 (+ 3202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:17.223775 (+ 1082us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:17.223784 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:17.223787 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:17.223969 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:17.224543 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:17.224549 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:17.224551 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:17.225062 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:51:17.225424 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:17.225768 (+ 344us) server_negotiation.cc:299] Negotiation successful
0811 18:51:17.225992 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117}
I20260811 18:51:17.227288 21336 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:51:17.347275 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 21122
I20260811 18:51:17.373906 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 21357
Aug 11 18:51:17 dist-test-slave-lgr5 krb5kdc[20700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.3@KRBTEST.COM
I20260811 18:51:17.391827 21607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:17.374785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43768 (local address 127.25.25.3:35735)
0811 18:51:17.375019 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:17.375035 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:17.375056 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:51:17.375198 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:17.375202 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:17.375286 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:17.375380 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:51:17.376974 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:17.377789 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:17.379414 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:17.379888 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:17.380022 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:17.385251 (+ 5229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:51:17.385271 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:51:17.385289 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:51:17.385339 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:51:17.388409 (+ 3070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:17.389366 (+ 957us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:17.389375 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:17.389377 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:17.389597 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:17.390008 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:17.390013 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:17.390015 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:17.390540 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:51:17.390834 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:17.391180 (+ 346us) server_negotiation.cc:299] Negotiation successful
0811 18:51:17.391439 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 18:51:17.392632 21567 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:51:17.483637 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 21357
I20260811 18:51:17.506778 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 20727
I20260811 18:51:17.507913 20827 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:51:17.621829 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 20727
I20260811 18:51:37.654942 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:43223
--webserver_interface=127.25.25.62
--webserver_port=44913
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:39481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:43223
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:51:38.030496 21658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:51:38.030829 21658 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:51:38.030954 21658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:51:38.038548 21658 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 18:51:38.038657 21658 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 18:51:38.038697 21658 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 18:51:38.038766 21658 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:51:38.038841 21658 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:51:38.038950 21658 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:51:38.039011 21658 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:51:38.039064 21658 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:51:38.049487 21658 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:39481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:43223
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:43223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=44913
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:51:38.050971 21658 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:51:38.052476 21658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:51:38.079486 21670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:51:38.079502 21658 server_base.cc:1034] running on GCE node
W20260811 18:51:38.079553 21677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:51:38.079510 21671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:51:38.080993 21658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:51:38.082917 21658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:51:38.084247 21658 hybrid_clock.cc:648] HybridClock initialized: now 1786474298084141 us; error 66 us; skew 500 ppm
I20260811 18:51:38.084774 21658 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:51:38 dist-test-slave-lgr5 krb5kdc[20700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474298, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:51:38.089512 21658 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:51:38.091756 21658 webserver.cc:460] Webserver started at http://127.25.25.62:44913/ using document root <none> and password file <none>
I20260811 18:51:38.092753 21658 fs_manager.cc:359] Metadata directory not provided
I20260811 18:51:38.092911 21658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:51:38.100385 21658 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 18:51:38.104375 21691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:51:38.106089 21658 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 18:51:38.106287 21658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "426a58507c7c40caaf404880a5e07040"
format_stamp: "Formatted at 2026-08-11 18:51:14 on dist-test-slave-lgr5"
server_key: "dfa04aa47fbaf162f674d46eac4e310d"
server_key_iv: "1482c5b99c007af69de29558f7725bac"
server_key_version: "encryptionkey@0"
I20260811 18:51:38.107434 21658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:51:38.121543 21658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:51:38.126605 21658 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:51:38.126929 21658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:51:38.147415 21658 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:43223
I20260811 18:51:38.147451 21779 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:43223 every 8 connection(s)
I20260811 18:51:38.149417 21658 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:51:38.157922 21781 sys_catalog.cc:263] Verifying existing consensus state
I20260811 18:51:38.160178 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 21658
I20260811 18:51:38.161300 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:33565
--local_ip_for_outbound_sockets=127.25.25.1
--tserver_master_addrs=127.25.25.62:43223
--webserver_port=46449
--webserver_interface=127.25.25.1
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:39481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:51:38.162781 21781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040: Bootstrap starting.
I20260811 18:51:38.187691 21781 log.cc:824] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040: Log is configured to *not* fsync() on all Append() calls
I20260811 18:51:38.202289 21781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:51:38.202991 21781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040: Bootstrap complete.
I20260811 18:51:38.213189 21781 raft_consensus.cc:348] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426a58507c7c40caaf404880a5e07040" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43223 } }
I20260811 18:51:38.214164 21781 raft_consensus.cc:729] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 426a58507c7c40caaf404880a5e07040, State: Initialized, Role: FOLLOWER
I20260811 18:51:38.214915 21781 consensus_queue.cc:260] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426a58507c7c40caaf404880a5e07040" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43223 } }
I20260811 18:51:38.215185 21781 raft_consensus.cc:388] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:51:38.215327 21781 raft_consensus.cc:482] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:51:38.215502 21781 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [term 1 FOLLOWER]: Advancing to term 2
I20260811 18:51:38.219754 21781 raft_consensus.cc:504] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426a58507c7c40caaf404880a5e07040" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43223 } }
I20260811 18:51:38.220417 21781 leader_election.cc:302] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 426a58507c7c40caaf404880a5e07040; no voters:
I20260811 18:51:38.221076 21781 leader_election.cc:288] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 18:51:38.221230 21785 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 18:51:38.222427 21785 raft_consensus.cc:686] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [term 2 LEADER]: Becoming Leader. State: Replica: 426a58507c7c40caaf404880a5e07040, State: Running, Role: LEADER
I20260811 18:51:38.223038 21785 consensus_queue.cc:237] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426a58507c7c40caaf404880a5e07040" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43223 } }
I20260811 18:51:38.223565 21781 sys_catalog.cc:564] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:51:38.226074 21791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 426a58507c7c40caaf404880a5e07040. Latest consensus state: current_term: 2 leader_uuid: "426a58507c7c40caaf404880a5e07040" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426a58507c7c40caaf404880a5e07040" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43223 } } }
I20260811 18:51:38.227265 21791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [sys.catalog]: This master's current role is: LEADER
I20260811 18:51:38.226100 21786 sys_catalog.cc:455] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "426a58507c7c40caaf404880a5e07040" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426a58507c7c40caaf404880a5e07040" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43223 } } }
I20260811 18:51:38.228012 21786 sys_catalog.cc:458] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [sys.catalog]: This master's current role is: LEADER
I20260811 18:51:38.228891 21798 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:51:38.238229 21798 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:51:38.239938 21798 catalog_manager.cc:1259] Loaded cluster ID: eefc3ddfe4ec4f26876d2b00edd5a421
I20260811 18:51:38.240161 21798 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:51:38.244675 21798 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:51:38.246958 21798 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040: Loaded TSK: 0
I20260811 18:51:38.267530 21820 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 18:51:38.277339 21798 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040: Generated new TSK 1
I20260811 18:51:38.277822 21798 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 18:51:38.563490 21783 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:51:38.563838 21783 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:51:38.563969 21783 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:51:38.572186 21783 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:51:38.572329 21783 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:51:38.572499 21783 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:51:38.583473 21783 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:39481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:33565
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=46449
--tserver_master_addrs=127.25.25.62:43223
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:51:38.584993 21783 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:51:38.586570 21783 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:51:38.603169 21830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:51:38.603144 21832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:51:38.603619 21835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:51:38.604533 21783 server_base.cc:1034] running on GCE node
I20260811 18:51:38.605252 21783 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:51:38.606305 21783 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:51:38.607524 21783 hybrid_clock.cc:648] HybridClock initialized: now 1786474298607452 us; error 59 us; skew 500 ppm
I20260811 18:51:38.607919 21783 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:51:38 dist-test-slave-lgr5 krb5kdc[20700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474298, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:51:38.612238 21783 init.cc:377] Logged in from keytab as kudu/127.25.25.1@KRBTEST.COM (short username kudu)
I20260811 18:51:38.613973 21783 webserver.cc:460] Webserver started at http://127.25.25.1:46449/ using document root <none> and password file <none>
I20260811 18:51:38.614719 21783 fs_manager.cc:359] Metadata directory not provided
I20260811 18:51:38.614866 21783 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:51:38.620957 21783 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 18:51:38.623930 21849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:51:38.625458 21783 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 18:51:38.625633 21783 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "2847cd691e2945cd83691bf2dd76bbc6"
format_stamp: "Formatted at 2026-08-11 18:51:15 on dist-test-slave-lgr5"
server_key: "b8c98aa9f96308863d3c315952f6b14c"
server_key_iv: "0e53f024d1acd674a9ec258bb5a2ed78"
server_key_version: "encryptionkey@0"
I20260811 18:51:38.626665 21783 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:51:38.639989 21783 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:51:38.644380 21783 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:51:38.644666 21783 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:51:38.645768 21783 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:51:38.647271 21783 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:51:38.647377 21783 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:51:38.647493 21783 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:51:38.647571 21783 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:51:38.680864 21783 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:33565
I20260811 18:51:38.680943 22045 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:33565 every 8 connection(s)
I20260811 18:51:38.682389 21783 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:51:38.689095 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 21783
I20260811 18:51:38.689857 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:40373
--local_ip_for_outbound_sockets=127.25.25.2
--tserver_master_addrs=127.25.25.62:43223
--webserver_port=39371
--webserver_interface=127.25.25.2
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:39481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:51:38 dist-test-slave-lgr5 krb5kdc[20700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474298, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:51:38.708861 22050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:38.685498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.1:53673)
0811 18:51:38.686274 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:38.686312 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 18:51:38.688157 (+ 1845us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:51:38.689659 (+ 1502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:51:38.689670 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:51:38.690406 (+ 736us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:51:38.691186 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:38.691214 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:38.693090 (+ 1876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:38.693096 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:38.695077 (+ 1981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:38.695096 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:38.696236 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:38.696243 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:38.696521 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:38.697357 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:51:38.697389 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:51:38.700348 (+ 2959us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:51:38.704475 (+ 4127us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:51:38.704485 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:51:38.704500 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:51:38.705004 (+ 504us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:51:38.705500 (+ 496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:51:38.705504 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:51:38.705507 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:51:38.705701 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:51:38.706699 (+ 998us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:51:38.706708 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:51:38.707034 (+ 326us) client_negotiation.cc:769] Sending connection context
0811 18:51:38.707274 (+ 240us) client_negotiation.cc:240] Negotiation successful
0811 18:51:38.707725 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":345,"threads_started":1}
I20260811 18:51:38.709136 22049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:38.685428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:53673 (local address 127.25.25.62:43223)
0811 18:51:38.686131 (+ 703us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:38.686147 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:38.686440 (+ 293us) server_negotiation.cc:407] Connection header received
0811 18:51:38.688715 (+ 2275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:38.688729 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:38.689105 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:38.689425 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:51:38.691431 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:38.692891 (+ 1460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:38.695272 (+ 2381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:38.695954 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:38.696171 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:38.700729 (+ 4558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:51:38.700739 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:51:38.700756 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:51:38.700800 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:51:38.704285 (+ 3485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:38.705164 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:38.705174 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:38.705181 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:38.705394 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:38.705809 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:38.705813 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:38.705816 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:38.706554 (+ 738us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:51:38.706731 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:38.707542 (+ 811us) server_negotiation.cc:299] Negotiation successful
0811 18:51:38.708000 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":256,"threads_started":1}
I20260811 18:51:38.712224 22046 heartbeater.cc:347] Connected to a master server at 127.25.25.62:43223
I20260811 18:51:38.712584 22046 heartbeater.cc:464] Registering TS with master...
I20260811 18:51:38.713343 22046 heartbeater.cc:511] Master 127.25.25.62:43223 requested a full tablet report, sending...
I20260811 18:51:38.715757 21726 ts_manager.cc:194] Registered new tserver with Master: 2847cd691e2945cd83691bf2dd76bbc6 (127.25.25.1:33565)
I20260811 18:51:38.717437 21726 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.1@KRBTEST.COM'} at 127.25.25.1:53673
W20260811 18:51:39.057027 22052 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:51:39.057355 22052 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:51:39.057490 22052 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:51:39.065040 22052 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:51:39.065198 22052 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:51:39.065363 22052 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:51:39.075955 22052 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:39481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:40373
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=39371
--tserver_master_addrs=127.25.25.62:43223
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:51:39.077481 22052 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:51:39.078955 22052 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:51:39.093273 22068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:51:39.093288 22065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:51:39.093827 22071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:51:39.094283 22052 server_base.cc:1034] running on GCE node
I20260811 18:51:39.094986 22052 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:51:39.096196 22052 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:51:39.097483 22052 hybrid_clock.cc:648] HybridClock initialized: now 1786474299097418 us; error 49 us; skew 500 ppm
I20260811 18:51:39.097913 22052 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:51:39 dist-test-slave-lgr5 krb5kdc[20700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474299, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:51:39.101740 22052 init.cc:377] Logged in from keytab as kudu/127.25.25.2@KRBTEST.COM (short username kudu)
I20260811 18:51:39.103593 22052 webserver.cc:460] Webserver started at http://127.25.25.2:39371/ using document root <none> and password file <none>
I20260811 18:51:39.104460 22052 fs_manager.cc:359] Metadata directory not provided
I20260811 18:51:39.104609 22052 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:51:39.110993 22052 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 18:51:39.114662 22082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:51:39.116429 22052 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 18:51:39.116653 22052 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "9c47b8ca998d45dc81fdca86bc19ca80"
format_stamp: "Formatted at 2026-08-11 18:51:15 on dist-test-slave-lgr5"
server_key: "fb2924d77489640e4a8c5ed61dfc445b"
server_key_iv: "634f694904db72213ea222a45f4f41c9"
server_key_version: "encryptionkey@0"
I20260811 18:51:39.117784 22052 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:51:39.139467 22052 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:51:39.144165 22052 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:51:39.144459 22052 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:51:39.147169 22052 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:51:39.149138 22052 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:51:39.149277 22052 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:51:39.149397 22052 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:51:39.149473 22052 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:51:39.183784 22052 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:40373
I20260811 18:51:39.183847 22289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:40373 every 8 connection(s)
I20260811 18:51:39.185406 22052 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:51:39.187877 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 22052
I20260811 18:51:39.188614 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:35735
--local_ip_for_outbound_sockets=127.25.25.3
--tserver_master_addrs=127.25.25.62:43223
--webserver_port=45009
--webserver_interface=127.25.25.3
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:39481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:51:39 dist-test-slave-lgr5 krb5kdc[20700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474299, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:51:39.208168 22049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:39.188356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:52025 (local address 127.25.25.62:43223)
0811 18:51:39.188587 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:39.188593 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:39.190019 (+ 1426us) server_negotiation.cc:407] Connection header received
0811 18:51:39.192018 (+ 1999us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:39.192025 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:39.192161 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:39.192276 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:51:39.194105 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:39.195117 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:39.196987 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:39.197591 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:39.197731 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:39.201821 (+ 4090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:51:39.201827 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:51:39.201830 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:51:39.201869 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:51:39.204727 (+ 2858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:39.205597 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:39.205602 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:39.205604 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:39.205741 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:39.206231 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:39.206235 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:39.206238 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:39.206572 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:51:39.206726 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:39.207507 (+ 781us) server_negotiation.cc:299] Negotiation successful
0811 18:51:39.207771 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 18:51:39.209292 22297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:39.188917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.2:52025)
0811 18:51:39.189805 (+ 888us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:39.189857 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 18:51:39.191709 (+ 1852us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:51:39.192515 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:51:39.192525 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:51:39.193188 (+ 663us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:51:39.193873 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:39.193906 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:39.195354 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:39.195359 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:39.196791 (+ 1432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:39.196807 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:39.197851 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:39.197857 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:39.198101 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:39.198798 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:51:39.198826 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:51:39.201507 (+ 2681us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:51:39.204903 (+ 3396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:51:39.204914 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:51:39.204933 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:51:39.205422 (+ 489us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:51:39.205861 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:51:39.205866 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:51:39.205870 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:51:39.206102 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:51:39.206713 (+ 611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:51:39.206721 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:51:39.207108 (+ 387us) client_negotiation.cc:769] Sending connection context
0811 18:51:39.207369 (+ 261us) client_negotiation.cc:240] Negotiation successful
0811 18:51:39.207976 (+ 607us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":372,"threads_started":1}
I20260811 18:51:39.210876 22290 heartbeater.cc:347] Connected to a master server at 127.25.25.62:43223
I20260811 18:51:39.211189 22290 heartbeater.cc:464] Registering TS with master...
I20260811 18:51:39.211985 22290 heartbeater.cc:511] Master 127.25.25.62:43223 requested a full tablet report, sending...
I20260811 18:51:39.213639 21726 ts_manager.cc:194] Registered new tserver with Master: 9c47b8ca998d45dc81fdca86bc19ca80 (127.25.25.2:40373)
I20260811 18:51:39.214849 21726 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.2@KRBTEST.COM'} at 127.25.25.2:52025
W20260811 18:51:39.560847 22298 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:51:39.561170 22298 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:51:39.561272 22298 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:51:39.568883 22298 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:51:39.569025 22298 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:51:39.569145 22298 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:51:39.579887 22298 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:39481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:35735
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=45009
--tserver_master_addrs=127.25.25.62:43223
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:51:39.581357 22298 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:51:39.582791 22298 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:51:39.598649 22310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:51:39.598690 22312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:51:39.598740 22308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:51:39.602320 22298 server_base.cc:1034] running on GCE node
I20260811 18:51:39.603178 22298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:51:39.604401 22298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:51:39.605683 22298 hybrid_clock.cc:648] HybridClock initialized: now 1786474299605613 us; error 56 us; skew 500 ppm
I20260811 18:51:39.606099 22298 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:51:39 dist-test-slave-lgr5 krb5kdc[20700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474299, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:51:39.609858 22298 init.cc:377] Logged in from keytab as kudu/127.25.25.3@KRBTEST.COM (short username kudu)
I20260811 18:51:39.612919 22298 webserver.cc:460] Webserver started at http://127.25.25.3:45009/ using document root <none> and password file <none>
I20260811 18:51:39.614123 22298 fs_manager.cc:359] Metadata directory not provided
I20260811 18:51:39.614326 22298 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:51:39.620901 22298 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 18:51:39.624181 22331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:51:39.625888 22298 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 18:51:39.626062 22298 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "24cc1175c4774e1592f062cfd0dbbc95"
format_stamp: "Formatted at 2026-08-11 18:51:16 on dist-test-slave-lgr5"
server_key: "1b32b9b541032a17797fb87824afb841"
server_key_iv: "b96fd36efad32d9a5b18c79b9e8292c6"
server_key_version: "encryptionkey@0"
I20260811 18:51:39.627131 22298 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:51:39.642485 22298 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:51:39.647189 22298 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:51:39.647449 22298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:51:39.648530 22298 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:51:39.649959 22298 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:51:39.650051 22298 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:51:39.650139 22298 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:51:39.650192 22298 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:51:39.684229 22298 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:35735
I20260811 18:51:39.684262 22550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:35735 every 8 connection(s)
I20260811 18:51:39.685720 22298 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:51:39.693632 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 22298
Aug 11 18:51:39 dist-test-slave-lgr5 krb5kdc[20700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474299, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:51:39.707404 22049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:39.688350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:42631 (local address 127.25.25.62:43223)
0811 18:51:39.688538 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:39.688542 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:39.689719 (+ 1177us) server_negotiation.cc:407] Connection header received
0811 18:51:39.691621 (+ 1902us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:39.691628 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:39.691712 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:39.691804 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:51:39.693650 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:39.694602 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:39.696591 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:39.697018 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:39.697111 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:39.701257 (+ 4146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:51:39.701264 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:51:39.701268 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:51:39.701309 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:51:39.703986 (+ 2677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:39.704808 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:39.704814 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:39.704817 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:39.704986 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:39.705482 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:39.705487 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:39.705490 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:39.705799 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:51:39.705993 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:39.706772 (+ 779us) server_negotiation.cc:299] Negotiation successful
0811 18:51:39.707034 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 18:51:39.708530 22555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:39.688824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.3:42631)
0811 18:51:39.689548 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:39.689585 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 18:51:39.691333 (+ 1748us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:51:39.692109 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:51:39.692122 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:51:39.692668 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:51:39.693400 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:39.693429 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:39.694817 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:39.694824 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:39.696448 (+ 1624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:39.696477 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:39.697266 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:39.697275 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:39.697614 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:39.698389 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:51:39.698413 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:51:39.701025 (+ 2612us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:51:39.704171 (+ 3146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:51:39.704181 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:51:39.704196 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:51:39.704673 (+ 477us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:51:39.705106 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:51:39.705109 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:51:39.705112 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:51:39.705339 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:51:39.705942 (+ 603us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:51:39.705950 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:51:39.706331 (+ 381us) client_negotiation.cc:769] Sending connection context
0811 18:51:39.706645 (+ 314us) client_negotiation.cc:240] Negotiation successful
0811 18:51:39.707237 (+ 592us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":275,"threads_started":1}
I20260811 18:51:39.709949 22557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:39.694697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45476 (local address 127.25.25.62:43223)
0811 18:51:39.695897 (+ 1200us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:39.695901 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:39.695916 (+ 15us) server_negotiation.cc:407] Connection header received
0811 18:51:39.695969 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:39.695972 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:39.696027 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:39.696157 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:51:39.698208 (+ 2051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:39.698960 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:39.700758 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:39.701215 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:39.701318 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:39.703920 (+ 2602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:51:39.703931 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:51:39.703943 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:51:39.703980 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:51:39.706650 (+ 2670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:39.707365 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:39.707370 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:39.707374 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:39.707546 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:39.708041 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:39.708047 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:39.708050 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:39.708378 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:51:39.708653 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:39.709354 (+ 701us) server_negotiation.cc:299] Negotiation successful
0811 18:51:39.709580 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1106,"thread_start_us":970,"threads_started":1}
I20260811 18:51:39.710207 22552 heartbeater.cc:347] Connected to a master server at 127.25.25.62:43223
I20260811 18:51:39.710580 22552 heartbeater.cc:464] Registering TS with master...
I20260811 18:51:39.711547 22552 heartbeater.cc:511] Master 127.25.25.62:43223 requested a full tablet report, sending...
I20260811 18:51:39.713362 21726 ts_manager.cc:194] Registered new tserver with Master: 24cc1175c4774e1592f062cfd0dbbc95 (127.25.25.3:35735)
I20260811 18:51:39.714228 21726 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.3@KRBTEST.COM'} at 127.25.25.3:42631
I20260811 18:51:39.721282 22046 heartbeater.cc:503] Master 127.25.25.62:43223 was elected leader, sending a full tablet report...
I20260811 18:51:39.725536 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:51:39.732774 22557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:39.726512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45486 (local address 127.25.25.62:43223)
0811 18:51:39.726692 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:39.726696 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:39.727204 (+ 508us) server_negotiation.cc:407] Connection header received
0811 18:51:39.727429 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:39.727433 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:39.727616 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:39.727753 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:51:39.728239 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:39.729000 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:39.730613 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:39.731087 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:39.731204 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:39.731870 (+ 666us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:51:39.732154 (+ 284us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 18:51:39.732506 (+ 352us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45486: token expired
Metrics: {"server-negotiator.queue_time_us":64}
W20260811 18:51:39.732924 22557 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45486: token expired
W20260811 18:51:39.733563 21582 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.25.25.62:43223)
I20260811 18:51:39.747282 22557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:39.734244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45496 (local address 127.25.25.62:43223)
0811 18:51:39.734432 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:39.734438 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:39.734456 (+ 18us) server_negotiation.cc:407] Connection header received
0811 18:51:39.734508 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:39.734512 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:39.734570 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:39.734652 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:51:39.736119 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:39.736853 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:39.738297 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:39.738710 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:39.738823 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:39.741781 (+ 2958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:51:39.741786 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:51:39.741789 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:51:39.741826 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:51:39.744452 (+ 2626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:39.745181 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:39.745187 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:39.745189 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:39.745337 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:39.745715 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:39.745719 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:39.745721 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:39.746094 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:51:39.746331 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:39.746681 (+ 350us) server_negotiation.cc:299] Negotiation successful
0811 18:51:39.746932 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 18:51:39.751039 21726 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45496:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:51:39.758844 21726 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:51:39.786049 22565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:39.772942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:33565 (local address 127.0.0.1:60180)
0811 18:51:39.775847 (+ 2905us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:39.775868 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:51:39.776137 (+ 269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:51:39.777071 (+ 934us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:51:39.777075 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:51:39.777097 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:51:39.777470 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:39.777491 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:39.779538 (+ 2047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:39.779543 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:39.782232 (+ 2689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:39.782250 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:39.784822 (+ 2572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:39.784830 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:39.785079 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:39.785143 (+ 64us) client_negotiation.cc:769] Sending connection context
0811 18:51:39.785297 (+ 154us) client_negotiation.cc:240] Negotiation successful
0811 18:51:39.785534 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2775,"mutex_wait_us":57,"thread_start_us":925,"threads_started":1}
I20260811 18:51:39.786563 22566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:39.772837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:35735 (local address 127.0.0.1:39936)
0811 18:51:39.773751 (+ 914us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:39.773805 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 18:51:39.774013 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:51:39.776803 (+ 2790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:51:39.776811 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:51:39.776841 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:51:39.777348 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:39.777363 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:39.780372 (+ 3009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:39.780378 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:39.783490 (+ 3112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:39.783513 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:39.785676 (+ 2163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:39.785683 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:39.785874 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:39.785911 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 18:51:39.785997 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 18:51:39.786139 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":634,"mutex_wait_us":898,"thread_start_us":2725,"threads_started":1}
I20260811 18:51:39.787166 22570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:39.773683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60180 (local address 127.25.25.1:33565)
0811 18:51:39.775525 (+ 1842us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:39.775535 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:39.775981 (+ 446us) server_negotiation.cc:407] Connection header received
0811 18:51:39.776328 (+ 347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:39.776335 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:39.776549 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:39.776735 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:51:39.777658 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:39.779317 (+ 1659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:39.782478 (+ 3161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:39.784180 (+ 1702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:39.784325 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:39.784632 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:39.786626 (+ 1994us) server_negotiation.cc:299] Negotiation successful
0811 18:51:39.786837 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1618,"thread_start_us":1481,"threads_started":1}
I20260811 18:51:39.789399 22569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:39.773073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39936 (local address 127.25.25.3:35735)
0811 18:51:39.776069 (+ 2996us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:39.776099 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:39.776134 (+ 35us) server_negotiation.cc:407] Connection header received
0811 18:51:39.776250 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:39.776259 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:39.776547 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:39.778333 (+ 1786us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:51:39.778614 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:39.780192 (+ 1578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:39.783790 (+ 3598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:39.785422 (+ 1632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:39.788413 (+ 2991us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:39.788713 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:39.788831 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 18:51:39.789036 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2808,"thread_start_us":2646,"threads_started":1}
I20260811 18:51:39.791872 21937 tablet_service.cc:1467] Processing CreateTablet for tablet 0de6a5d18554426baf5ebaff46365a99 (DEFAULT_TABLE table=test-table [id=cad6a5db5c8046b1adcbaf3f582ab07e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:51:39.793782 21937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0de6a5d18554426baf5ebaff46365a99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:51:39.793967 22432 tablet_service.cc:1467] Processing CreateTablet for tablet 0de6a5d18554426baf5ebaff46365a99 (DEFAULT_TABLE table=test-table [id=cad6a5db5c8046b1adcbaf3f582ab07e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:51:39.795708 22432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0de6a5d18554426baf5ebaff46365a99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:51:39.796351 22566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:39.776262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:40373 (local address 127.0.0.1:57020)
0811 18:51:39.786798 (+ 10536us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:39.786818 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:51:39.786945 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:51:39.790238 (+ 3293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:51:39.790242 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:51:39.790273 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:51:39.790462 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:39.790476 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:39.792130 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:39.792137 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:39.793817 (+ 1680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:39.793836 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:39.795481 (+ 1645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:39.795488 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:39.795691 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:39.795728 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 18:51:39.795815 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 18:51:39.795999 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10432,"thread_start_us":12584,"threads_started":1}
I20260811 18:51:39.796720 22576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:39.776316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57020 (local address 127.25.25.2:40373)
0811 18:51:39.789623 (+ 13307us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:39.789633 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:39.789664 (+ 31us) server_negotiation.cc:407] Connection header received
0811 18:51:39.789787 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:39.789796 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:39.790014 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:39.790211 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:51:39.790648 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:39.791936 (+ 1288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:39.794046 (+ 2110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:39.795287 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:39.795428 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:39.795659 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:39.795975 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 18:51:39.796188 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13122,"thread_start_us":12974,"threads_started":1}
I20260811 18:51:39.800586 22180 tablet_service.cc:1467] Processing CreateTablet for tablet 0de6a5d18554426baf5ebaff46365a99 (DEFAULT_TABLE table=test-table [id=cad6a5db5c8046b1adcbaf3f582ab07e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:51:39.801860 22180 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0de6a5d18554426baf5ebaff46365a99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:51:39.811805 22577 tablet_bootstrap.cc:492] T 0de6a5d18554426baf5ebaff46365a99 P 2847cd691e2945cd83691bf2dd76bbc6: Bootstrap starting.
I20260811 18:51:39.814184 22580 tablet_bootstrap.cc:492] T 0de6a5d18554426baf5ebaff46365a99 P 24cc1175c4774e1592f062cfd0dbbc95: Bootstrap starting.
I20260811 18:51:39.816437 22584 tablet_bootstrap.cc:492] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80: Bootstrap starting.
I20260811 18:51:39.817672 22577 tablet_bootstrap.cc:654] T 0de6a5d18554426baf5ebaff46365a99 P 2847cd691e2945cd83691bf2dd76bbc6: Neither blocks nor log segments found. Creating new log.
I20260811 18:51:39.818128 22580 tablet_bootstrap.cc:654] T 0de6a5d18554426baf5ebaff46365a99 P 24cc1175c4774e1592f062cfd0dbbc95: Neither blocks nor log segments found. Creating new log.
I20260811 18:51:39.818872 22577 log.cc:824] T 0de6a5d18554426baf5ebaff46365a99 P 2847cd691e2945cd83691bf2dd76bbc6: Log is configured to *not* fsync() on all Append() calls
I20260811 18:51:39.819456 22580 log.cc:824] T 0de6a5d18554426baf5ebaff46365a99 P 24cc1175c4774e1592f062cfd0dbbc95: Log is configured to *not* fsync() on all Append() calls
I20260811 18:51:39.820729 22584 tablet_bootstrap.cc:654] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80: Neither blocks nor log segments found. Creating new log.
I20260811 18:51:39.822222 22584 log.cc:824] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80: Log is configured to *not* fsync() on all Append() calls
I20260811 18:51:39.828817 22584 tablet_bootstrap.cc:492] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80: No bootstrap required, opened a new log
I20260811 18:51:39.828817 22577 tablet_bootstrap.cc:492] T 0de6a5d18554426baf5ebaff46365a99 P 2847cd691e2945cd83691bf2dd76bbc6: No bootstrap required, opened a new log
I20260811 18:51:39.829008 22580 tablet_bootstrap.cc:492] T 0de6a5d18554426baf5ebaff46365a99 P 24cc1175c4774e1592f062cfd0dbbc95: No bootstrap required, opened a new log
I20260811 18:51:39.829174 22577 ts_tablet_manager.cc:1397] T 0de6a5d18554426baf5ebaff46365a99 P 2847cd691e2945cd83691bf2dd76bbc6: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.010s
I20260811 18:51:39.829180 22584 ts_tablet_manager.cc:1397] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.003s
I20260811 18:51:39.829291 22580 ts_tablet_manager.cc:1397] T 0de6a5d18554426baf5ebaff46365a99 P 24cc1175c4774e1592f062cfd0dbbc95: Time spent bootstrapping tablet: real 0.015s user 0.013s sys 0.000s
I20260811 18:51:39.837352 22580 raft_consensus.cc:348] T 0de6a5d18554426baf5ebaff46365a99 P 24cc1175c4774e1592f062cfd0dbbc95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cc1175c4774e1592f062cfd0dbbc95" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35735 } } peers { permanent_uuid: "2847cd691e2945cd83691bf2dd76bbc6" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33565 } } peers { permanent_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 40373 } }
I20260811 18:51:39.837781 22580 raft_consensus.cc:374] T 0de6a5d18554426baf5ebaff46365a99 P 24cc1175c4774e1592f062cfd0dbbc95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:51:39.837880 22580 raft_consensus.cc:729] T 0de6a5d18554426baf5ebaff46365a99 P 24cc1175c4774e1592f062cfd0dbbc95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24cc1175c4774e1592f062cfd0dbbc95, State: Initialized, Role: FOLLOWER
I20260811 18:51:39.838550 22580 consensus_queue.cc:260] T 0de6a5d18554426baf5ebaff46365a99 P 24cc1175c4774e1592f062cfd0dbbc95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cc1175c4774e1592f062cfd0dbbc95" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35735 } } peers { permanent_uuid: "2847cd691e2945cd83691bf2dd76bbc6" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33565 } } peers { permanent_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 40373 } }
I20260811 18:51:39.839747 22552 heartbeater.cc:503] Master 127.25.25.62:43223 was elected leader, sending a full tablet report...
I20260811 18:51:39.840574 22580 ts_tablet_manager.cc:1428] T 0de6a5d18554426baf5ebaff46365a99 P 24cc1175c4774e1592f062cfd0dbbc95: Time spent starting tablet: real 0.011s user 0.007s sys 0.005s
I20260811 18:51:39.840492 22577 raft_consensus.cc:348] T 0de6a5d18554426baf5ebaff46365a99 P 2847cd691e2945cd83691bf2dd76bbc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cc1175c4774e1592f062cfd0dbbc95" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35735 } } peers { permanent_uuid: "2847cd691e2945cd83691bf2dd76bbc6" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33565 } } peers { permanent_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 40373 } }
I20260811 18:51:39.840492 22584 raft_consensus.cc:348] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cc1175c4774e1592f062cfd0dbbc95" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35735 } } peers { permanent_uuid: "2847cd691e2945cd83691bf2dd76bbc6" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33565 } } peers { permanent_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 40373 } }
I20260811 18:51:39.840978 22577 raft_consensus.cc:374] T 0de6a5d18554426baf5ebaff46365a99 P 2847cd691e2945cd83691bf2dd76bbc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:51:39.840974 22584 raft_consensus.cc:374] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:51:39.841075 22577 raft_consensus.cc:729] T 0de6a5d18554426baf5ebaff46365a99 P 2847cd691e2945cd83691bf2dd76bbc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2847cd691e2945cd83691bf2dd76bbc6, State: Initialized, Role: FOLLOWER
I20260811 18:51:39.841075 22584 raft_consensus.cc:729] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c47b8ca998d45dc81fdca86bc19ca80, State: Initialized, Role: FOLLOWER
I20260811 18:51:39.841753 22584 consensus_queue.cc:260] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cc1175c4774e1592f062cfd0dbbc95" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35735 } } peers { permanent_uuid: "2847cd691e2945cd83691bf2dd76bbc6" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33565 } } peers { permanent_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 40373 } }
I20260811 18:51:39.841737 22577 consensus_queue.cc:260] T 0de6a5d18554426baf5ebaff46365a99 P 2847cd691e2945cd83691bf2dd76bbc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cc1175c4774e1592f062cfd0dbbc95" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35735 } } peers { permanent_uuid: "2847cd691e2945cd83691bf2dd76bbc6" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33565 } } peers { permanent_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 40373 } }
I20260811 18:51:39.847172 22584 ts_tablet_manager.cc:1428] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80: Time spent starting tablet: real 0.018s user 0.013s sys 0.004s
I20260811 18:51:39.847216 22290 heartbeater.cc:503] Master 127.25.25.62:43223 was elected leader, sending a full tablet report...
I20260811 18:51:39.848817 22577 ts_tablet_manager.cc:1428] T 0de6a5d18554426baf5ebaff46365a99 P 2847cd691e2945cd83691bf2dd76bbc6: Time spent starting tablet: real 0.020s user 0.015s sys 0.005s
W20260811 18:51:39.934906 22047 tablet.cc:2369] T 0de6a5d18554426baf5ebaff46365a99 P 2847cd691e2945cd83691bf2dd76bbc6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:51:39.937500 22294 tablet.cc:2369] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:51:39.937397 22554 tablet.cc:2369] T 0de6a5d18554426baf5ebaff46365a99 P 24cc1175c4774e1592f062cfd0dbbc95: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:51:40.038672 22591 raft_consensus.cc:482] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:51:40.038969 22591 raft_consensus.cc:504] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cc1175c4774e1592f062cfd0dbbc95" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35735 } } peers { permanent_uuid: "2847cd691e2945cd83691bf2dd76bbc6" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33565 } } peers { permanent_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 40373 } }
I20260811 18:51:40.040768 22591 leader_election.cc:288] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24cc1175c4774e1592f062cfd0dbbc95 (127.25.25.3:35735), 2847cd691e2945cd83691bf2dd76bbc6 (127.25.25.1:33565)
I20260811 18:51:40.050061 22569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:40.041294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:53187 (local address 127.25.25.3:35735)
0811 18:51:40.041526 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:40.041533 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:40.042317 (+ 784us) server_negotiation.cc:407] Connection header received
0811 18:51:40.042534 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:40.042539 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:40.042623 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:40.042728 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:51:40.043549 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:40.044734 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:40.047595 (+ 2861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:40.048873 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:40.049033 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:40.049126 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:40.049656 (+ 530us) server_negotiation.cc:299] Negotiation successful
0811 18:51:40.049797 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 18:51:40.050061 22570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:40.041396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:51765 (local address 127.25.25.1:33565)
0811 18:51:40.041590 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:40.041595 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:40.042315 (+ 720us) server_negotiation.cc:407] Connection header received
0811 18:51:40.042539 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:40.042544 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:40.042623 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:40.042728 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:51:40.043646 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:40.044756 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:40.047605 (+ 2849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:40.048857 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:40.049009 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:40.049126 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:40.049656 (+ 530us) server_negotiation.cc:299] Negotiation successful
0811 18:51:40.049797 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 18:51:40.050326 22598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:40.041152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:35735 (local address 127.25.25.2:53187)
0811 18:51:40.042172 (+ 1020us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:40.042195 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:51:40.042394 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:51:40.042803 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:51:40.042809 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:51:40.042844 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:51:40.043341 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:40.043357 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:40.044895 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:40.044899 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:40.047403 (+ 2504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:40.047423 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:40.049143 (+ 1720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:40.049148 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:40.049446 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:40.049515 (+ 69us) client_negotiation.cc:769] Sending connection context
0811 18:51:40.049608 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 18:51:40.049842 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":850,"mutex_wait_us":237,"spinlock_wait_cycles":24320,"thread_start_us":596,"threads_started":1}
I20260811 18:51:40.050634 22597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:40.041214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:33565 (local address 127.25.25.2:51765)
0811 18:51:40.042180 (+ 966us) negotiation.cc:107] Waiting for socket to connect
0811 18:51:40.042194 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:51:40.042368 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:51:40.042811 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:51:40.042815 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:51:40.042876 (+ 61us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:51:40.043468 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:40.043482 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:40.044893 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:40.044899 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:40.047408 (+ 2509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:51:40.047423 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:51:40.049140 (+ 1717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:51:40.049147 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:51:40.049452 (+ 305us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:40.049513 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 18:51:40.049610 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 18:51:40.049842 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":868,"mutex_wait_us":208,"spinlock_wait_cycles":35072,"thread_start_us":521,"threads_started":1}
I20260811 18:51:40.051507 22464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0de6a5d18554426baf5ebaff46365a99" candidate_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cc1175c4774e1592f062cfd0dbbc95" is_pre_election: true
I20260811 18:51:40.051684 21969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0de6a5d18554426baf5ebaff46365a99" candidate_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2847cd691e2945cd83691bf2dd76bbc6" is_pre_election: true
I20260811 18:51:40.052145 22464 raft_consensus.cc:2454] T 0de6a5d18554426baf5ebaff46365a99 P 24cc1175c4774e1592f062cfd0dbbc95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c47b8ca998d45dc81fdca86bc19ca80 in term 0.
I20260811 18:51:40.052256 21969 raft_consensus.cc:2454] T 0de6a5d18554426baf5ebaff46365a99 P 2847cd691e2945cd83691bf2dd76bbc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c47b8ca998d45dc81fdca86bc19ca80 in term 0.
I20260811 18:51:40.052979 22087 leader_election.cc:302] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24cc1175c4774e1592f062cfd0dbbc95, 9c47b8ca998d45dc81fdca86bc19ca80; no voters:
I20260811 18:51:40.053421 22591 raft_consensus.cc:2781] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:51:40.053576 22591 raft_consensus.cc:482] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:51:40.053681 22591 raft_consensus.cc:3037] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:51:40.056067 22591 raft_consensus.cc:504] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cc1175c4774e1592f062cfd0dbbc95" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35735 } } peers { permanent_uuid: "2847cd691e2945cd83691bf2dd76bbc6" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33565 } } peers { permanent_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 40373 } }
I20260811 18:51:40.056819 22591 leader_election.cc:288] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80 [CANDIDATE]: Term 1 election: Requested vote from peers 24cc1175c4774e1592f062cfd0dbbc95 (127.25.25.3:35735), 2847cd691e2945cd83691bf2dd76bbc6 (127.25.25.1:33565)
I20260811 18:51:40.057379 22464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0de6a5d18554426baf5ebaff46365a99" candidate_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24cc1175c4774e1592f062cfd0dbbc95"
I20260811 18:51:40.057400 21969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0de6a5d18554426baf5ebaff46365a99" candidate_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2847cd691e2945cd83691bf2dd76bbc6"
I20260811 18:51:40.057601 22464 raft_consensus.cc:3037] T 0de6a5d18554426baf5ebaff46365a99 P 24cc1175c4774e1592f062cfd0dbbc95 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:51:40.057600 21969 raft_consensus.cc:3037] T 0de6a5d18554426baf5ebaff46365a99 P 2847cd691e2945cd83691bf2dd76bbc6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:51:40.059967 22464 raft_consensus.cc:2454] T 0de6a5d18554426baf5ebaff46365a99 P 24cc1175c4774e1592f062cfd0dbbc95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c47b8ca998d45dc81fdca86bc19ca80 in term 1.
I20260811 18:51:40.059957 21969 raft_consensus.cc:2454] T 0de6a5d18554426baf5ebaff46365a99 P 2847cd691e2945cd83691bf2dd76bbc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c47b8ca998d45dc81fdca86bc19ca80 in term 1.
I20260811 18:51:40.060546 22084 leader_election.cc:302] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 24cc1175c4774e1592f062cfd0dbbc95, 2847cd691e2945cd83691bf2dd76bbc6, 9c47b8ca998d45dc81fdca86bc19ca80; no voters:
I20260811 18:51:40.060995 22591 raft_consensus.cc:2781] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:51:40.061467 22591 raft_consensus.cc:686] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80 [term 1 LEADER]: Becoming Leader. State: Replica: 9c47b8ca998d45dc81fdca86bc19ca80, State: Running, Role: LEADER
I20260811 18:51:40.062037 22591 consensus_queue.cc:237] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cc1175c4774e1592f062cfd0dbbc95" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35735 } } peers { permanent_uuid: "2847cd691e2945cd83691bf2dd76bbc6" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33565 } } peers { permanent_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 40373 } }
I20260811 18:51:40.067028 21726 catalog_manager.cc:5495] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c47b8ca998d45dc81fdca86bc19ca80 (127.25.25.2). New cstate: current_term: 1 leader_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24cc1175c4774e1592f062cfd0dbbc95" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2847cd691e2945cd83691bf2dd76bbc6" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c47b8ca998d45dc81fdca86bc19ca80" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 40373 } health_report { overall_health: HEALTHY } } }
I20260811 18:51:40.089668 22576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:40.083287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57026 (local address 127.25.25.2:40373)
0811 18:51:40.083527 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:40.083532 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:40.083550 (+ 18us) server_negotiation.cc:407] Connection header received
0811 18:51:40.083649 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:40.083653 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:40.083745 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:40.083878 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:51:40.084376 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:40.085394 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:40.087006 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:40.087460 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:40.087599 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:40.088308 (+ 709us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:51:40.089000 (+ 692us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:51:40.089168 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:40.089280 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 18:51:40.089368 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 18:51:40.099426 21969 raft_consensus.cc:1261] T 0de6a5d18554426baf5ebaff46365a99 P 2847cd691e2945cd83691bf2dd76bbc6 [term 1 FOLLOWER]: Refusing update from remote peer 9c47b8ca998d45dc81fdca86bc19ca80: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:51:40.099431 22464 raft_consensus.cc:1261] T 0de6a5d18554426baf5ebaff46365a99 P 24cc1175c4774e1592f062cfd0dbbc95 [term 1 FOLLOWER]: Refusing update from remote peer 9c47b8ca998d45dc81fdca86bc19ca80: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:51:40.100793 22599 consensus_queue.cc:1035] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2847cd691e2945cd83691bf2dd76bbc6" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 33565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:51:40.101325 22591 consensus_queue.cc:1035] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24cc1175c4774e1592f062cfd0dbbc95" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 35735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:51:40.113662 22606 mvcc.cc:205] Tried to move back new op lower bound from 7317398733194899456 to 7317398733057953792. Current Snapshot: MvccSnapshot[applied={T|T < 7317398733194899456}]
I20260811 18:51:40.128713 21724 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45496:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:51:40.129055 21724 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45496:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:51:40.133385 21724 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040: Sending DeleteTablet for 3 replicas of tablet 0de6a5d18554426baf5ebaff46365a99
I20260811 18:51:40.134816 21937 tablet_service.cc:1514] Processing DeleteTablet for tablet 0de6a5d18554426baf5ebaff46365a99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:51:40 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:60180
I20260811 18:51:40.135062 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 21783
I20260811 18:51:40.134934 22432 tablet_service.cc:1514] Processing DeleteTablet for tablet 0de6a5d18554426baf5ebaff46365a99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:51:40 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:39936
I20260811 18:51:40.136109 22180 tablet_service.cc:1514] Processing DeleteTablet for tablet 0de6a5d18554426baf5ebaff46365a99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:51:40 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:57020
I20260811 18:51:40.146220 22623 tablet_replica.cc:330] T 0de6a5d18554426baf5ebaff46365a99 P 2847cd691e2945cd83691bf2dd76bbc6: stopping tablet replica
I20260811 18:51:40.146808 22623 raft_consensus.cc:2229] T 0de6a5d18554426baf5ebaff46365a99 P 2847cd691e2945cd83691bf2dd76bbc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:51:40.148802 22623 raft_consensus.cc:2258] T 0de6a5d18554426baf5ebaff46365a99 P 2847cd691e2945cd83691bf2dd76bbc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:51:40.153308 22623 ts_tablet_manager.cc:1905] T 0de6a5d18554426baf5ebaff46365a99 P 2847cd691e2945cd83691bf2dd76bbc6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:51:40.159507 22570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:40.136676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60196 (local address 127.25.25.1:33565)
0811 18:51:40.136869 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:40.136876 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:40.136895 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:51:40.136970 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:40.136975 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:40.137091 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:40.137199 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:51:40.139817 (+ 2618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:40.141755 (+ 1938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:40.144062 (+ 2307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:40.144874 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:40.145031 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:40.149385 (+ 4354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:51:40.149404 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:51:40.149427 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:51:40.149497 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:51:40.154330 (+ 4833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:40.155440 (+ 1110us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:40.155451 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:40.155455 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:40.155660 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:40.156230 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:40.156235 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:40.156238 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:40.156926 (+ 688us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:51:40.157271 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:40.158751 (+ 1480us) server_negotiation.cc:299] Negotiation successful
0811 18:51:40.159054 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 18:51:40.160377 22040 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:51:40.169427 22625 tablet_replica.cc:330] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80: stopping tablet replica
I20260811 18:51:40.170043 22624 tablet_replica.cc:330] T 0de6a5d18554426baf5ebaff46365a99 P 24cc1175c4774e1592f062cfd0dbbc95: stopping tablet replica
I20260811 18:51:40.170200 22625 raft_consensus.cc:2229] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:51:40.170447 22624 raft_consensus.cc:2229] T 0de6a5d18554426baf5ebaff46365a99 P 24cc1175c4774e1592f062cfd0dbbc95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:51:40.170928 22624 raft_consensus.cc:2258] T 0de6a5d18554426baf5ebaff46365a99 P 24cc1175c4774e1592f062cfd0dbbc95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:51:40.171072 22625 raft_consensus.cc:2258] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:51:40.175305 22625 ts_tablet_manager.cc:1905] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:51:40.183925 22625 ts_tablet_manager.cc:1918] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:51:40.184209 22625 log.cc:1196] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/wal/wals/0de6a5d18554426baf5ebaff46365a99
I20260811 18:51:40.184847 22625 ts_tablet_manager.cc:1939] T 0de6a5d18554426baf5ebaff46365a99 P 9c47b8ca998d45dc81fdca86bc19ca80: Deleting consensus metadata
I20260811 18:51:40.186991 21698 catalog_manager.cc:4841] TS 9c47b8ca998d45dc81fdca86bc19ca80 (127.25.25.2:40373): tablet 0de6a5d18554426baf5ebaff46365a99 (table test-table [id=cad6a5db5c8046b1adcbaf3f582ab07e]) successfully deleted
I20260811 18:51:40.190296 22624 ts_tablet_manager.cc:1905] T 0de6a5d18554426baf5ebaff46365a99 P 24cc1175c4774e1592f062cfd0dbbc95: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:51:40.198772 22624 ts_tablet_manager.cc:1918] T 0de6a5d18554426baf5ebaff46365a99 P 24cc1175c4774e1592f062cfd0dbbc95: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:51:40.199004 22624 log.cc:1196] T 0de6a5d18554426baf5ebaff46365a99 P 24cc1175c4774e1592f062cfd0dbbc95: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/wal/wals/0de6a5d18554426baf5ebaff46365a99
I20260811 18:51:40.199587 22624 ts_tablet_manager.cc:1939] T 0de6a5d18554426baf5ebaff46365a99 P 24cc1175c4774e1592f062cfd0dbbc95: Deleting consensus metadata
I20260811 18:51:40.201781 21698 catalog_manager.cc:4841] TS 24cc1175c4774e1592f062cfd0dbbc95 (127.25.25.3:35735): tablet 0de6a5d18554426baf5ebaff46365a99 (table test-table [id=cad6a5db5c8046b1adcbaf3f582ab07e]) successfully deleted
I20260811 18:51:40.285154 22623 ts_tablet_manager.cc:1918] T 0de6a5d18554426baf5ebaff46365a99 P 2847cd691e2945cd83691bf2dd76bbc6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:51:40.285441 22623 log.cc:1196] T 0de6a5d18554426baf5ebaff46365a99 P 2847cd691e2945cd83691bf2dd76bbc6: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/wal/wals/0de6a5d18554426baf5ebaff46365a99
I20260811 18:51:40.286060 22623 ts_tablet_manager.cc:1939] T 0de6a5d18554426baf5ebaff46365a99 P 2847cd691e2945cd83691bf2dd76bbc6: Deleting consensus metadata
I20260811 18:51:40.287787 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 21783
I20260811 18:51:40.287986 21695 catalog_manager.cc:4841] TS 2847cd691e2945cd83691bf2dd76bbc6 (127.25.25.1:33565): tablet 0de6a5d18554426baf5ebaff46365a99 (table test-table [id=cad6a5db5c8046b1adcbaf3f582ab07e]) successfully deleted
I20260811 18:51:40.317145 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 22052
I20260811 18:51:40.334606 22576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:40.317988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57042 (local address 127.25.25.2:40373)
0811 18:51:40.318192 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:40.318198 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:40.318221 (+ 23us) server_negotiation.cc:407] Connection header received
0811 18:51:40.318340 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:40.318346 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:40.318442 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:40.318564 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:51:40.320046 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:40.321374 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:40.322867 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:40.323624 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:40.323757 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:40.326542 (+ 2785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:51:40.326562 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:51:40.326585 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:51:40.326634 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:51:40.330785 (+ 4151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:40.331816 (+ 1031us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:40.331827 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:40.331830 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:40.332223 (+ 393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:40.332774 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:40.332780 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:40.332784 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:40.333233 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:51:40.333610 (+ 377us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:40.333961 (+ 351us) server_negotiation.cc:299] Negotiation successful
0811 18:51:40.334220 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 18:51:40.335886 22278 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:51:40.455927 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 22052
I20260811 18:51:40.483525 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 22298
I20260811 18:51:40.500280 22569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:51:40.484564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39942 (local address 127.25.25.3:35735)
0811 18:51:40.484810 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 18:51:40.484818 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:51:40.484840 (+ 22us) server_negotiation.cc:407] Connection header received
0811 18:51:40.484913 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:51:40.484917 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:51:40.484989 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:51:40.485091 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:51:40.486674 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:40.487490 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:40.489333 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:51:40.489769 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:51:40.489926 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:51:40.493097 (+ 3171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:51:40.493118 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:51:40.493137 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:51:40.493210 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:51:40.496609 (+ 3399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:40.497591 (+ 982us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:40.497600 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:40.497602 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:40.497806 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:51:40.498274 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:51:40.498281 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:51:40.498283 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:51:40.498762 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:51:40.499106 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0811 18:51:40.499523 (+ 417us) server_negotiation.cc:299] Negotiation successful
0811 18:51:40.499770 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 18:51:40.501052 22539 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:51:40.592933 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 22298
I20260811 18:51:40.620235 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 21658
I20260811 18:51:40.621570 21775 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:51:40.738735 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 21658
I20260811 18:52:00.772372 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:43223
--webserver_interface=127.25.25.62
--webserver_port=44913
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:39481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:43223
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:01.155669 22635 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:01.156028 22635 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:01.156184 22635 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:01.163749 22635 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 18:52:01.163887 22635 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 18:52:01.163925 22635 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 18:52:01.163970 22635 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:52:01.164026 22635 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:01.164113 22635 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:01.164158 22635 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:52:01.164237 22635 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:52:01.174837 22635 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:39481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:43223
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:43223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=44913
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:01.176316 22635 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:01.177847 22635 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:01.190080 22645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:01.190003 22648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:01.190042 22646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:01.190855 22635 server_base.cc:1034] running on GCE node
I20260811 18:52:01.191789 22635 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:01.193378 22635 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:01.194665 22635 hybrid_clock.cc:648] HybridClock initialized: now 1786474321194584 us; error 48 us; skew 500 ppm
I20260811 18:52:01.195109 22635 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:52:01 dist-test-slave-lgr5 krb5kdc[20700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474321, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:01.202091 22635 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:52:01.204190 22635 webserver.cc:460] Webserver started at http://127.25.25.62:44913/ using document root <none> and password file <none>
I20260811 18:52:01.204990 22635 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:01.205096 22635 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:01.211226 22635 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 18:52:01.215992 22661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:01.217789 22635 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260811 18:52:01.218031 22635 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "426a58507c7c40caaf404880a5e07040"
format_stamp: "Formatted at 2026-08-11 18:51:14 on dist-test-slave-lgr5"
server_key: "dfa04aa47fbaf162f674d46eac4e310d"
server_key_iv: "1482c5b99c007af69de29558f7725bac"
server_key_version: "encryptionkey@0"
I20260811 18:52:01.219174 22635 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:01.234822 22635 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:01.240360 22635 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:01.240710 22635 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:01.260207 22635 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:43223
I20260811 18:52:01.260239 22749 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:43223 every 8 connection(s)
I20260811 18:52:01.262156 22635 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:52:01.269253 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 22635
I20260811 18:52:01.270207 22752 sys_catalog.cc:263] Verifying existing consensus state
I20260811 18:52:01.270362 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:33565
--local_ip_for_outbound_sockets=127.25.25.1
--tserver_master_addrs=127.25.25.62:43223
--webserver_port=46449
--webserver_interface=127.25.25.1
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:39481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:52:01.274996 22752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040: Bootstrap starting.
I20260811 18:52:01.299929 22752 log.cc:824] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:01.317843 22752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:52:01.318445 22752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040: Bootstrap complete.
I20260811 18:52:01.328275 22752 raft_consensus.cc:348] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426a58507c7c40caaf404880a5e07040" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43223 } }
I20260811 18:52:01.329288 22752 raft_consensus.cc:729] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 426a58507c7c40caaf404880a5e07040, State: Initialized, Role: FOLLOWER
I20260811 18:52:01.329932 22752 consensus_queue.cc:260] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426a58507c7c40caaf404880a5e07040" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43223 } }
I20260811 18:52:01.330188 22752 raft_consensus.cc:388] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:52:01.330307 22752 raft_consensus.cc:482] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:52:01.330474 22752 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [term 2 FOLLOWER]: Advancing to term 3
I20260811 18:52:01.334779 22752 raft_consensus.cc:504] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426a58507c7c40caaf404880a5e07040" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43223 } }
I20260811 18:52:01.335422 22752 leader_election.cc:302] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 426a58507c7c40caaf404880a5e07040; no voters:
I20260811 18:52:01.336167 22752 leader_election.cc:288] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 18:52:01.336340 22761 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 18:52:01.337538 22761 raft_consensus.cc:686] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [term 3 LEADER]: Becoming Leader. State: Replica: 426a58507c7c40caaf404880a5e07040, State: Running, Role: LEADER
I20260811 18:52:01.338269 22761 consensus_queue.cc:237] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426a58507c7c40caaf404880a5e07040" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43223 } }
I20260811 18:52:01.338706 22752 sys_catalog.cc:564] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:52:01.341261 22764 sys_catalog.cc:455] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 426a58507c7c40caaf404880a5e07040. Latest consensus state: current_term: 3 leader_uuid: "426a58507c7c40caaf404880a5e07040" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426a58507c7c40caaf404880a5e07040" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43223 } } }
I20260811 18:52:01.341715 22764 sys_catalog.cc:458] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:01.341513 22763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "426a58507c7c40caaf404880a5e07040" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426a58507c7c40caaf404880a5e07040" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43223 } } }
I20260811 18:52:01.341882 22763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040 [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:01.353044 22773 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:52:01.364013 22773 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:52:01.366004 22773 catalog_manager.cc:1259] Loaded cluster ID: eefc3ddfe4ec4f26876d2b00edd5a421
I20260811 18:52:01.366206 22773 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:52:01.371132 22773 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:52:01.373278 22773 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040: Loaded TSK: 0
I20260811 18:52:01.373536 22773 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 426a58507c7c40caaf404880a5e07040: Loaded TSK: 1
F20260811 18:52:01.374895 22773 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7efdac1b69ad google::LogMessage::Fail() at ??:0
@ 0x7efdac1b988a google::LogMessage::SendToLog() at ??:0
@ 0x7efdac1b64de google::LogMessage::Flush() at ??:0
@ 0x7efdac1b7a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7efdaff1a7d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7efdaff0973e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7efdc1be51c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7efdc1be4783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7efdc1c702a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7efdc1c700c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7efdc1cba5e9 std::function<>::operator()() at ??:0
@ 0x7efdc1be8cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7efdc1be6c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7efdc1c6e610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7efdc1c6e439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7efdaee02345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7efdaee0591c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7efdaee05799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7efdaede0eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7efdb20ba6db start_thread at ??:0
@ 0x7efdab05061f clone at ??:0
W20260811 18:52:01.767797 22756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:01.768174 22756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:01.768301 22756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:01.775841 22756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:01.775990 22756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:01.776170 22756 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:52:01.787125 22756 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:39481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:33565
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=46449
--tserver_master_addrs=127.25.25.62:43223
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:01.788909 22756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:01.790443 22756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:01.805150 22851 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:01.805207 22855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:01.805313 22858 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:01.806110 22756 server_base.cc:1034] running on GCE node
I20260811 18:52:01.806881 22756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:01.808060 22756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:01.809453 22756 hybrid_clock.cc:648] HybridClock initialized: now 1786474321809372 us; error 74 us; skew 500 ppm
I20260811 18:52:01.809844 22756 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:52:01 dist-test-slave-lgr5 krb5kdc[20700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474321, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:01.813515 22756 init.cc:377] Logged in from keytab as kudu/127.25.25.1@KRBTEST.COM (short username kudu)
I20260811 18:52:01.815276 22756 webserver.cc:460] Webserver started at http://127.25.25.1:46449/ using document root <none> and password file <none>
I20260811 18:52:01.816066 22756 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:01.816277 22756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:01.822505 22756 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260811 18:52:01.825879 22865 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:01.827579 22756 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 18:52:01.827781 22756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "2847cd691e2945cd83691bf2dd76bbc6"
format_stamp: "Formatted at 2026-08-11 18:51:15 on dist-test-slave-lgr5"
server_key: "b8c98aa9f96308863d3c315952f6b14c"
server_key_iv: "0e53f024d1acd674a9ec258bb5a2ed78"
server_key_version: "encryptionkey@0"
I20260811 18:52:01.828953 22756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:01.848412 22756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:01.853255 22756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:01.853559 22756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:01.854687 22756 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:01.856280 22756 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:01.856432 22756 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:01.856570 22756 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:01.856650 22756 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:01.890533 22756 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:33565
I20260811 18:52:01.890599 23077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:33565 every 8 connection(s)
I20260811 18:52:01.892212 22756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:52:01.895368 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 22756
I20260811 18:52:01.896238 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:40373
--local_ip_for_outbound_sockets=127.25.25.2
--tserver_master_addrs=127.25.25.62:43223
--webserver_port=39371
--webserver_interface=127.25.25.2
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:39481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:52:01.898248 23088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:01.895784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.1:43245)
0811 18:52:01.896877 (+ 1093us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:01.897169 (+ 292us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":761,"thread_start_us":437,"threads_started":1}
W20260811 18:52:01.899156 23082 heartbeater.cc:644] Failed to heartbeat to 127.25.25.62:43223 (0 consecutive failures): Network error: Failed to ping master at 127.25.25.62:43223: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
I20260811 18:52:01.900339 23088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:01.899845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.1:53807)
0811 18:52:01.900107 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:01.900199 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
I20260811 18:52:01.901490 23088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:01.901067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.1:53915)
0811 18:52:01.901233 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:01.901318 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260811 18:52:01.901764 23082 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 18:52:02.271875 23089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:02.272284 23089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:02.272403 23089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:02.280125 23089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:02.280277 23089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:02.280402 23089 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:52:02.290758 23089 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:39481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:40373
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=39371
--tserver_master_addrs=127.25.25.62:43223
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:02.292187 23089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:02.293694 23089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:02.307984 23098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:02.308156 23096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:02.308192 23101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:02.308744 23089 server_base.cc:1034] running on GCE node
I20260811 18:52:02.309625 23089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:02.310747 23089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:02.312016 23089 hybrid_clock.cc:648] HybridClock initialized: now 1786474322311956 us; error 42 us; skew 500 ppm
I20260811 18:52:02.312466 23089 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:52:02 dist-test-slave-lgr5 krb5kdc[20700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474322, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:02.316164 23089 init.cc:377] Logged in from keytab as kudu/127.25.25.2@KRBTEST.COM (short username kudu)
I20260811 18:52:02.317970 23089 webserver.cc:460] Webserver started at http://127.25.25.2:39371/ using document root <none> and password file <none>
I20260811 18:52:02.318763 23089 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:02.318907 23089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:02.325145 23089 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 18:52:02.328274 23114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:02.329867 23089 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 18:52:02.330081 23089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "9c47b8ca998d45dc81fdca86bc19ca80"
format_stamp: "Formatted at 2026-08-11 18:51:15 on dist-test-slave-lgr5"
server_key: "fb2924d77489640e4a8c5ed61dfc445b"
server_key_iv: "634f694904db72213ea222a45f4f41c9"
server_key_version: "encryptionkey@0"
I20260811 18:52:02.331168 23089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:02.348472 23089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:02.353771 23089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:02.354113 23089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:02.355351 23089 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:02.356966 23089 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:02.357074 23089 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:02.357188 23089 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:02.357263 23089 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:02.390534 23089 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:40373
I20260811 18:52:02.390610 23353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:40373 every 8 connection(s)
I20260811 18:52:02.392133 23089 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:52:02.397176 23356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:02.395207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.2:44329)
0811 18:52:02.395952 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:02.396219 (+ 267us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":272,"threads_started":1}
W20260811 18:52:02.397936 23354 heartbeater.cc:644] Failed to heartbeat to 127.25.25.62:43223 (0 consecutive failures): Network error: Failed to ping master at 127.25.25.62:43223: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
I20260811 18:52:02.398942 23356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:02.398549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.2:59705)
0811 18:52:02.398724 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:02.398802 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 18:52:02.399857 23356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:02.399497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.2:47421)
0811 18:52:02.399630 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:02.399710 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 18:52:02.400172 23354 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 18:52:02.401156 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 23089
I20260811 18:52:02.401784 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:35735
--local_ip_for_outbound_sockets=127.25.25.3
--tserver_master_addrs=127.25.25.62:43223
--webserver_port=45009
--webserver_interface=127.25.25.3
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:39481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:02.777689 23357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:02.778002 23357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:02.778137 23357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:02.785892 23357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:02.786034 23357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:02.786203 23357 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:52:02.796639 23357 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:39481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:35735
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=45009
--tserver_master_addrs=127.25.25.62:43223
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:02.798103 23357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:02.799530 23357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:02.814785 23364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:02.814725 23372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:02.814759 23367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:02.815186 23357 server_base.cc:1034] running on GCE node
I20260811 18:52:02.816215 23357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:02.817301 23357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:02.818547 23357 hybrid_clock.cc:648] HybridClock initialized: now 1786474322818475 us; error 65 us; skew 500 ppm
I20260811 18:52:02.818933 23357 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:52:02 dist-test-slave-lgr5 krb5kdc[20700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474322, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:02.822839 23357 init.cc:377] Logged in from keytab as kudu/127.25.25.3@KRBTEST.COM (short username kudu)
I20260811 18:52:02.824680 23357 webserver.cc:460] Webserver started at http://127.25.25.3:45009/ using document root <none> and password file <none>
I20260811 18:52:02.825485 23357 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:02.825618 23357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:02.832212 23357 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 18:52:02.835608 23384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:02.837301 23357 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 18:52:02.837514 23357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "24cc1175c4774e1592f062cfd0dbbc95"
format_stamp: "Formatted at 2026-08-11 18:51:16 on dist-test-slave-lgr5"
server_key: "1b32b9b541032a17797fb87824afb841"
server_key_iv: "b96fd36efad32d9a5b18c79b9e8292c6"
server_key_version: "encryptionkey@0"
I20260811 18:52:02.838624 23357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:02.855160 23357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:02.859421 23357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:02.859700 23357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:02.860800 23357 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:02.862221 23357 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:02.862320 23357 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:02.862438 23357 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:02.862510 23357 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:02.897089 23357 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:35735
I20260811 18:52:02.897159 23601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:35735 every 8 connection(s)
I20260811 18:52:02.898541 23357 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:52:02.903707 23606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:02.902409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.1:42125)
0811 18:52:02.903284 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:02.903417 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":738,"thread_start_us":606,"threads_started":1}
I20260811 18:52:02.904137 23605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:02.901678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.3:34555)
0811 18:52:02.902480 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:02.902764 (+ 284us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":310,"threads_started":1}
W20260811 18:52:02.904976 23602 heartbeater.cc:644] Failed to heartbeat to 127.25.25.62:43223 (0 consecutive failures): Network error: Failed to ping master at 127.25.25.62:43223: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
I20260811 18:52:02.905395 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 23357
I20260811 18:52:02.905911 23605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:02.905501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.3:45579)
0811 18:52:02.905677 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:02.905767 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 18:52:02.906888 23605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:02.906458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.3:48755)
0811 18:52:02.906634 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:02.906737 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260811 18:52:02.907171 23602 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 18:52:03.401716 23614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:03.400855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.2:56027)
0811 18:52:03.401361 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:03.401478 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":241,"threads_started":1}
I20260811 18:52:03.905797 23615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:03.904826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.1:44449)
0811 18:52:03.905499 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:03.905604 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":322,"threads_started":1}
I20260811 18:52:03.908823 23616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:03.907871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.3:36581)
0811 18:52:03.908457 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:03.908574 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":308,"threads_started":1}
I20260811 18:52:04.403513 23617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:04.402649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.2:56579)
0811 18:52:04.403209 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:04.403300 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":272,"threads_started":1}
I20260811 18:52:04.907886 23619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:04.906988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.1:50221)
0811 18:52:04.907575 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:04.907687 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":293,"threads_started":1}
I20260811 18:52:04.910655 23620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:04.909828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.3:46801)
0811 18:52:04.910380 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:04.910479 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":302,"threads_started":1}
I20260811 18:52:05.405409 23621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:05.404584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.2:52459)
0811 18:52:05.405121 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:05.405220 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":277,"threads_started":1}
I20260811 18:52:05.909758 23622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:05.908937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.1:35769)
0811 18:52:05.909490 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:05.909582 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":260,"threads_started":1}
I20260811 18:52:05.912432 23624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:05.911627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.3:38233)
0811 18:52:05.912073 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:05.912203 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":227,"threads_started":1}
I20260811 18:52:06.407608 23625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:06.406740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.2:42333)
0811 18:52:06.407258 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:06.407372 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":266,"threads_started":1}
I20260811 18:52:06.911849 23627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:06.910993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.1:35575)
0811 18:52:06.911538 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:06.911644 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":297,"threads_started":1}
I20260811 18:52:06.914247 23629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:06.913453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.3:46135)
0811 18:52:06.913950 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:06.914039 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":255,"threads_started":1}
I20260811 18:52:07.409674 23633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:07.408788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.2:57945)
0811 18:52:07.409393 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:07.409489 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":302,"threads_started":1}
I20260811 18:52:07.913627 23641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:07.912809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.1:33759)
0811 18:52:07.913345 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:07.913448 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":258,"threads_started":1}
I20260811 18:52:07.916046 23642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:07.915205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.3:40795)
0811 18:52:07.915774 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:07.915864 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":308,"threads_started":1}
I20260811 18:52:08.411625 23644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:08.410774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.2:60711)
0811 18:52:08.411332 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:08.411445 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":303,"threads_started":1}
I20260811 18:52:08.915642 23645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:08.914722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.1:59979)
0811 18:52:08.915316 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:08.915413 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":266,"threads_started":1}
I20260811 18:52:08.917871 23647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:08.917049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.3:42523)
0811 18:52:08.917575 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:08.917691 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":245,"threads_started":1}
I20260811 18:52:09.413797 23650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:09.412818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.2:50225)
0811 18:52:09.413444 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:09.413535 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":266,"threads_started":1}
I20260811 18:52:09.917701 23651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:09.916810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.1:46375)
0811 18:52:09.917421 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:09.917516 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":336,"threads_started":1}
I20260811 18:52:09.919597 23654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:09.918754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.3:34389)
0811 18:52:09.919255 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:09.919338 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":219,"threads_started":1}
I20260811 18:52:10.415791 23655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:10.414877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.2:54009)
0811 18:52:10.415493 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:10.415589 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":323,"threads_started":1}
I20260811 18:52:10.919548 23656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:10.918750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.1:58675)
0811 18:52:10.919238 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:10.919332 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":226,"threads_started":1}
I20260811 18:52:10.921170 23657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:10.920482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.3:51237)
0811 18:52:10.920916 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:10.921003 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":219,"threads_started":1}
I20260811 18:52:11.417740 23658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:11.416896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.2:33587)
0811 18:52:11.417445 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:11.417544 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":253,"threads_started":1}
I20260811 18:52:11.921561 23660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:11.920780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.1:39477)
0811 18:52:11.921279 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:11.921367 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":264,"threads_started":1}
I20260811 18:52:11.922808 23662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:11.922068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.3:46345)
0811 18:52:11.922558 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:11.922642 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":216,"threads_started":1}
I20260811 18:52:12.420001 23664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:12.418974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.2:55793)
0811 18:52:12.419663 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:12.419807 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":367,"threads_started":1}
I20260811 18:52:12.923543 23665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:12.922649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.1:42623)
0811 18:52:12.923210 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:12.923318 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":283,"threads_started":1}
I20260811 18:52:12.924623 23668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:12.923839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.3:38621)
0811 18:52:12.924366 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:12.924460 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":304,"threads_started":1}
I20260811 18:52:13.422017 23669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:13.421142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.2:43161)
0811 18:52:13.421693 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:13.421811 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":290,"threads_started":1}
I20260811 18:52:13.925772 23671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:13.924796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.1:60299)
0811 18:52:13.925522 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:13.925606 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":336,"threads_started":1}
I20260811 18:52:13.926345 23672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:13.925556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.3:35033)
0811 18:52:13.926039 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:13.926157 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":251,"threads_started":1}
I20260811 18:52:14.424860 23677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:14.423563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.2:53451)
0811 18:52:14.424343 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:14.424528 (+ 185us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":346,"threads_started":1}
I20260811 18:52:14.929068 23682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:14.927758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.3:50009)
0811 18:52:14.928640 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:14.928789 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":707,"thread_start_us":497,"threads_started":1}
I20260811 18:52:14.929076 23681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:14.927394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.1:50759)
0811 18:52:14.928473 (+ 1079us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:14.928679 (+ 206us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":803,"thread_start_us":434,"threads_started":1}
I20260811 18:52:15.427691 23684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:15.426458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.2:48081)
0811 18:52:15.427134 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:15.427353 (+ 219us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":321,"threads_started":1}
I20260811 18:52:15.931180 23690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:15.930381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.1:44165)
0811 18:52:15.930895 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:15.930990 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":258,"threads_started":1}
I20260811 18:52:15.931289 23692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:15.930471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.3:58855)
0811 18:52:15.930994 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:15.931096 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":267,"threads_started":1}
I20260811 18:52:16.429747 23695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:16.428944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.2:60975)
0811 18:52:16.429442 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:16.429538 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":231,"threads_started":1}
I20260811 18:52:16.933343 23698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:16.932410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.3:56423)
0811 18:52:16.932951 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:16.933089 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"threads_started":1}
I20260811 18:52:16.937399 23699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:16.936459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.1:47281)
0811 18:52:16.936998 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:16.937129 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":682,"threads_started":1}
I20260811 18:52:17.431943 23702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:17.431111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.2:49853)
0811 18:52:17.431626 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:17.431741 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":259,"threads_started":1}
I20260811 18:52:17.916096 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 22756
I20260811 18:52:17.937052 23703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:17.917727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55884 (local address 127.25.25.1:33565)
0811 18:52:17.918316 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:17.918331 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:17.918373 (+ 42us) server_negotiation.cc:407] Connection header received
0811 18:52:17.919978 (+ 1605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:17.919991 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:17.920558 (+ 567us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:17.920948 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:17.922690 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:17.924025 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:17.925466 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:17.926253 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:17.926455 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:17.929590 (+ 3135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:17.929601 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:17.929621 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:17.929679 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:17.933057 (+ 3378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:17.934047 (+ 990us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:17.934056 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:17.934063 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:17.934280 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:17.934717 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:17.934721 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:17.934724 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:17.935386 (+ 662us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:17.935745 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:17.936273 (+ 528us) server_negotiation.cc:299] Negotiation successful
0811 18:52:17.936736 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":235,"threads_started":1}
I20260811 18:52:17.938905 23072 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:17.938980 23707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:17.938053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.3:53325)
0811 18:52:17.938610 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:17.938744 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":255,"threads_started":1}
I20260811 18:52:18.030900 23709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:17.940231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43223 (local address 127.25.25.1:47871)
0811 18:52:18.030293 (+ 90062us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:18.030512 (+ 219us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.62:43223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89911,"thread_start_us":89721,"threads_started":1}
I20260811 18:52:18.031261 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 22756
I20260811 18:52:18.059991 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 23089
I20260811 18:52:18.080953 23712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:18.061120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58666 (local address 127.25.25.2:40373)
0811 18:52:18.061763 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:18.061780 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:18.061821 (+ 41us) server_negotiation.cc:407] Connection header received
0811 18:52:18.063587 (+ 1766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:18.063598 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:18.064221 (+ 623us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:18.064621 (+ 400us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:18.066098 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:18.067528 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:18.069135 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:18.070046 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:18.070236 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:18.073501 (+ 3265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:18.073512 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:18.073533 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:18.073588 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:18.077063 (+ 3475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:18.077980 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:18.077990 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:18.077999 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:18.078226 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:18.078688 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:18.078692 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:18.078695 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:18.079414 (+ 719us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:18.079679 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:18.080173 (+ 494us) server_negotiation.cc:299] Negotiation successful
0811 18:52:18.080636 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":323,"threads_started":1}
I20260811 18:52:18.082542 23341 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:18.168965 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 23089
I20260811 18:52:18.194743 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 23357
I20260811 18:52:18.215086 23716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:18.195984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45390 (local address 127.25.25.3:35735)
0811 18:52:18.196720 (+ 736us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:18.196735 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:18.196780 (+ 45us) server_negotiation.cc:407] Connection header received
0811 18:52:18.198464 (+ 1684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:18.198479 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:18.198953 (+ 474us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:18.199335 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:18.201119 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:18.202417 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:18.203793 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:18.204587 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:18.204792 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:18.207720 (+ 2928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:18.207731 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:18.207749 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:18.207808 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:18.211118 (+ 3310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:18.212036 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:18.212045 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:18.212053 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:18.212324 (+ 271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:18.212766 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:18.212770 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:18.212772 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:18.213400 (+ 628us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:18.213732 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:18.214276 (+ 544us) server_negotiation.cc:299] Negotiation successful
0811 18:52:18.214744 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":570,"thread_start_us":384,"threads_started":1}
I20260811 18:52:18.216804 23597 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:18.303639 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 23357
2026-08-11T18:52:18Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (65882 ms)
[----------] 30 tests from SecurityITest (325544 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:52:18 dist-test-slave-lgr5 krb5kdc[23723](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:52:18 dist-test-slave-lgr5 krb5kdc[23723](info): set up 2 sockets
Aug 11 18:52:18 dist-test-slave-lgr5 krb5kdc[23723](info): commencing operation
krb5kdc: starting...
W20260811 18:52:19.662079 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.304s user 0.001s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:52:19 dist-test-slave-lgr5 krb5kdc[23723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:52:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:52:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:52:20.009373 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:41445
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:33023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:41445
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:20.388305 23748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:20.389016 23748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:20.389192 23748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:20.397338 23748 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:52:20.397495 23748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:20.397552 23748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:20.397640 23748 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:52:20.397693 23748 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:52:20.408432 23748 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:33023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:41445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:41445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:20.409966 23748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:20.411451 23748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:20.425000 23769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:20.425136 23766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:20.425150 23774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:20.425753 23748 server_base.cc:1034] running on GCE node
I20260811 18:52:20.426594 23748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:20.428282 23748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:20.429523 23748 hybrid_clock.cc:648] HybridClock initialized: now 1786474340429442 us; error 68 us; skew 500 ppm
I20260811 18:52:20.429893 23748 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:52:20 dist-test-slave-lgr5 krb5kdc[23723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474340, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:20.433427 23748 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:52:20.435264 23748 webserver.cc:460] Webserver started at http://127.25.25.62:46831/ using document root <none> and password file <none>
I20260811 18:52:20.436069 23748 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:20.436256 23748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:20.436597 23748 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:20.440248 23748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "813a2e8b9aca4775889a6d336621d252"
format_stamp: "Formatted at 2026-08-11 18:52:20 on dist-test-slave-lgr5"
server_key: "f5950beeeb2e89c725f0e8dbab5846e9"
server_key_iv: "afa1c28411e5af578c344b85c6224e63"
server_key_version: "encryptionkey@0"
I20260811 18:52:20.441215 23748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "813a2e8b9aca4775889a6d336621d252"
format_stamp: "Formatted at 2026-08-11 18:52:20 on dist-test-slave-lgr5"
server_key: "f5950beeeb2e89c725f0e8dbab5846e9"
server_key_iv: "afa1c28411e5af578c344b85c6224e63"
server_key_version: "encryptionkey@0"
I20260811 18:52:20.447634 23748 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260811 18:52:20.451944 23792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:20.453629 23748 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:52:20.453830 23748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "813a2e8b9aca4775889a6d336621d252"
format_stamp: "Formatted at 2026-08-11 18:52:20 on dist-test-slave-lgr5"
server_key: "f5950beeeb2e89c725f0e8dbab5846e9"
server_key_iv: "afa1c28411e5af578c344b85c6224e63"
server_key_version: "encryptionkey@0"
I20260811 18:52:20.454077 23748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:20.471513 23748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:20.476617 23748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:20.476975 23748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:20.496836 23748 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:41445
I20260811 18:52:20.496882 23878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:41445 every 8 connection(s)
I20260811 18:52:20.498334 23748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:52:20.502486 23881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:20.504060 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 23748
I20260811 18:52:20.504360 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:52:20.505219 25700 external_mini_cluster.cc:1428] Setting key dfbf21c4c104a3ed0fdac2f181726cc3
I20260811 18:52:20.519258 23881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 813a2e8b9aca4775889a6d336621d252: Bootstrap starting.
Aug 11 18:52:20 dist-test-slave-lgr5 krb5kdc[23723](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:52:20.523682 23881 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 813a2e8b9aca4775889a6d336621d252: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:20.525070 23881 log.cc:824] T 00000000000000000000000000000000 P 813a2e8b9aca4775889a6d336621d252: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:20.529000 23881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 813a2e8b9aca4775889a6d336621d252: No bootstrap required, opened a new log
I20260811 18:52:20.532414 23888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:20.507636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50004 (local address 127.25.25.62:41445)
0811 18:52:20.508566 (+ 930us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:20.508582 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:20.508628 (+ 46us) server_negotiation.cc:407] Connection header received
0811 18:52:20.510424 (+ 1796us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:20.510457 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:20.510989 (+ 532us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:20.511399 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:20.513485 (+ 2086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:20.514940 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:20.517150 (+ 2210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:20.518035 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:20.518218 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:20.523604 (+ 5386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:20.523616 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:20.523635 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:20.523693 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:20.527485 (+ 3792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:20.528600 (+ 1115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:20.528608 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:20.528615 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:20.528813 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:20.529282 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:20.529286 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:20.529288 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:20.529901 (+ 613us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:20.530166 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:20.530712 (+ 546us) server_negotiation.cc:299] Negotiation successful
0811 18:52:20.531210 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":690,"thread_start_us":432,"threads_started":1}
I20260811 18:52:20.538335 23881 raft_consensus.cc:348] T 00000000000000000000000000000000 P 813a2e8b9aca4775889a6d336621d252 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813a2e8b9aca4775889a6d336621d252" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41445 } }
I20260811 18:52:20.538793 23881 raft_consensus.cc:374] T 00000000000000000000000000000000 P 813a2e8b9aca4775889a6d336621d252 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:20.538889 23881 raft_consensus.cc:729] T 00000000000000000000000000000000 P 813a2e8b9aca4775889a6d336621d252 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 813a2e8b9aca4775889a6d336621d252, State: Initialized, Role: FOLLOWER
I20260811 18:52:20.539568 23881 consensus_queue.cc:260] T 00000000000000000000000000000000 P 813a2e8b9aca4775889a6d336621d252 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813a2e8b9aca4775889a6d336621d252" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41445 } }
I20260811 18:52:20.539835 23881 raft_consensus.cc:388] T 00000000000000000000000000000000 P 813a2e8b9aca4775889a6d336621d252 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:52:20.539970 23881 raft_consensus.cc:482] T 00000000000000000000000000000000 P 813a2e8b9aca4775889a6d336621d252 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:52:20.540158 23881 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 813a2e8b9aca4775889a6d336621d252 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:20.542498 23881 raft_consensus.cc:504] T 00000000000000000000000000000000 P 813a2e8b9aca4775889a6d336621d252 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813a2e8b9aca4775889a6d336621d252" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41445 } }
I20260811 18:52:20.543161 23881 leader_election.cc:302] T 00000000000000000000000000000000 P 813a2e8b9aca4775889a6d336621d252 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 813a2e8b9aca4775889a6d336621d252; no voters:
I20260811 18:52:20.543886 23881 leader_election.cc:288] T 00000000000000000000000000000000 P 813a2e8b9aca4775889a6d336621d252 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:52:20.544029 23890 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 813a2e8b9aca4775889a6d336621d252 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:20.544766 23890 raft_consensus.cc:686] T 00000000000000000000000000000000 P 813a2e8b9aca4775889a6d336621d252 [term 1 LEADER]: Becoming Leader. State: Replica: 813a2e8b9aca4775889a6d336621d252, State: Running, Role: LEADER
I20260811 18:52:20.545369 23890 consensus_queue.cc:237] T 00000000000000000000000000000000 P 813a2e8b9aca4775889a6d336621d252 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813a2e8b9aca4775889a6d336621d252" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41445 } }
I20260811 18:52:20.546136 23881 sys_catalog.cc:564] T 00000000000000000000000000000000 P 813a2e8b9aca4775889a6d336621d252 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:52:20.548244 23893 sys_catalog.cc:455] T 00000000000000000000000000000000 P 813a2e8b9aca4775889a6d336621d252 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "813a2e8b9aca4775889a6d336621d252" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813a2e8b9aca4775889a6d336621d252" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41445 } } }
I20260811 18:52:20.548800 23893 sys_catalog.cc:458] T 00000000000000000000000000000000 P 813a2e8b9aca4775889a6d336621d252 [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:20.549283 23895 sys_catalog.cc:455] T 00000000000000000000000000000000 P 813a2e8b9aca4775889a6d336621d252 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 813a2e8b9aca4775889a6d336621d252. Latest consensus state: current_term: 1 leader_uuid: "813a2e8b9aca4775889a6d336621d252" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813a2e8b9aca4775889a6d336621d252" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41445 } } }
I20260811 18:52:20.549712 23895 sys_catalog.cc:458] T 00000000000000000000000000000000 P 813a2e8b9aca4775889a6d336621d252 [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:20.551271 23908 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:52:20.556376 23908 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:52:20.566519 23908 catalog_manager.cc:1347] Generated new cluster ID: 91ba1621bb6646d5adac849940c5d3c8
I20260811 18:52:20.566672 23908 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:52:20.615862 23908 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:52:20.617328 23908 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:52:20.634085 23908 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 813a2e8b9aca4775889a6d336621d252: Generated new TSK 0
I20260811 18:52:20.635409 23908 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.25.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
I20260811 18:52:20.720396 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:0
--local_ip_for_outbound_sockets=127.25.25.1
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:41445
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:33023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:21.105053 23928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:21.105345 23928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:21.105484 23928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:21.112859 23928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:21.112993 23928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:21.113147 23928 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:52:21.123333 23928 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:33023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:41445
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:21.124778 23928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:21.126312 23928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:21.140483 23940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:21.140441 23948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:21.140409 23941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:21.141391 23928 server_base.cc:1034] running on GCE node
I20260811 18:52:21.142122 23928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:21.143167 23928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:21.144424 23928 hybrid_clock.cc:648] HybridClock initialized: now 1786474341144343 us; error 69 us; skew 500 ppm
I20260811 18:52:21.144814 23928 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:52:21 dist-test-slave-lgr5 krb5kdc[23723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474341, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:21.148433 23928 init.cc:377] Logged in from keytab as kudu/127.25.25.1@KRBTEST.COM (short username kudu)
I20260811 18:52:21.150180 23928 webserver.cc:460] Webserver started at http://127.25.25.1:45603/ using document root <none> and password file <none>
I20260811 18:52:21.150960 23928 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:21.151096 23928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:21.151440 23928 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:21.154913 23928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-0/data/instance:
uuid: "15eedbc01b4d4e7189b5abd46ef980ba"
format_stamp: "Formatted at 2026-08-11 18:52:21 on dist-test-slave-lgr5"
server_key: "4ca4d9155157d0da3221e42d0d25642a"
server_key_iv: "1596e6d915430216f0e5a85f2b744992"
server_key_version: "encryptionkey@0"
I20260811 18:52:21.155881 23928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance:
uuid: "15eedbc01b4d4e7189b5abd46ef980ba"
format_stamp: "Formatted at 2026-08-11 18:52:21 on dist-test-slave-lgr5"
server_key: "4ca4d9155157d0da3221e42d0d25642a"
server_key_iv: "1596e6d915430216f0e5a85f2b744992"
server_key_version: "encryptionkey@0"
I20260811 18:52:21.162333 23928 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 18:52:21.166618 23960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:21.168424 23928 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 18:52:21.168635 23928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "15eedbc01b4d4e7189b5abd46ef980ba"
format_stamp: "Formatted at 2026-08-11 18:52:21 on dist-test-slave-lgr5"
server_key: "4ca4d9155157d0da3221e42d0d25642a"
server_key_iv: "1596e6d915430216f0e5a85f2b744992"
server_key_version: "encryptionkey@0"
I20260811 18:52:21.168874 23928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:21.195611 23928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:21.200453 23928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:21.200773 23928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:21.201882 23928 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:21.203477 23928 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:21.203572 23928 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:21.203703 23928 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:21.203759 23928 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:21.235872 23928 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:45057
I20260811 18:52:21.235926 24155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:45057 every 8 connection(s)
I20260811 18:52:21.237314 23928 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:52:21.247642 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 23928
I20260811 18:52:21.247869 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance
I20260811 18:52:21.248615 25700 external_mini_cluster.cc:1428] Setting key 668ef33f7b7dfaf0180bce07270f4e00
Aug 11 18:52:21 dist-test-slave-lgr5 krb5kdc[23723](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474341, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:52:21.262571 24159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:21.240313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:41649 (local address 127.25.25.62:41445)
0811 18:52:21.240818 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:21.240822 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:21.242014 (+ 1192us) server_negotiation.cc:407] Connection header received
0811 18:52:21.244109 (+ 2095us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:21.244116 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:21.244202 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:21.244307 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:21.246123 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:21.246933 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:21.249323 (+ 2390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:21.249814 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:21.249937 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:21.255123 (+ 5186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:21.255130 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:21.255134 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:21.255183 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:21.258388 (+ 3205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:21.259763 (+ 1375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:21.259768 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:21.259771 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:21.259950 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:21.260527 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:21.260532 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:21.260534 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:21.260865 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:21.261030 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:21.261902 (+ 872us) server_negotiation.cc:299] Negotiation successful
0811 18:52:21.262199 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":261,"threads_started":1}
I20260811 18:52:21.263672 24160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:21.240958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:41445 (local address 127.25.25.1:41649)
0811 18:52:21.241787 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:21.241845 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:21.243716 (+ 1871us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:21.244569 (+ 853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:21.244578 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:21.245193 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:21.245897 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:21.245922 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:21.247139 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:21.247144 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:21.249106 (+ 1962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:21.249132 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:21.250130 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:21.250138 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:21.250588 (+ 450us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:21.251589 (+ 1001us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:21.251628 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:21.254749 (+ 3121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:21.258734 (+ 3985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:21.258744 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:21.258762 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:21.259588 (+ 826us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:21.260115 (+ 527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:21.260121 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:21.260126 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:21.260381 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:21.261033 (+ 652us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:21.261043 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:21.261462 (+ 419us) client_negotiation.cc:769] Sending connection context
0811 18:52:21.261737 (+ 275us) client_negotiation.cc:240] Negotiation successful
0811 18:52:21.262364 (+ 627us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":314,"threads_started":1}
I20260811 18:52:21.265498 24156 heartbeater.cc:347] Connected to a master server at 127.25.25.62:41445
I20260811 18:52:21.265844 24156 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:21.266881 24156 heartbeater.cc:511] Master 127.25.25.62:41445 requested a full tablet report, sending...
I20260811 18:52:21.269766 23822 ts_manager.cc:194] Registered new tserver with Master: 15eedbc01b4d4e7189b5abd46ef980ba (127.25.25.1:45057)
I20260811 18:52:21.271399 23822 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.1@KRBTEST.COM'} at 127.25.25.1:41649
WARNING: no policy specified for kudu/127.25.25.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
I20260811 18:52:21.328693 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:0
--local_ip_for_outbound_sockets=127.25.25.2
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:41445
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:33023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:21.710543 24165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:21.710886 24165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:21.710987 24165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:21.718771 24165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:21.718924 24165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:21.719044 24165 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:52:21.729923 24165 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:33023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:41445
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:21.731372 24165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:21.732863 24165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:21.749274 24170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:21.749320 24171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:21.749233 24174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:21.750190 24165 server_base.cc:1034] running on GCE node
I20260811 18:52:21.750964 24165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:21.752117 24165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:21.753440 24165 hybrid_clock.cc:648] HybridClock initialized: now 1786474341753366 us; error 59 us; skew 500 ppm
I20260811 18:52:21.753863 24165 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:52:21 dist-test-slave-lgr5 krb5kdc[23723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474341, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:21.759124 24165 init.cc:377] Logged in from keytab as kudu/127.25.25.2@KRBTEST.COM (short username kudu)
I20260811 18:52:21.761422 24165 webserver.cc:460] Webserver started at http://127.25.25.2:38565/ using document root <none> and password file <none>
I20260811 18:52:21.762238 24165 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:21.762374 24165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:21.762710 24165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:21.766389 24165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-1/data/instance:
uuid: "b6f5f04b91cb42a7a2be0ada35a69c37"
format_stamp: "Formatted at 2026-08-11 18:52:21 on dist-test-slave-lgr5"
server_key: "7d4a489ce047ca18d9d72b15943182b6"
server_key_iv: "749bceaec3465772b9cbff368eb3502e"
server_key_version: "encryptionkey@0"
I20260811 18:52:21.767308 24165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance:
uuid: "b6f5f04b91cb42a7a2be0ada35a69c37"
format_stamp: "Formatted at 2026-08-11 18:52:21 on dist-test-slave-lgr5"
server_key: "7d4a489ce047ca18d9d72b15943182b6"
server_key_iv: "749bceaec3465772b9cbff368eb3502e"
server_key_version: "encryptionkey@0"
I20260811 18:52:21.774426 24165 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260811 18:52:21.778721 24188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:21.780397 24165 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:52:21.780594 24165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "b6f5f04b91cb42a7a2be0ada35a69c37"
format_stamp: "Formatted at 2026-08-11 18:52:21 on dist-test-slave-lgr5"
server_key: "7d4a489ce047ca18d9d72b15943182b6"
server_key_iv: "749bceaec3465772b9cbff368eb3502e"
server_key_version: "encryptionkey@0"
I20260811 18:52:21.780808 24165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:21.804677 24165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:21.809857 24165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:21.810232 24165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:21.811406 24165 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:21.813053 24165 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:21.813148 24165 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:21.813263 24165 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:21.813329 24165 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:21.849872 24165 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:41939
I20260811 18:52:21.850010 24378 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:41939 every 8 connection(s)
I20260811 18:52:21.851404 24165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:52:21.855427 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 24165
I20260811 18:52:21.855614 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance
I20260811 18:52:21.856202 25700 external_mini_cluster.cc:1428] Setting key 576062b6ca6de032f3fd013fbe1ba89c
Aug 11 18:52:21 dist-test-slave-lgr5 krb5kdc[23723](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474341, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:52:21.876233 24384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:21.854620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:36743 (local address 127.25.25.62:41445)
0811 18:52:21.855199 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:21.855207 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:21.857035 (+ 1828us) server_negotiation.cc:407] Connection header received
0811 18:52:21.859310 (+ 2275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:21.859316 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:21.859399 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:21.859511 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:21.861558 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:21.862520 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:21.864426 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:21.865050 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:21.865183 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:21.869326 (+ 4143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:21.869333 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:21.869338 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:21.869385 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:21.872651 (+ 3266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:21.873584 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:21.873589 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:21.873593 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:21.873724 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:21.874216 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:21.874222 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:21.874225 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:21.874627 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:21.874787 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:21.875534 (+ 747us) server_negotiation.cc:299] Negotiation successful
0811 18:52:21.875805 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":277,"threads_started":1}
I20260811 18:52:21.877122 24385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:21.855280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:41445 (local address 127.25.25.2:36743)
0811 18:52:21.856813 (+ 1533us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:21.856868 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:21.858977 (+ 2109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:21.859887 (+ 910us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:21.859898 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:21.860611 (+ 713us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:21.861323 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:21.861346 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:21.862741 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:21.862746 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:21.864238 (+ 1492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:21.864256 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:21.865335 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:21.865342 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:21.865591 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:21.866371 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:21.866395 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:21.869017 (+ 2622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:21.872839 (+ 3822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:21.872851 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:21.872869 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:21.873410 (+ 541us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:21.873846 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:21.873852 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:21.873856 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:21.874063 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:21.874759 (+ 696us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:21.874766 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:21.875143 (+ 377us) client_negotiation.cc:769] Sending connection context
0811 18:52:21.875388 (+ 245us) client_negotiation.cc:240] Negotiation successful
0811 18:52:21.875834 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1162,"thread_start_us":915,"threads_started":1}
I20260811 18:52:21.878732 24381 heartbeater.cc:347] Connected to a master server at 127.25.25.62:41445
I20260811 18:52:21.879122 24381 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:21.880055 24381 heartbeater.cc:511] Master 127.25.25.62:41445 requested a full tablet report, sending...
I20260811 18:52:21.881907 23822 ts_manager.cc:194] Registered new tserver with Master: b6f5f04b91cb42a7a2be0ada35a69c37 (127.25.25.2:41939)
I20260811 18:52:21.882771 23822 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.2@KRBTEST.COM'} at 127.25.25.2:36743
WARNING: no policy specified for kudu/127.25.25.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
I20260811 18:52:21.932934 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:0
--local_ip_for_outbound_sockets=127.25.25.3
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:41445
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:33023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:52:22.275429 24156 heartbeater.cc:503] Master 127.25.25.62:41445 was elected leader, sending a full tablet report...
W20260811 18:52:22.320919 24390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:22.321262 24390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:22.321373 24390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:22.329288 24390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:22.329444 24390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:22.329582 24390 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:52:22.340504 24390 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:33023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:41445
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:22.341934 24390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:22.343520 24390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:22.359572 24402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:22.359643 24396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:22.359620 24397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:22.360250 24390 server_base.cc:1034] running on GCE node
I20260811 18:52:22.361106 24390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:22.362308 24390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:22.363577 24390 hybrid_clock.cc:648] HybridClock initialized: now 1786474342363514 us; error 47 us; skew 500 ppm
I20260811 18:52:22.363994 24390 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:52:22 dist-test-slave-lgr5 krb5kdc[23723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474342, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:22.367475 24390 init.cc:377] Logged in from keytab as kudu/127.25.25.3@KRBTEST.COM (short username kudu)
I20260811 18:52:22.369243 24390 webserver.cc:460] Webserver started at http://127.25.25.3:33347/ using document root <none> and password file <none>
I20260811 18:52:22.370008 24390 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:22.370141 24390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:22.370483 24390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:22.374009 24390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-2/data/instance:
uuid: "79528e0b2892436ebd1bc24d3fffaed9"
format_stamp: "Formatted at 2026-08-11 18:52:22 on dist-test-slave-lgr5"
server_key: "e231808a3312fa508bed43900be9f843"
server_key_iv: "3cdcb1b118d7c6020838b7d7d30d2a6a"
server_key_version: "encryptionkey@0"
I20260811 18:52:22.374878 24390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance:
uuid: "79528e0b2892436ebd1bc24d3fffaed9"
format_stamp: "Formatted at 2026-08-11 18:52:22 on dist-test-slave-lgr5"
server_key: "e231808a3312fa508bed43900be9f843"
server_key_iv: "3cdcb1b118d7c6020838b7d7d30d2a6a"
server_key_version: "encryptionkey@0"
I20260811 18:52:22.380921 24390 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 18:52:22.385185 24412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:22.386749 24390 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260811 18:52:22.386950 24390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "79528e0b2892436ebd1bc24d3fffaed9"
format_stamp: "Formatted at 2026-08-11 18:52:22 on dist-test-slave-lgr5"
server_key: "e231808a3312fa508bed43900be9f843"
server_key_iv: "3cdcb1b118d7c6020838b7d7d30d2a6a"
server_key_version: "encryptionkey@0"
I20260811 18:52:22.387187 24390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:22.409356 24390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:22.413982 24390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:22.414346 24390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:22.415565 24390 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:22.417351 24390 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:22.417451 24390 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:22.417603 24390 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:22.417668 24390 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:22.453409 24390 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:44021
I20260811 18:52:22.453467 24624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:44021 every 8 connection(s)
I20260811 18:52:22.454964 24390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:52:22.459811 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 24390
I20260811 18:52:22.460037 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance
I20260811 18:52:22.460561 25700 external_mini_cluster.cc:1428] Setting key c81baaa01938d07aa1c769ba21c3d269
Aug 11 18:52:22 dist-test-slave-lgr5 krb5kdc[23723](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474342, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:52:22.478701 24629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:22.457759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:50323 (local address 127.25.25.62:41445)
0811 18:52:22.458236 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:22.458242 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:22.459481 (+ 1239us) server_negotiation.cc:407] Connection header received
0811 18:52:22.462085 (+ 2604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:22.462091 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:22.462187 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:22.462342 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:22.464441 (+ 2099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.465211 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.467037 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.467471 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.467585 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:22.471790 (+ 4205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:22.471796 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:22.471799 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:22.471848 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:22.474810 (+ 2962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:22.475852 (+ 1042us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:22.475856 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:22.475858 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:22.476001 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:22.476737 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:22.476743 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:22.476746 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:22.477091 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:22.477214 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:22.478105 (+ 891us) server_negotiation.cc:299] Negotiation successful
0811 18:52:22.478317 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":228,"threads_started":1}
I20260811 18:52:22.479851 24630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:22.458423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:41445 (local address 127.25.25.3:50323)
0811 18:52:22.459258 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:22.459325 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:22.461707 (+ 2382us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:22.462547 (+ 840us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:22.462556 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:22.463338 (+ 782us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:22.464264 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:22.464289 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.465365 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.465370 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:22.466849 (+ 1479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:22.466868 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.467722 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.467729 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:22.468203 (+ 474us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:22.468999 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:22.469033 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:22.471495 (+ 2462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:22.475015 (+ 3520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:22.475037 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:22.475058 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:22.475720 (+ 662us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:22.476161 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:22.476166 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:22.476169 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:22.476580 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:22.477242 (+ 662us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:22.477249 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:22.477648 (+ 399us) client_negotiation.cc:769] Sending connection context
0811 18:52:22.477936 (+ 288us) client_negotiation.cc:240] Negotiation successful
0811 18:52:22.478414 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":316,"threads_started":1}
I20260811 18:52:22.481721 24625 heartbeater.cc:347] Connected to a master server at 127.25.25.62:41445
I20260811 18:52:22.482064 24625 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:22.482928 24625 heartbeater.cc:511] Master 127.25.25.62:41445 requested a full tablet report, sending...
I20260811 18:52:22.484812 23822 ts_manager.cc:194] Registered new tserver with Master: 79528e0b2892436ebd1bc24d3fffaed9 (127.25.25.3:44021)
I20260811 18:52:22.485827 23822 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.3@KRBTEST.COM'} at 127.25.25.3:50323
I20260811 18:52:22.489959 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:52:22.510390 24629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:22.495021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50010 (local address 127.25.25.62:41445)
0811 18:52:22.495212 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:22.495217 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:22.495565 (+ 348us) server_negotiation.cc:407] Connection header received
0811 18:52:22.495746 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:22.495751 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:22.495863 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:22.495964 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:22.497836 (+ 1872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.498625 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.500159 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.500638 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.500766 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:22.503722 (+ 2956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:22.503729 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:22.503732 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:22.503777 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:22.506795 (+ 3018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:22.507759 (+ 964us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:22.507765 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:22.507767 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:22.508046 (+ 279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:22.508638 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:22.508643 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:22.508645 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:22.509058 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:22.509324 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:22.509774 (+ 450us) server_negotiation.cc:299] Negotiation successful
0811 18:52:22.510055 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 18:52:22.515414 23822 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50010:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:52:22.523288 23822 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:52:22.553013 24649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:22.539231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:44021 (local address 127.0.0.1:47872)
0811 18:52:22.541587 (+ 2356us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:22.541614 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:22.541731 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:22.544977 (+ 3246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:22.544986 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:22.545029 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:22.545491 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:22.545505 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.547415 (+ 1910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.547420 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:22.549789 (+ 2369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:22.549801 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.551966 (+ 2165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.551973 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:22.552200 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:22.552260 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 18:52:22.552394 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 18:52:22.552624 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2217,"mutex_wait_us":1,"thread_start_us":1037,"threads_started":1}
I20260811 18:52:22.553821 24651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:22.539933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47872 (local address 127.25.25.3:44021)
0811 18:52:22.544128 (+ 4195us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:22.544140 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:22.544182 (+ 42us) server_negotiation.cc:407] Connection header received
0811 18:52:22.544312 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:22.544322 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:22.544650 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:22.545527 (+ 877us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:22.545790 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.547278 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.550012 (+ 2734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.551356 (+ 1344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.551509 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:22.551800 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:22.553306 (+ 1506us) server_negotiation.cc:299] Negotiation successful
0811 18:52:22.553497 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3937,"thread_start_us":3738,"threads_started":1}
I20260811 18:52:22.554947 24650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:22.538986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:45057 (local address 127.0.0.1:55468)
0811 18:52:22.540607 (+ 1621us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:22.540676 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:22.540907 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:22.546233 (+ 5326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:22.546238 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:22.546268 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:22.546875 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:22.546889 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.548780 (+ 1891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.548786 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:22.551140 (+ 2354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:22.551158 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.553887 (+ 2729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.553901 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:22.554188 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:22.554267 (+ 79us) client_negotiation.cc:769] Sending connection context
0811 18:52:22.554354 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 18:52:22.554519 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1266,"mutex_wait_us":113,"spinlock_wait_cycles":3456,"thread_start_us":2266,"threads_started":1}
I20260811 18:52:22.555063 24647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:22.539022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55468 (local address 127.25.25.1:45057)
0811 18:52:22.545560 (+ 6538us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:22.545570 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:22.545598 (+ 28us) server_negotiation.cc:407] Connection header received
0811 18:52:22.545691 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:22.545698 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:22.545989 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:22.547142 (+ 1153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:22.547450 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.548626 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.551396 (+ 2770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.553112 (+ 1716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.554191 (+ 1079us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:22.554458 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:22.554539 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 18:52:22.554720 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6343,"thread_start_us":6160,"threads_started":1}
I20260811 18:52:22.554980 24654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:22.543323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38920 (local address 127.25.25.2:41939)
0811 18:52:22.544557 (+ 1234us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:22.544568 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:22.545418 (+ 850us) server_negotiation.cc:407] Connection header received
0811 18:52:22.545534 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:22.545543 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:22.545792 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:22.546018 (+ 226us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:22.547596 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.549144 (+ 1548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.551855 (+ 2711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.553482 (+ 1627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.553647 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:22.554060 (+ 413us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:22.554496 (+ 436us) server_negotiation.cc:299] Negotiation successful
0811 18:52:22.554686 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1047,"thread_start_us":880,"threads_started":1}
I20260811 18:52:22.555648 24652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:22.542603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:41939 (local address 127.0.0.1:38920)
0811 18:52:22.545041 (+ 2438us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:22.545070 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:22.545251 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:22.546321 (+ 1070us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:22.546331 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:22.546355 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:22.547394 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:22.547409 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.549310 (+ 1901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.549317 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:22.551619 (+ 2302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:22.551634 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.553720 (+ 2086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.553726 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:22.554183 (+ 457us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:22.554266 (+ 83us) client_negotiation.cc:769] Sending connection context
0811 18:52:22.554358 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 18:52:22.555270 (+ 912us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2303,"mutex_wait_us":1406,"spinlock_wait_cycles":1408,"thread_start_us":2146,"threads_started":1}
I20260811 18:52:22.559224 24509 tablet_service.cc:1467] Processing CreateTablet for tablet 6aa3edd0ccd742a7af131f9921de3e1f (DEFAULT_TABLE table=test-table [id=f5cc4c97a9114d729f82f138d953045f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:22.560186 24269 tablet_service.cc:1467] Processing CreateTablet for tablet 6aa3edd0ccd742a7af131f9921de3e1f (DEFAULT_TABLE table=test-table [id=f5cc4c97a9114d729f82f138d953045f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:22.561197 24509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6aa3edd0ccd742a7af131f9921de3e1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:22.561720 24269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6aa3edd0ccd742a7af131f9921de3e1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:22.567003 24043 tablet_service.cc:1467] Processing CreateTablet for tablet 6aa3edd0ccd742a7af131f9921de3e1f (DEFAULT_TABLE table=test-table [id=f5cc4c97a9114d729f82f138d953045f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:22.568553 24043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6aa3edd0ccd742a7af131f9921de3e1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:22.577768 24657 tablet_bootstrap.cc:492] T 6aa3edd0ccd742a7af131f9921de3e1f P b6f5f04b91cb42a7a2be0ada35a69c37: Bootstrap starting.
I20260811 18:52:22.578684 24655 tablet_bootstrap.cc:492] T 6aa3edd0ccd742a7af131f9921de3e1f P 79528e0b2892436ebd1bc24d3fffaed9: Bootstrap starting.
I20260811 18:52:22.582873 24655 tablet_bootstrap.cc:654] T 6aa3edd0ccd742a7af131f9921de3e1f P 79528e0b2892436ebd1bc24d3fffaed9: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:22.582875 24657 tablet_bootstrap.cc:654] T 6aa3edd0ccd742a7af131f9921de3e1f P b6f5f04b91cb42a7a2be0ada35a69c37: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:22.582947 24661 tablet_bootstrap.cc:492] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba: Bootstrap starting.
I20260811 18:52:22.584359 24657 log.cc:824] T 6aa3edd0ccd742a7af131f9921de3e1f P b6f5f04b91cb42a7a2be0ada35a69c37: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:22.584333 24655 log.cc:824] T 6aa3edd0ccd742a7af131f9921de3e1f P 79528e0b2892436ebd1bc24d3fffaed9: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:22.586952 24661 tablet_bootstrap.cc:654] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:22.587742 24657 tablet_bootstrap.cc:492] T 6aa3edd0ccd742a7af131f9921de3e1f P b6f5f04b91cb42a7a2be0ada35a69c37: No bootstrap required, opened a new log
I20260811 18:52:22.587954 24655 tablet_bootstrap.cc:492] T 6aa3edd0ccd742a7af131f9921de3e1f P 79528e0b2892436ebd1bc24d3fffaed9: No bootstrap required, opened a new log
I20260811 18:52:22.588047 24657 ts_tablet_manager.cc:1397] T 6aa3edd0ccd742a7af131f9921de3e1f P b6f5f04b91cb42a7a2be0ada35a69c37: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.003s
I20260811 18:52:22.588289 24655 ts_tablet_manager.cc:1397] T 6aa3edd0ccd742a7af131f9921de3e1f P 79528e0b2892436ebd1bc24d3fffaed9: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260811 18:52:22.588449 24661 log.cc:824] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:22.592533 24661 tablet_bootstrap.cc:492] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba: No bootstrap required, opened a new log
I20260811 18:52:22.592959 24661 ts_tablet_manager.cc:1397] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.003s
I20260811 18:52:22.597050 24657 raft_consensus.cc:348] T 6aa3edd0ccd742a7af131f9921de3e1f P b6f5f04b91cb42a7a2be0ada35a69c37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15eedbc01b4d4e7189b5abd46ef980ba" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45057 } } peers { permanent_uuid: "79528e0b2892436ebd1bc24d3fffaed9" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 44021 } } peers { permanent_uuid: "b6f5f04b91cb42a7a2be0ada35a69c37" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 41939 } }
I20260811 18:52:22.597489 24657 raft_consensus.cc:374] T 6aa3edd0ccd742a7af131f9921de3e1f P b6f5f04b91cb42a7a2be0ada35a69c37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:22.597590 24657 raft_consensus.cc:729] T 6aa3edd0ccd742a7af131f9921de3e1f P b6f5f04b91cb42a7a2be0ada35a69c37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f5f04b91cb42a7a2be0ada35a69c37, State: Initialized, Role: FOLLOWER
I20260811 18:52:22.598362 24657 consensus_queue.cc:260] T 6aa3edd0ccd742a7af131f9921de3e1f P b6f5f04b91cb42a7a2be0ada35a69c37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15eedbc01b4d4e7189b5abd46ef980ba" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45057 } } peers { permanent_uuid: "79528e0b2892436ebd1bc24d3fffaed9" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 44021 } } peers { permanent_uuid: "b6f5f04b91cb42a7a2be0ada35a69c37" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 41939 } }
I20260811 18:52:22.599578 24381 heartbeater.cc:503] Master 127.25.25.62:41445 was elected leader, sending a full tablet report...
I20260811 18:52:22.600163 24657 ts_tablet_manager.cc:1428] T 6aa3edd0ccd742a7af131f9921de3e1f P b6f5f04b91cb42a7a2be0ada35a69c37: Time spent starting tablet: real 0.012s user 0.011s sys 0.001s
I20260811 18:52:22.599164 24655 raft_consensus.cc:348] T 6aa3edd0ccd742a7af131f9921de3e1f P 79528e0b2892436ebd1bc24d3fffaed9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15eedbc01b4d4e7189b5abd46ef980ba" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45057 } } peers { permanent_uuid: "79528e0b2892436ebd1bc24d3fffaed9" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 44021 } } peers { permanent_uuid: "b6f5f04b91cb42a7a2be0ada35a69c37" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 41939 } }
I20260811 18:52:22.600625 24655 raft_consensus.cc:374] T 6aa3edd0ccd742a7af131f9921de3e1f P 79528e0b2892436ebd1bc24d3fffaed9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:22.600737 24655 raft_consensus.cc:729] T 6aa3edd0ccd742a7af131f9921de3e1f P 79528e0b2892436ebd1bc24d3fffaed9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79528e0b2892436ebd1bc24d3fffaed9, State: Initialized, Role: FOLLOWER
I20260811 18:52:22.601399 24655 consensus_queue.cc:260] T 6aa3edd0ccd742a7af131f9921de3e1f P 79528e0b2892436ebd1bc24d3fffaed9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15eedbc01b4d4e7189b5abd46ef980ba" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45057 } } peers { permanent_uuid: "79528e0b2892436ebd1bc24d3fffaed9" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 44021 } } peers { permanent_uuid: "b6f5f04b91cb42a7a2be0ada35a69c37" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 41939 } }
I20260811 18:52:22.602697 24625 heartbeater.cc:503] Master 127.25.25.62:41445 was elected leader, sending a full tablet report...
I20260811 18:52:22.603440 24655 ts_tablet_manager.cc:1428] T 6aa3edd0ccd742a7af131f9921de3e1f P 79528e0b2892436ebd1bc24d3fffaed9: Time spent starting tablet: real 0.015s user 0.012s sys 0.001s
W20260811 18:52:22.604014 24383 tablet.cc:2369] T 6aa3edd0ccd742a7af131f9921de3e1f P b6f5f04b91cb42a7a2be0ada35a69c37: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:52:22.603725 24661 raft_consensus.cc:348] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15eedbc01b4d4e7189b5abd46ef980ba" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45057 } } peers { permanent_uuid: "79528e0b2892436ebd1bc24d3fffaed9" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 44021 } } peers { permanent_uuid: "b6f5f04b91cb42a7a2be0ada35a69c37" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 41939 } }
I20260811 18:52:22.604295 24661 raft_consensus.cc:374] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:22.604404 24661 raft_consensus.cc:729] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15eedbc01b4d4e7189b5abd46ef980ba, State: Initialized, Role: FOLLOWER
I20260811 18:52:22.605065 24661 consensus_queue.cc:260] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15eedbc01b4d4e7189b5abd46ef980ba" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45057 } } peers { permanent_uuid: "79528e0b2892436ebd1bc24d3fffaed9" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 44021 } } peers { permanent_uuid: "b6f5f04b91cb42a7a2be0ada35a69c37" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 41939 } }
I20260811 18:52:22.607959 24661 ts_tablet_manager.cc:1428] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba: Time spent starting tablet: real 0.015s user 0.009s sys 0.004s
W20260811 18:52:22.706835 24627 tablet.cc:2369] T 6aa3edd0ccd742a7af131f9921de3e1f P 79528e0b2892436ebd1bc24d3fffaed9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:52:22.740231 24157 tablet.cc:2369] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:52:22.792992 24675 raft_consensus.cc:482] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:52:22.793331 24675 raft_consensus.cc:504] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15eedbc01b4d4e7189b5abd46ef980ba" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45057 } } peers { permanent_uuid: "79528e0b2892436ebd1bc24d3fffaed9" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 44021 } } peers { permanent_uuid: "b6f5f04b91cb42a7a2be0ada35a69c37" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 41939 } }
I20260811 18:52:22.795236 24675 leader_election.cc:288] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79528e0b2892436ebd1bc24d3fffaed9 (127.25.25.3:44021), b6f5f04b91cb42a7a2be0ada35a69c37 (127.25.25.2:41939)
I20260811 18:52:22.802929 24654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:22.795901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:49001 (local address 127.25.25.2:41939)
0811 18:52:22.796197 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:22.796205 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:22.797154 (+ 949us) server_negotiation.cc:407] Connection header received
0811 18:52:22.797349 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:22.797355 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:22.797436 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:22.797505 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:22.798198 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.798922 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.800943 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.801773 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.801890 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:22.801996 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:22.802519 (+ 523us) server_negotiation.cc:299] Negotiation successful
0811 18:52:22.802658 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 18:52:22.802943 24651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:22.795763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:42555 (local address 127.25.25.3:44021)
0811 18:52:22.795988 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:22.795995 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:22.797140 (+ 1145us) server_negotiation.cc:407] Connection header received
0811 18:52:22.797415 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:22.797420 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:22.797489 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:22.797588 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:22.798215 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.798964 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.800949 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.801883 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.802040 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:22.802161 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:22.802505 (+ 344us) server_negotiation.cc:299] Negotiation successful
0811 18:52:22.802655 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 18:52:22.803092 24676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:22.795674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:44021 (local address 127.25.25.1:42555)
0811 18:52:22.796892 (+ 1218us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:22.797008 (+ 116us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:22.797251 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:22.797621 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:22.797626 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:22.797655 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:22.798059 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:22.798071 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.799113 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.799121 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:22.800778 (+ 1657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:22.800792 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.802135 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.802140 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:22.802270 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:22.802352 (+ 82us) client_negotiation.cc:769] Sending connection context
0811 18:52:22.802436 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 18:52:22.802583 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1064,"mutex_wait_us":114,"spinlock_wait_cycles":30464,"thread_start_us":789,"threads_started":1}
I20260811 18:52:22.803575 24677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:22.795894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:41939 (local address 127.25.25.1:49001)
0811 18:52:22.796990 (+ 1096us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:22.797006 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:22.797197 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:22.797556 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:22.797561 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:22.797586 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:22.798027 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:22.798038 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.799062 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.799068 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:22.800760 (+ 1692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:22.800774 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.802069 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.802081 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:22.802321 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:22.802364 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 18:52:22.802465 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 18:52:22.802609 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":977,"mutex_wait_us":28,"thread_start_us":707,"threads_started":1}
I20260811 18:52:22.804436 24552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6aa3edd0ccd742a7af131f9921de3e1f" candidate_uuid: "15eedbc01b4d4e7189b5abd46ef980ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79528e0b2892436ebd1bc24d3fffaed9" is_pre_election: true
I20260811 18:52:22.804742 24308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6aa3edd0ccd742a7af131f9921de3e1f" candidate_uuid: "15eedbc01b4d4e7189b5abd46ef980ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f5f04b91cb42a7a2be0ada35a69c37" is_pre_election: true
I20260811 18:52:22.805027 24552 raft_consensus.cc:2454] T 6aa3edd0ccd742a7af131f9921de3e1f P 79528e0b2892436ebd1bc24d3fffaed9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15eedbc01b4d4e7189b5abd46ef980ba in term 0.
I20260811 18:52:22.805277 24308 raft_consensus.cc:2454] T 6aa3edd0ccd742a7af131f9921de3e1f P b6f5f04b91cb42a7a2be0ada35a69c37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15eedbc01b4d4e7189b5abd46ef980ba in term 0.
I20260811 18:52:22.805908 23963 leader_election.cc:302] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15eedbc01b4d4e7189b5abd46ef980ba, 79528e0b2892436ebd1bc24d3fffaed9; no voters:
I20260811 18:52:22.806521 24675 raft_consensus.cc:2781] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:52:22.806674 24675 raft_consensus.cc:482] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:52:22.806788 24675 raft_consensus.cc:3037] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:22.809320 24675 raft_consensus.cc:504] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15eedbc01b4d4e7189b5abd46ef980ba" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45057 } } peers { permanent_uuid: "79528e0b2892436ebd1bc24d3fffaed9" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 44021 } } peers { permanent_uuid: "b6f5f04b91cb42a7a2be0ada35a69c37" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 41939 } }
I20260811 18:52:22.810027 24675 leader_election.cc:288] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba [CANDIDATE]: Term 1 election: Requested vote from peers 79528e0b2892436ebd1bc24d3fffaed9 (127.25.25.3:44021), b6f5f04b91cb42a7a2be0ada35a69c37 (127.25.25.2:41939)
I20260811 18:52:22.810714 24552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6aa3edd0ccd742a7af131f9921de3e1f" candidate_uuid: "15eedbc01b4d4e7189b5abd46ef980ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79528e0b2892436ebd1bc24d3fffaed9"
I20260811 18:52:22.810695 24308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6aa3edd0ccd742a7af131f9921de3e1f" candidate_uuid: "15eedbc01b4d4e7189b5abd46ef980ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6f5f04b91cb42a7a2be0ada35a69c37"
I20260811 18:52:22.810940 24308 raft_consensus.cc:3037] T 6aa3edd0ccd742a7af131f9921de3e1f P b6f5f04b91cb42a7a2be0ada35a69c37 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:22.810928 24552 raft_consensus.cc:3037] T 6aa3edd0ccd742a7af131f9921de3e1f P 79528e0b2892436ebd1bc24d3fffaed9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:22.813361 24552 raft_consensus.cc:2454] T 6aa3edd0ccd742a7af131f9921de3e1f P 79528e0b2892436ebd1bc24d3fffaed9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15eedbc01b4d4e7189b5abd46ef980ba in term 1.
I20260811 18:52:22.813369 24308 raft_consensus.cc:2454] T 6aa3edd0ccd742a7af131f9921de3e1f P b6f5f04b91cb42a7a2be0ada35a69c37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15eedbc01b4d4e7189b5abd46ef980ba in term 1.
I20260811 18:52:22.813946 23963 leader_election.cc:302] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15eedbc01b4d4e7189b5abd46ef980ba, 79528e0b2892436ebd1bc24d3fffaed9; no voters:
I20260811 18:52:22.814458 24675 raft_consensus.cc:2781] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:22.814999 24675 raft_consensus.cc:686] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba [term 1 LEADER]: Becoming Leader. State: Replica: 15eedbc01b4d4e7189b5abd46ef980ba, State: Running, Role: LEADER
I20260811 18:52:22.815606 24675 consensus_queue.cc:237] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15eedbc01b4d4e7189b5abd46ef980ba" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45057 } } peers { permanent_uuid: "79528e0b2892436ebd1bc24d3fffaed9" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 44021 } } peers { permanent_uuid: "b6f5f04b91cb42a7a2be0ada35a69c37" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 41939 } }
I20260811 18:52:22.820753 23821 catalog_manager.cc:5495] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 15eedbc01b4d4e7189b5abd46ef980ba (127.25.25.1). New cstate: current_term: 1 leader_uuid: "15eedbc01b4d4e7189b5abd46ef980ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15eedbc01b4d4e7189b5abd46ef980ba" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79528e0b2892436ebd1bc24d3fffaed9" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6f5f04b91cb42a7a2be0ada35a69c37" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 41939 } health_report { overall_health: UNKNOWN } } }
I20260811 18:52:22.855587 24647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:22.848667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55476 (local address 127.25.25.1:45057)
0811 18:52:22.848909 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:22.848914 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:22.848933 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:52:22.849170 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:22.849175 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:22.849296 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:22.849485 (+ 189us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:52:22.849852 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.850994 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.852635 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.853252 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.853402 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:22.854005 (+ 603us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:52:22.854698 (+ 693us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:52:22.854850 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:22.854989 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 18:52:22.855108 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 18:52:22.865650 24552 raft_consensus.cc:1261] T 6aa3edd0ccd742a7af131f9921de3e1f P 79528e0b2892436ebd1bc24d3fffaed9 [term 1 FOLLOWER]: Refusing update from remote peer 15eedbc01b4d4e7189b5abd46ef980ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:22.865653 24308 raft_consensus.cc:1261] T 6aa3edd0ccd742a7af131f9921de3e1f P b6f5f04b91cb42a7a2be0ada35a69c37 [term 1 FOLLOWER]: Refusing update from remote peer 15eedbc01b4d4e7189b5abd46ef980ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:22.866719 24680 consensus_queue.cc:1035] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "79528e0b2892436ebd1bc24d3fffaed9" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 44021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:52:22.867157 24675 consensus_queue.cc:1035] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6f5f04b91cb42a7a2be0ada35a69c37" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 41939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:52:22.896941 23821 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50010:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:52:22.897329 23821 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50010:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:52:22.901861 23821 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 813a2e8b9aca4775889a6d336621d252: Sending DeleteTablet for 3 replicas of tablet 6aa3edd0ccd742a7af131f9921de3e1f
I20260811 18:52:22.903514 24509 tablet_service.cc:1514] Processing DeleteTablet for tablet 6aa3edd0ccd742a7af131f9921de3e1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:22 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:47872
I20260811 18:52:22.903519 24043 tablet_service.cc:1514] Processing DeleteTablet for tablet 6aa3edd0ccd742a7af131f9921de3e1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:22 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:55468
I20260811 18:52:22.904551 24269 tablet_service.cc:1514] Processing DeleteTablet for tablet 6aa3edd0ccd742a7af131f9921de3e1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:22 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:38920
I20260811 18:52:22.905457 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 23928
I20260811 18:52:22.912906 24712 tablet_replica.cc:330] T 6aa3edd0ccd742a7af131f9921de3e1f P b6f5f04b91cb42a7a2be0ada35a69c37: stopping tablet replica
I20260811 18:52:22.913571 24712 raft_consensus.cc:2229] T 6aa3edd0ccd742a7af131f9921de3e1f P b6f5f04b91cb42a7a2be0ada35a69c37 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:52:22.914309 24712 raft_consensus.cc:2258] T 6aa3edd0ccd742a7af131f9921de3e1f P b6f5f04b91cb42a7a2be0ada35a69c37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:22.919431 24708 tablet_replica.cc:330] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba: stopping tablet replica
I20260811 18:52:22.919998 24712 ts_tablet_manager.cc:1905] T 6aa3edd0ccd742a7af131f9921de3e1f P b6f5f04b91cb42a7a2be0ada35a69c37: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:22.920377 24708 raft_consensus.cc:2229] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:52:22.921299 24708 raft_consensus.cc:2258] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:22.922297 24706 tablet_replica.cc:330] T 6aa3edd0ccd742a7af131f9921de3e1f P 79528e0b2892436ebd1bc24d3fffaed9: stopping tablet replica
I20260811 18:52:22.924932 24708 ts_tablet_manager.cc:1905] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:22.928462 24712 ts_tablet_manager.cc:1918] T 6aa3edd0ccd742a7af131f9921de3e1f P b6f5f04b91cb42a7a2be0ada35a69c37: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:52:22.928705 24712 log.cc:1196] T 6aa3edd0ccd742a7af131f9921de3e1f P b6f5f04b91cb42a7a2be0ada35a69c37: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-1/wal/wals/6aa3edd0ccd742a7af131f9921de3e1f
I20260811 18:52:22.929433 24712 ts_tablet_manager.cc:1939] T 6aa3edd0ccd742a7af131f9921de3e1f P b6f5f04b91cb42a7a2be0ada35a69c37: Deleting consensus metadata
I20260811 18:52:22.929355 24706 raft_consensus.cc:2229] T 6aa3edd0ccd742a7af131f9921de3e1f P 79528e0b2892436ebd1bc24d3fffaed9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:52:22.930174 24706 raft_consensus.cc:2258] T 6aa3edd0ccd742a7af131f9921de3e1f P 79528e0b2892436ebd1bc24d3fffaed9 [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 11 18:52:22 dist-test-slave-lgr5 krb5kdc[23723](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.1@KRBTEST.COM
I20260811 18:52:22.931828 23798 catalog_manager.cc:4841] TS b6f5f04b91cb42a7a2be0ada35a69c37 (127.25.25.2:41939): tablet 6aa3edd0ccd742a7af131f9921de3e1f (table test-table [id=f5cc4c97a9114d729f82f138d953045f]) successfully deleted
I20260811 18:52:22.933367 24706 ts_tablet_manager.cc:1905] T 6aa3edd0ccd742a7af131f9921de3e1f P 79528e0b2892436ebd1bc24d3fffaed9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:22.936419 24708 ts_tablet_manager.cc:1918] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:52:22.936765 24708 log.cc:1196] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-0/wal/wals/6aa3edd0ccd742a7af131f9921de3e1f
I20260811 18:52:22.937489 24708 ts_tablet_manager.cc:1939] T 6aa3edd0ccd742a7af131f9921de3e1f P 15eedbc01b4d4e7189b5abd46ef980ba: Deleting consensus metadata
I20260811 18:52:22.940457 23796 catalog_manager.cc:4841] TS 15eedbc01b4d4e7189b5abd46ef980ba (127.25.25.1:45057): tablet 6aa3edd0ccd742a7af131f9921de3e1f (table test-table [id=f5cc4c97a9114d729f82f138d953045f]) successfully deleted
I20260811 18:52:22.941596 24706 ts_tablet_manager.cc:1918] T 6aa3edd0ccd742a7af131f9921de3e1f P 79528e0b2892436ebd1bc24d3fffaed9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:52:22.941790 24706 log.cc:1196] T 6aa3edd0ccd742a7af131f9921de3e1f P 79528e0b2892436ebd1bc24d3fffaed9: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474012733352-25700-0/minicluster-data/ts-2/wal/wals/6aa3edd0ccd742a7af131f9921de3e1f
I20260811 18:52:22.942365 24706 ts_tablet_manager.cc:1939] T 6aa3edd0ccd742a7af131f9921de3e1f P 79528e0b2892436ebd1bc24d3fffaed9: Deleting consensus metadata
I20260811 18:52:22.942909 24647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:22.906835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55484 (local address 127.25.25.1:45057)
0811 18:52:22.907052 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:22.907058 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:22.918906 (+ 11848us) server_negotiation.cc:407] Connection header received
0811 18:52:22.919515 (+ 609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:22.919521 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:22.919623 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:22.919716 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:22.921754 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.923002 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.925331 (+ 2329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:22.926102 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:22.926229 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:22.933842 (+ 7613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:22.933870 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:22.933891 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:22.933960 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:22.938605 (+ 4645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:22.939856 (+ 1251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:22.939869 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:22.939872 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:22.940139 (+ 267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:22.940709 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:22.940715 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:22.940719 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:22.941239 (+ 520us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:22.941477 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:22.942180 (+ 703us) server_negotiation.cc:299] Negotiation successful
0811 18:52:22.942533 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 18:52:22.943761 24149 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:22.944741 23793 catalog_manager.cc:4841] TS 79528e0b2892436ebd1bc24d3fffaed9 (127.25.25.3:44021): tablet 6aa3edd0ccd742a7af131f9921de3e1f (table test-table [id=f5cc4c97a9114d729f82f138d953045f]) successfully deleted
I20260811 18:52:23.047107 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 23928
I20260811 18:52:23.079809 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 24165
Aug 11 18:52:23 dist-test-slave-lgr5 krb5kdc[23723](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.2@KRBTEST.COM
I20260811 18:52:23.097023 24654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:23.080732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38930 (local address 127.25.25.2:41939)
0811 18:52:23.080951 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:23.080958 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:23.080980 (+ 22us) server_negotiation.cc:407] Connection header received
0811 18:52:23.081126 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:23.081132 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:23.081226 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:23.081333 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:23.082918 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:23.083738 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:23.085481 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:23.085990 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:23.086131 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:23.090795 (+ 4664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:23.090816 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:23.090835 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:23.090879 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:23.093972 (+ 3093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:23.094762 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:23.094770 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:23.094773 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:23.094920 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:23.095318 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:23.095322 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:23.095324 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:23.095747 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:23.096104 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:23.096448 (+ 344us) server_negotiation.cc:299] Negotiation successful
0811 18:52:23.096682 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 18:52:23.097723 24369 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:23.190011 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 24165
I20260811 18:52:23.215912 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 24390
Aug 11 18:52:23 dist-test-slave-lgr5 krb5kdc[23723](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.3@KRBTEST.COM
I20260811 18:52:23.234139 24651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:23.216901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47888 (local address 127.25.25.3:44021)
0811 18:52:23.217111 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:23.217116 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:23.217135 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:52:23.217194 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:23.217199 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:23.217264 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:23.217362 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:23.218845 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:23.219602 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:23.221327 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:23.221765 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:23.221913 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:23.226900 (+ 4987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:23.226924 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:23.226943 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:23.226992 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:23.230635 (+ 3643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:23.231637 (+ 1002us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:23.231646 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:23.231648 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:23.231839 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:23.232341 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:23.232345 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:23.232347 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:23.232786 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:23.233112 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:23.233499 (+ 387us) server_negotiation.cc:299] Negotiation successful
0811 18:52:23.233770 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 18:52:23.235179 24619 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:23.330891 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 24390
I20260811 18:52:23.358007 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 23748
I20260811 18:52:23.359264 23871 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:23.473093 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 23748
2026-08-11T18:52:23Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (5177 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T18:52:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:52:23Z Disabled control of system clock
I20260811 18:52:23.590584 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:36061
--webserver_interface=127.25.25.62
--webserver_port=0
--builtin_ntp_servers=127.25.25.20:43903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:36061
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 18:52:23.956887 24721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:23.957216 24721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:23.957340 24721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:23.964902 24721 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:52:23.965034 24721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:23.965078 24721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:23.965159 24721 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:52:23.965216 24721 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:52:23.977193 24721 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:43903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:36061
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:36061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:23.979005 24721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:23.981463 24721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:23.995321 24732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:23.995352 24734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:23.995383 24740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:23.996454 24721 server_base.cc:1034] running on GCE node
I20260811 18:52:23.997426 24721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:23.999130 24721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:24.000361 24721 hybrid_clock.cc:648] HybridClock initialized: now 1786474344000279 us; error 66 us; skew 500 ppm
I20260811 18:52:24.000761 24721 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:52:24.003446 24721 webserver.cc:460] Webserver started at http://127.25.25.62:34251/ using document root <none> and password file <none>
I20260811 18:52:24.004330 24721 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:24.004460 24721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:24.004837 24721 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:24.008496 24721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "2c7a30a578bd45679e950651915e3730"
format_stamp: "Formatted at 2026-08-11 18:52:24 on dist-test-slave-lgr5"
server_key: "c9e7e7dfd782698721cb86ea2784f10f"
server_key_iv: "340c0382f5e9b807ec9b471fbe993afb"
server_key_version: "encryptionkey@0"
I20260811 18:52:24.009603 24721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "2c7a30a578bd45679e950651915e3730"
format_stamp: "Formatted at 2026-08-11 18:52:24 on dist-test-slave-lgr5"
server_key: "c9e7e7dfd782698721cb86ea2784f10f"
server_key_iv: "340c0382f5e9b807ec9b471fbe993afb"
server_key_version: "encryptionkey@0"
I20260811 18:52:24.016261 24721 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 18:52:24.020192 24749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:24.021719 24721 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:52:24.021924 24721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "2c7a30a578bd45679e950651915e3730"
format_stamp: "Formatted at 2026-08-11 18:52:24 on dist-test-slave-lgr5"
server_key: "c9e7e7dfd782698721cb86ea2784f10f"
server_key_iv: "340c0382f5e9b807ec9b471fbe993afb"
server_key_version: "encryptionkey@0"
I20260811 18:52:24.022166 24721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:24.055732 24721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:24.057158 24721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:24.057538 24721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:24.080417 24721 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:36061
I20260811 18:52:24.080423 24837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:36061 every 8 connection(s)
I20260811 18:52:24.082007 24721 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:52:24.084379 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 24721
I20260811 18:52:24.084563 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:52:24.085088 25700 external_mini_cluster.cc:1428] Setting key e3cdcdf5fda843ad0be1acc00daedb25
I20260811 18:52:24.087088 24838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:24.102438 24846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:24.087704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33206 (local address 127.25.25.62:36061)
0811 18:52:24.088899 (+ 1195us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:24.088913 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:24.088965 (+ 52us) server_negotiation.cc:407] Connection header received
0811 18:52:24.090671 (+ 1706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:24.090700 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:24.091299 (+ 599us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:24.091710 (+ 411us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:24.092564 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:24.094118 (+ 1554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:24.096575 (+ 2457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:24.097475 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:24.097672 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:24.099271 (+ 1599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:24.099285 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:24.099309 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:24.100062 (+ 753us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:24.100228 (+ 166us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:24.100263 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:24.100393 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:24.100768 (+ 375us) server_negotiation.cc:299] Negotiation successful
0811 18:52:24.101220 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":700,"thread_start_us":461,"threads_started":1}
I20260811 18:52:24.102777 24838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c7a30a578bd45679e950651915e3730: Bootstrap starting.
I20260811 18:52:24.106781 24838 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c7a30a578bd45679e950651915e3730: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:24.107906 24838 log.cc:824] T 00000000000000000000000000000000 P 2c7a30a578bd45679e950651915e3730: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:24.111557 24838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c7a30a578bd45679e950651915e3730: No bootstrap required, opened a new log
I20260811 18:52:24.120128 24838 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c7a30a578bd45679e950651915e3730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c7a30a578bd45679e950651915e3730" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 36061 } }
I20260811 18:52:24.120692 24838 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2c7a30a578bd45679e950651915e3730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:24.120781 24838 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c7a30a578bd45679e950651915e3730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c7a30a578bd45679e950651915e3730, State: Initialized, Role: FOLLOWER
I20260811 18:52:24.121400 24838 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c7a30a578bd45679e950651915e3730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c7a30a578bd45679e950651915e3730" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 36061 } }
I20260811 18:52:24.121656 24838 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2c7a30a578bd45679e950651915e3730 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:52:24.121762 24838 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c7a30a578bd45679e950651915e3730 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:52:24.121896 24838 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c7a30a578bd45679e950651915e3730 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:24.124267 24838 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c7a30a578bd45679e950651915e3730 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c7a30a578bd45679e950651915e3730" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 36061 } }
I20260811 18:52:24.124855 24838 leader_election.cc:302] T 00000000000000000000000000000000 P 2c7a30a578bd45679e950651915e3730 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c7a30a578bd45679e950651915e3730; no voters:
I20260811 18:52:24.125612 24838 leader_election.cc:288] T 00000000000000000000000000000000 P 2c7a30a578bd45679e950651915e3730 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:52:24.125787 24851 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c7a30a578bd45679e950651915e3730 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:24.126585 24851 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2c7a30a578bd45679e950651915e3730 [term 1 LEADER]: Becoming Leader. State: Replica: 2c7a30a578bd45679e950651915e3730, State: Running, Role: LEADER
I20260811 18:52:24.127158 24851 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c7a30a578bd45679e950651915e3730 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c7a30a578bd45679e950651915e3730" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 36061 } }
I20260811 18:52:24.127882 24838 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c7a30a578bd45679e950651915e3730 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:52:24.130106 24854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c7a30a578bd45679e950651915e3730 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c7a30a578bd45679e950651915e3730. Latest consensus state: current_term: 1 leader_uuid: "2c7a30a578bd45679e950651915e3730" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c7a30a578bd45679e950651915e3730" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 36061 } } }
I20260811 18:52:24.130595 24854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c7a30a578bd45679e950651915e3730 [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:24.130980 24853 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c7a30a578bd45679e950651915e3730 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2c7a30a578bd45679e950651915e3730" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c7a30a578bd45679e950651915e3730" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 36061 } } }
I20260811 18:52:24.131326 24853 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c7a30a578bd45679e950651915e3730 [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:24.133536 24864 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:52:24.139602 24864 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:52:24.150002 24864 catalog_manager.cc:1347] Generated new cluster ID: 9fb098888d0c4c48a82dbe4c1ab1669b
I20260811 18:52:24.150153 24864 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:52:24.187979 24864 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:52:24.189730 24864 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:52:24.200117 24864 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2c7a30a578bd45679e950651915e3730: Generated new TSK 0
I20260811 18:52:24.201201 24864 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:52:24.218022 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:0
--local_ip_for_outbound_sockets=127.25.25.1
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:36061
--builtin_ntp_servers=127.25.25.20:43903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 18:52:24.621217 24884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:24.621551 24884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:24.621641 24884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:24.629487 24884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:24.629606 24884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:24.629714 24884 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:52:24.639969 24884 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:43903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:36061
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:24.641440 24884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:24.643402 24884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:24.657977 24891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:24.657960 24894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:24.658031 24892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:24.659857 24884 server_base.cc:1034] running on GCE node
I20260811 18:52:24.660727 24884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:24.661880 24884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:24.663111 24884 hybrid_clock.cc:648] HybridClock initialized: now 1786474344663053 us; error 51 us; skew 500 ppm
I20260811 18:52:24.663499 24884 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:52:24.666100 24884 webserver.cc:460] Webserver started at http://127.25.25.1:35453/ using document root <none> and password file <none>
I20260811 18:52:24.666851 24884 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:24.666965 24884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:24.667291 24884 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:24.670636 24884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-0/data/instance:
uuid: "ec5fe8c09449462caee2937483332ae9"
format_stamp: "Formatted at 2026-08-11 18:52:24 on dist-test-slave-lgr5"
server_key: "682a81d51f2ac201d418eabc5fabe249"
server_key_iv: "65184f6d6ab5a54172fadf94cd51ada2"
server_key_version: "encryptionkey@0"
I20260811 18:52:24.671576 24884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance:
uuid: "ec5fe8c09449462caee2937483332ae9"
format_stamp: "Formatted at 2026-08-11 18:52:24 on dist-test-slave-lgr5"
server_key: "682a81d51f2ac201d418eabc5fabe249"
server_key_iv: "65184f6d6ab5a54172fadf94cd51ada2"
server_key_version: "encryptionkey@0"
I20260811 18:52:24.677582 24884 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260811 18:52:24.682049 24902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:24.683880 24884 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 18:52:24.684163 24884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "ec5fe8c09449462caee2937483332ae9"
format_stamp: "Formatted at 2026-08-11 18:52:24 on dist-test-slave-lgr5"
server_key: "682a81d51f2ac201d418eabc5fabe249"
server_key_iv: "65184f6d6ab5a54172fadf94cd51ada2"
server_key_version: "encryptionkey@0"
I20260811 18:52:24.684464 24884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:24.702113 24884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:24.703141 24884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:24.703490 24884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:24.704708 24884 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:24.706449 24884 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:24.706559 24884 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:24.706691 24884 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:24.706774 24884 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:24.742461 24884 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:40469
I20260811 18:52:24.742516 25098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:40469 every 8 connection(s)
I20260811 18:52:24.744020 24884 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:52:24.752101 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 24884
I20260811 18:52:24.752319 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance
I20260811 18:52:24.752934 25700 external_mini_cluster.cc:1428] Setting key 4200abff3500e82bfe32c0967581c863
I20260811 18:52:24.756156 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:0
--local_ip_for_outbound_sockets=127.25.25.2
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:36061
--builtin_ntp_servers=127.25.25.20:43903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 18:52:24.757740 25103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:24.747005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:59299 (local address 127.25.25.62:36061)
0811 18:52:24.747531 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:24.747536 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:24.748798 (+ 1262us) server_negotiation.cc:407] Connection header received
0811 18:52:24.750633 (+ 1835us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:24.750638 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:24.750710 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:24.750822 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:24.751936 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:24.753121 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:24.754779 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:24.755207 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:24.755329 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:24.756866 (+ 1537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:24.756874 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:24.756879 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:24.756900 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:24.756943 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:24.756956 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:24.757035 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:24.757268 (+ 233us) server_negotiation.cc:299] Negotiation successful
0811 18:52:24.757383 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":246,"threads_started":1}
I20260811 18:52:24.758827 25104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:24.747632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:36061 (local address 127.25.25.1:59299)
0811 18:52:24.748617 (+ 985us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:24.748658 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:24.750347 (+ 1689us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:24.751031 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:24.751040 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:24.751130 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:24.751722 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:24.751739 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:24.753284 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:24.753289 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:24.754624 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:24.754639 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:24.755460 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:24.755469 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:24.755705 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:24.756519 (+ 814us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:52:24.756521 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:24.756565 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:52:24.756656 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:24.757051 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:24.757064 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:24.757073 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 18:52:24.757238 (+ 165us) client_negotiation.cc:240] Negotiation successful
0811 18:52:24.757680 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":280,"threads_started":1}
I20260811 18:52:24.760807 25099 heartbeater.cc:347] Connected to a master server at 127.25.25.62:36061
I20260811 18:52:24.761133 25099 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:24.761977 25099 heartbeater.cc:511] Master 127.25.25.62:36061 requested a full tablet report, sending...
I20260811 18:52:24.764534 24779 ts_manager.cc:194] Registered new tserver with Master: ec5fe8c09449462caee2937483332ae9 (127.25.25.1:40469)
I20260811 18:52:24.766585 24779 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.25.1:59299
W20260811 18:52:25.134697 25105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:25.135121 25105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:25.135229 25105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:25.143396 25105 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:25.143533 25105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:25.143651 25105 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:52:25.153345 25105 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:43903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:36061
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:25.154872 25105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:25.156915 25105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:25.171576 25124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:25.171780 25119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:25.171763 25121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:25.173327 25105 server_base.cc:1034] running on GCE node
I20260811 18:52:25.174311 25105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:25.175649 25105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:25.177181 25105 hybrid_clock.cc:648] HybridClock initialized: now 1786474345177039 us; error 141 us; skew 500 ppm
I20260811 18:52:25.177618 25105 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:52:25.180701 25105 webserver.cc:460] Webserver started at http://127.25.25.2:46469/ using document root <none> and password file <none>
I20260811 18:52:25.181661 25105 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:25.181794 25105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:25.182159 25105 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:25.185649 25105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-1/data/instance:
uuid: "26db4449a0bd46bdb1d86efd3cf7a6cb"
format_stamp: "Formatted at 2026-08-11 18:52:25 on dist-test-slave-lgr5"
server_key: "a753009d1e305b65c3ecba8e72c37013"
server_key_iv: "c35f01fc90b9670b62c6186a84ceb113"
server_key_version: "encryptionkey@0"
I20260811 18:52:25.186635 25105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance:
uuid: "26db4449a0bd46bdb1d86efd3cf7a6cb"
format_stamp: "Formatted at 2026-08-11 18:52:25 on dist-test-slave-lgr5"
server_key: "a753009d1e305b65c3ecba8e72c37013"
server_key_iv: "c35f01fc90b9670b62c6186a84ceb113"
server_key_version: "encryptionkey@0"
I20260811 18:52:25.193288 25105 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 18:52:25.197880 25136 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:25.199851 25105 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 18:52:25.200120 25105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "26db4449a0bd46bdb1d86efd3cf7a6cb"
format_stamp: "Formatted at 2026-08-11 18:52:25 on dist-test-slave-lgr5"
server_key: "a753009d1e305b65c3ecba8e72c37013"
server_key_iv: "c35f01fc90b9670b62c6186a84ceb113"
server_key_version: "encryptionkey@0"
I20260811 18:52:25.200446 25105 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:25.220742 25105 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:25.221652 25105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:25.221920 25105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:25.223028 25105 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:25.224692 25105 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:25.224792 25105 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:25.224879 25105 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:25.224941 25105 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:25.258728 25105 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:39359
I20260811 18:52:25.258788 25353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:39359 every 8 connection(s)
I20260811 18:52:25.260272 25105 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:52:25.261000 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 25105
I20260811 18:52:25.261178 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance
I20260811 18:52:25.261852 25700 external_mini_cluster.cc:1428] Setting key 8d792ab7341a714fe9c690a458e95a39
I20260811 18:52:25.265838 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:0
--local_ip_for_outbound_sockets=127.25.25.3
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:36061
--builtin_ntp_servers=127.25.25.20:43903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 18:52:25.278434 25356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:25.263763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:51641 (local address 127.25.25.62:36061)
0811 18:52:25.268570 (+ 4807us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:25.268578 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:25.268608 (+ 30us) server_negotiation.cc:407] Connection header received
0811 18:52:25.270066 (+ 1458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:25.270072 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:25.270178 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:25.270484 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:25.272204 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:25.273004 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:25.274824 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:25.275297 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:25.275428 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:25.277433 (+ 2005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:25.277439 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:25.277443 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:25.277468 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:25.277518 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:25.277541 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:25.277633 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:25.277921 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 18:52:25.278056 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4646,"thread_start_us":4520,"threads_started":1}
I20260811 18:52:25.279980 25358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:25.264777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:36061 (local address 127.25.25.2:51641)
0811 18:52:25.267312 (+ 2535us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:25.267369 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:25.269636 (+ 2267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:25.270837 (+ 1201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:25.270849 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:25.271152 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:25.271891 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:25.271917 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:25.273218 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:25.273223 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:25.274618 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:25.274638 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:25.275590 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:25.275601 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:25.276000 (+ 399us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:25.276954 (+ 954us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:52:25.276958 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:25.277023 (+ 65us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:52:25.277140 (+ 117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:25.277662 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:25.277675 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:25.277682 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 18:52:25.277877 (+ 195us) client_negotiation.cc:240] Negotiation successful
0811 18:52:25.278418 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1792,"thread_start_us":1514,"threads_started":1}
I20260811 18:52:25.281880 25354 heartbeater.cc:347] Connected to a master server at 127.25.25.62:36061
I20260811 18:52:25.282336 25354 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:25.283392 25354 heartbeater.cc:511] Master 127.25.25.62:36061 requested a full tablet report, sending...
I20260811 18:52:25.285441 24779 ts_manager.cc:194] Registered new tserver with Master: 26db4449a0bd46bdb1d86efd3cf7a6cb (127.25.25.2:39359)
I20260811 18:52:25.286741 24779 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.25.2:51641
W20260811 18:52:25.653048 25359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:25.653391 25359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:25.653503 25359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:25.661418 25359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:25.661572 25359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:25.661695 25359 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:52:25.671531 25359 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:43903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:36061
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:25.673003 25359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:25.674995 25359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:25.689920 25365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:25.689988 25366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:25.689949 25369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:25.691067 25359 server_base.cc:1034] running on GCE node
I20260811 18:52:25.691761 25359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:25.692924 25359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:25.694171 25359 hybrid_clock.cc:648] HybridClock initialized: now 1786474345694112 us; error 48 us; skew 500 ppm
I20260811 18:52:25.694610 25359 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:52:25.697553 25359 webserver.cc:460] Webserver started at http://127.25.25.3:44717/ using document root <none> and password file <none>
I20260811 18:52:25.698438 25359 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:25.698585 25359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:25.699074 25359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:25.702726 25359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-2/data/instance:
uuid: "7da4786507ab4476bbc74ebb4ecaa349"
format_stamp: "Formatted at 2026-08-11 18:52:25 on dist-test-slave-lgr5"
server_key: "b12c3d803cb7b60ec7a3455a839cacaa"
server_key_iv: "90319ac3ad4eea4694723b2b4e1da5d7"
server_key_version: "encryptionkey@0"
I20260811 18:52:25.703778 25359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance:
uuid: "7da4786507ab4476bbc74ebb4ecaa349"
format_stamp: "Formatted at 2026-08-11 18:52:25 on dist-test-slave-lgr5"
server_key: "b12c3d803cb7b60ec7a3455a839cacaa"
server_key_iv: "90319ac3ad4eea4694723b2b4e1da5d7"
server_key_version: "encryptionkey@0"
I20260811 18:52:25.709923 25359 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260811 18:52:25.714090 25379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:25.715709 25359 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 18:52:25.715903 25359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "7da4786507ab4476bbc74ebb4ecaa349"
format_stamp: "Formatted at 2026-08-11 18:52:25 on dist-test-slave-lgr5"
server_key: "b12c3d803cb7b60ec7a3455a839cacaa"
server_key_iv: "90319ac3ad4eea4694723b2b4e1da5d7"
server_key_version: "encryptionkey@0"
I20260811 18:52:25.716177 25359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:25.741930 25359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:25.742851 25359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:25.743137 25359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:25.744277 25359 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:25.745976 25359 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:25.746102 25359 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:25.746213 25359 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:25.746299 25359 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:25.771138 25099 heartbeater.cc:503] Master 127.25.25.62:36061 was elected leader, sending a full tablet report...
I20260811 18:52:25.779973 25359 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:38737
I20260811 18:52:25.780151 25584 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:38737 every 8 connection(s)
I20260811 18:52:25.781639 25359 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:52:25.784552 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 25359
I20260811 18:52:25.784759 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance
I20260811 18:52:25.785344 25700 external_mini_cluster.cc:1428] Setting key 9b0617aa169d9c24ed896f70a9b68680
I20260811 18:52:25.795996 25590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:25.784444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:35253 (local address 127.25.25.62:36061)
0811 18:52:25.784924 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:25.784928 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:25.786630 (+ 1702us) server_negotiation.cc:407] Connection header received
0811 18:52:25.789132 (+ 2502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:25.789136 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:25.789212 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:25.789301 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:25.790608 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:25.791386 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:25.793142 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:25.793556 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:25.793657 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:25.795122 (+ 1465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:25.795128 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:25.795131 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:25.795154 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:25.795198 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:25.795211 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:25.795283 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:25.795565 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 18:52:25.795668 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":255,"threads_started":1}
I20260811 18:52:25.797032 25591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:25.785239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:36061 (local address 127.25.25.3:35253)
0811 18:52:25.786453 (+ 1214us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:25.786517 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:25.788848 (+ 2331us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:25.789561 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:25.789569 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:25.789688 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:25.790421 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:25.790444 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:25.791559 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:25.791564 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:25.793000 (+ 1436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:25.793016 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:25.793789 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:25.793795 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:25.794015 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:25.794740 (+ 725us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:52:25.794743 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:25.794791 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:52:25.794898 (+ 107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:25.795289 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:25.795296 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:25.795302 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 18:52:25.795499 (+ 197us) client_negotiation.cc:240] Negotiation successful
0811 18:52:25.795850 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":636,"thread_start_us":375,"threads_started":1}
I20260811 18:52:25.798542 25586 heartbeater.cc:347] Connected to a master server at 127.25.25.62:36061
I20260811 18:52:25.798871 25586 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:25.799839 25586 heartbeater.cc:511] Master 127.25.25.62:36061 requested a full tablet report, sending...
I20260811 18:52:25.801507 24779 ts_manager.cc:194] Registered new tserver with Master: 7da4786507ab4476bbc74ebb4ecaa349 (127.25.25.3:38737)
I20260811 18:52:25.802328 24779 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.25.3:35253
I20260811 18:52:25.814203 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:52:25.825716 25590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:25.818780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33208 (local address 127.25.25.62:36061)
0811 18:52:25.818977 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:25.818982 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:25.819346 (+ 364us) server_negotiation.cc:407] Connection header received
0811 18:52:25.819578 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:25.819583 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:25.819662 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:25.819795 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:25.820409 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:25.821252 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:25.822811 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:25.823243 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:25.823350 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:25.824691 (+ 1341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:25.824698 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:25.824701 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:25.824725 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:25.824768 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:25.824782 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:25.824863 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:25.825184 (+ 321us) server_negotiation.cc:299] Negotiation successful
0811 18:52:25.825291 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 18:52:25.830019 24779 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33208:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:52:25.837221 24779 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:52:25.863360 25608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:25.851306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:39359 (local address 127.0.0.1:40742)
0811 18:52:25.852513 (+ 1207us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:25.852563 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:25.852746 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:25.853894 (+ 1148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:25.853904 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:25.853939 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:25.855191 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:25.855208 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:25.857301 (+ 2093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:25.857308 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:25.859789 (+ 2481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:25.859817 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:25.862302 (+ 2485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:25.862309 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:25.862553 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:25.862607 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 18:52:25.862746 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 18:52:25.862986 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":932,"thread_start_us":756,"threads_started":1}
I20260811 18:52:25.864599 25611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:25.851393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40742 (local address 127.25.25.2:39359)
0811 18:52:25.852024 (+ 631us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:25.852033 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:25.852966 (+ 933us) server_negotiation.cc:407] Connection header received
0811 18:52:25.853090 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:25.853098 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:25.853380 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:25.853601 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:25.855416 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:25.857109 (+ 1693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:25.860071 (+ 2962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:25.861686 (+ 1615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:25.861841 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:25.862134 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:25.864015 (+ 1881us) server_negotiation.cc:299] Negotiation successful
0811 18:52:25.864253 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":383,"threads_started":1}
I20260811 18:52:25.873594 25242 tablet_service.cc:1467] Processing CreateTablet for tablet 2a20e784bae7400aa890ffbf25384c3e (DEFAULT_TABLE table=test-table [id=5391035ad25c412da35c6d92ad8f8153]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:25.875583 25242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a20e784bae7400aa890ffbf25384c3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:25.878214 25614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:25.852969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:38737 (local address 127.0.0.1:46594)
0811 18:52:25.868802 (+ 15833us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:25.868821 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:25.869001 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:25.870191 (+ 1190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:25.870197 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:25.870229 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:25.870609 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:25.870624 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:25.872756 (+ 2132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:25.872762 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:25.874884 (+ 2122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:25.874907 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:25.877344 (+ 2437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:25.877352 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:25.877549 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:25.877590 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 18:52:25.877690 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 18:52:25.877859 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15690,"thread_start_us":15523,"threads_started":1}
I20260811 18:52:25.879127 25620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:25.853580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46594 (local address 127.25.25.3:38737)
0811 18:52:25.868300 (+ 14720us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:25.868312 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:25.869158 (+ 846us) server_negotiation.cc:407] Connection header received
0811 18:52:25.869292 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:25.869300 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:25.869584 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:25.869834 (+ 250us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:25.870874 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:25.872521 (+ 1647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:25.875209 (+ 2688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:25.876699 (+ 1490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:25.876873 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:25.877176 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:25.878529 (+ 1353us) server_negotiation.cc:299] Negotiation successful
0811 18:52:25.878719 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14461,"thread_start_us":14267,"threads_started":1}
I20260811 18:52:25.884892 25465 tablet_service.cc:1467] Processing CreateTablet for tablet 2a20e784bae7400aa890ffbf25384c3e (DEFAULT_TABLE table=test-table [id=5391035ad25c412da35c6d92ad8f8153]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:25.887285 25465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a20e784bae7400aa890ffbf25384c3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:25.887944 25608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:25.852674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:40469 (local address 127.0.0.1:35232)
0811 18:52:25.863656 (+ 10982us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:25.863676 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:25.863815 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:25.880538 (+ 16723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:25.880544 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:25.880582 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:25.880769 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:25.880780 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:25.883074 (+ 2294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:25.883080 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:25.885125 (+ 2045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:25.885146 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:25.886938 (+ 1792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:25.886945 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:25.887172 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:25.887214 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 18:52:25.887343 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 18:52:25.887586 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10862,"thread_start_us":27264,"threads_started":1}
I20260811 18:52:25.888005 25615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:25.853046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35232 (local address 127.25.25.1:40469)
0811 18:52:25.879820 (+ 26774us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:25.879829 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:25.879862 (+ 33us) server_negotiation.cc:407] Connection header received
0811 18:52:25.879978 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:25.879985 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:25.880299 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:25.880979 (+ 680us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:25.881264 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:25.882851 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:25.885411 (+ 2560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:25.886718 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:25.886894 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:25.887225 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:25.887399 (+ 174us) server_negotiation.cc:299] Negotiation successful
0811 18:52:25.887595 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26550,"thread_start_us":26407,"threads_started":1}
I20260811 18:52:25.892210 24973 tablet_service.cc:1467] Processing CreateTablet for tablet 2a20e784bae7400aa890ffbf25384c3e (DEFAULT_TABLE table=test-table [id=5391035ad25c412da35c6d92ad8f8153]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:25.893679 24973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a20e784bae7400aa890ffbf25384c3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:25.894465 25622 tablet_bootstrap.cc:492] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb: Bootstrap starting.
I20260811 18:52:25.898808 25622 tablet_bootstrap.cc:654] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:25.900418 25622 log.cc:824] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:25.903273 25624 tablet_bootstrap.cc:492] T 2a20e784bae7400aa890ffbf25384c3e P 7da4786507ab4476bbc74ebb4ecaa349: Bootstrap starting.
I20260811 18:52:25.907202 25624 tablet_bootstrap.cc:654] T 2a20e784bae7400aa890ffbf25384c3e P 7da4786507ab4476bbc74ebb4ecaa349: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:25.907868 25622 tablet_bootstrap.cc:492] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb: No bootstrap required, opened a new log
I20260811 18:52:25.908233 25622 ts_tablet_manager.cc:1397] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.011s
I20260811 18:52:25.908390 25624 log.cc:824] T 2a20e784bae7400aa890ffbf25384c3e P 7da4786507ab4476bbc74ebb4ecaa349: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:25.913076 25629 tablet_bootstrap.cc:492] T 2a20e784bae7400aa890ffbf25384c3e P ec5fe8c09449462caee2937483332ae9: Bootstrap starting.
I20260811 18:52:25.917012 25629 tablet_bootstrap.cc:654] T 2a20e784bae7400aa890ffbf25384c3e P ec5fe8c09449462caee2937483332ae9: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:25.917488 25624 tablet_bootstrap.cc:492] T 2a20e784bae7400aa890ffbf25384c3e P 7da4786507ab4476bbc74ebb4ecaa349: No bootstrap required, opened a new log
I20260811 18:52:25.917806 25624 ts_tablet_manager.cc:1397] T 2a20e784bae7400aa890ffbf25384c3e P 7da4786507ab4476bbc74ebb4ecaa349: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.008s
I20260811 18:52:25.918664 25629 log.cc:824] T 2a20e784bae7400aa890ffbf25384c3e P ec5fe8c09449462caee2937483332ae9: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:25.918720 25622 raft_consensus.cc:348] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26db4449a0bd46bdb1d86efd3cf7a6cb" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 39359 } } peers { permanent_uuid: "7da4786507ab4476bbc74ebb4ecaa349" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 38737 } } peers { permanent_uuid: "ec5fe8c09449462caee2937483332ae9" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 40469 } }
I20260811 18:52:25.919256 25622 raft_consensus.cc:374] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:25.919368 25622 raft_consensus.cc:729] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26db4449a0bd46bdb1d86efd3cf7a6cb, State: Initialized, Role: FOLLOWER
I20260811 18:52:25.920006 25622 consensus_queue.cc:260] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26db4449a0bd46bdb1d86efd3cf7a6cb" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 39359 } } peers { permanent_uuid: "7da4786507ab4476bbc74ebb4ecaa349" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 38737 } } peers { permanent_uuid: "ec5fe8c09449462caee2937483332ae9" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 40469 } }
I20260811 18:52:25.921316 25354 heartbeater.cc:503] Master 127.25.25.62:36061 was elected leader, sending a full tablet report...
I20260811 18:52:25.921984 25622 ts_tablet_manager.cc:1428] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb: Time spent starting tablet: real 0.014s user 0.012s sys 0.001s
I20260811 18:52:25.925414 25629 tablet_bootstrap.cc:492] T 2a20e784bae7400aa890ffbf25384c3e P ec5fe8c09449462caee2937483332ae9: No bootstrap required, opened a new log
I20260811 18:52:25.925765 25629 ts_tablet_manager.cc:1397] T 2a20e784bae7400aa890ffbf25384c3e P ec5fe8c09449462caee2937483332ae9: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.006s
I20260811 18:52:25.930261 25624 raft_consensus.cc:348] T 2a20e784bae7400aa890ffbf25384c3e P 7da4786507ab4476bbc74ebb4ecaa349 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26db4449a0bd46bdb1d86efd3cf7a6cb" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 39359 } } peers { permanent_uuid: "7da4786507ab4476bbc74ebb4ecaa349" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 38737 } } peers { permanent_uuid: "ec5fe8c09449462caee2937483332ae9" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 40469 } }
I20260811 18:52:25.930845 25624 raft_consensus.cc:374] T 2a20e784bae7400aa890ffbf25384c3e P 7da4786507ab4476bbc74ebb4ecaa349 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:25.930960 25624 raft_consensus.cc:729] T 2a20e784bae7400aa890ffbf25384c3e P 7da4786507ab4476bbc74ebb4ecaa349 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7da4786507ab4476bbc74ebb4ecaa349, State: Initialized, Role: FOLLOWER
I20260811 18:52:25.931720 25624 consensus_queue.cc:260] T 2a20e784bae7400aa890ffbf25384c3e P 7da4786507ab4476bbc74ebb4ecaa349 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26db4449a0bd46bdb1d86efd3cf7a6cb" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 39359 } } peers { permanent_uuid: "7da4786507ab4476bbc74ebb4ecaa349" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 38737 } } peers { permanent_uuid: "ec5fe8c09449462caee2937483332ae9" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 40469 } }
I20260811 18:52:25.933003 25586 heartbeater.cc:503] Master 127.25.25.62:36061 was elected leader, sending a full tablet report...
I20260811 18:52:25.933907 25624 ts_tablet_manager.cc:1428] T 2a20e784bae7400aa890ffbf25384c3e P 7da4786507ab4476bbc74ebb4ecaa349: Time spent starting tablet: real 0.016s user 0.013s sys 0.003s
I20260811 18:52:25.936702 25629 raft_consensus.cc:348] T 2a20e784bae7400aa890ffbf25384c3e P ec5fe8c09449462caee2937483332ae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26db4449a0bd46bdb1d86efd3cf7a6cb" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 39359 } } peers { permanent_uuid: "7da4786507ab4476bbc74ebb4ecaa349" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 38737 } } peers { permanent_uuid: "ec5fe8c09449462caee2937483332ae9" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 40469 } }
I20260811 18:52:25.937223 25629 raft_consensus.cc:374] T 2a20e784bae7400aa890ffbf25384c3e P ec5fe8c09449462caee2937483332ae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:25.937340 25629 raft_consensus.cc:729] T 2a20e784bae7400aa890ffbf25384c3e P ec5fe8c09449462caee2937483332ae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec5fe8c09449462caee2937483332ae9, State: Initialized, Role: FOLLOWER
I20260811 18:52:25.938026 25629 consensus_queue.cc:260] T 2a20e784bae7400aa890ffbf25384c3e P ec5fe8c09449462caee2937483332ae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26db4449a0bd46bdb1d86efd3cf7a6cb" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 39359 } } peers { permanent_uuid: "7da4786507ab4476bbc74ebb4ecaa349" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 38737 } } peers { permanent_uuid: "ec5fe8c09449462caee2937483332ae9" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 40469 } }
I20260811 18:52:25.939996 25629 ts_tablet_manager.cc:1428] T 2a20e784bae7400aa890ffbf25384c3e P ec5fe8c09449462caee2937483332ae9: Time spent starting tablet: real 0.014s user 0.011s sys 0.003s
W20260811 18:52:25.996850 25102 tablet.cc:2369] T 2a20e784bae7400aa890ffbf25384c3e P ec5fe8c09449462caee2937483332ae9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:52:26.013202 25355 tablet.cc:2369] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:52:26.033573 25589 tablet.cc:2369] T 2a20e784bae7400aa890ffbf25384c3e P 7da4786507ab4476bbc74ebb4ecaa349: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:52:26.065826 25634 raft_consensus.cc:482] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:52:26.066187 25634 raft_consensus.cc:504] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26db4449a0bd46bdb1d86efd3cf7a6cb" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 39359 } } peers { permanent_uuid: "7da4786507ab4476bbc74ebb4ecaa349" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 38737 } } peers { permanent_uuid: "ec5fe8c09449462caee2937483332ae9" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 40469 } }
I20260811 18:52:26.068032 25634 leader_election.cc:288] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7da4786507ab4476bbc74ebb4ecaa349 (127.25.25.3:38737), ec5fe8c09449462caee2937483332ae9 (127.25.25.1:40469)
I20260811 18:52:26.075485 25620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:26.068469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:37057 (local address 127.25.25.3:38737)
0811 18:52:26.068686 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:26.068692 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:26.069502 (+ 810us) server_negotiation.cc:407] Connection header received
0811 18:52:26.069707 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:26.069712 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:26.069778 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:26.069859 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:26.070622 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:26.071643 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:26.073631 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:26.074449 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:26.074578 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:26.074686 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:26.075103 (+ 417us) server_negotiation.cc:299] Negotiation successful
0811 18:52:26.075241 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 18:52:26.075570 25641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:26.068526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:38737 (local address 127.25.25.2:37057)
0811 18:52:26.069339 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:26.069355 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:26.069550 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:26.069899 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:26.069904 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:26.069931 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:26.070382 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:26.070447 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:26.071780 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:26.071786 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:26.073407 (+ 1621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:26.073423 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:26.074672 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:26.074679 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:26.074838 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:26.074905 (+ 67us) client_negotiation.cc:769] Sending connection context
0811 18:52:26.074992 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 18:52:26.075162 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":692,"mutex_wait_us":25,"spinlock_wait_cycles":22400,"thread_start_us":507,"threads_started":1}
I20260811 18:52:26.075567 25615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:26.068566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:40329 (local address 127.25.25.1:40469)
0811 18:52:26.068782 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:26.068786 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:26.069955 (+ 1169us) server_negotiation.cc:407] Connection header received
0811 18:52:26.070320 (+ 365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:26.070324 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:26.070422 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:26.070522 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:26.071179 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:26.071954 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:26.073793 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:26.074611 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:26.074744 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:26.074852 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:26.075191 (+ 339us) server_negotiation.cc:299] Negotiation successful
0811 18:52:26.075331 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 18:52:26.075682 25643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:26.068560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:40469 (local address 127.25.25.2:40329)
0811 18:52:26.069829 (+ 1269us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:26.069846 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:26.070103 (+ 257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:26.070558 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:26.070564 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:26.070594 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:26.070991 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:26.071005 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:26.072141 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:26.072147 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:26.073574 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:26.073588 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:26.074821 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:26.074828 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:26.075015 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:26.075057 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 18:52:26.075136 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 18:52:26.075269 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1155,"mutex_wait_us":1,"thread_start_us":939,"threads_started":1}
I20260811 18:52:26.076820 25012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a20e784bae7400aa890ffbf25384c3e" candidate_uuid: "26db4449a0bd46bdb1d86efd3cf7a6cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec5fe8c09449462caee2937483332ae9" is_pre_election: true
I20260811 18:52:26.077051 25504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a20e784bae7400aa890ffbf25384c3e" candidate_uuid: "26db4449a0bd46bdb1d86efd3cf7a6cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7da4786507ab4476bbc74ebb4ecaa349" is_pre_election: true
I20260811 18:52:26.077556 25012 raft_consensus.cc:2454] T 2a20e784bae7400aa890ffbf25384c3e P ec5fe8c09449462caee2937483332ae9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26db4449a0bd46bdb1d86efd3cf7a6cb in term 0.
I20260811 18:52:26.077561 25504 raft_consensus.cc:2454] T 2a20e784bae7400aa890ffbf25384c3e P 7da4786507ab4476bbc74ebb4ecaa349 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26db4449a0bd46bdb1d86efd3cf7a6cb in term 0.
I20260811 18:52:26.078430 25143 leader_election.cc:302] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 26db4449a0bd46bdb1d86efd3cf7a6cb, 7da4786507ab4476bbc74ebb4ecaa349, ec5fe8c09449462caee2937483332ae9; no voters:
I20260811 18:52:26.078866 25634 raft_consensus.cc:2781] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:52:26.079032 25634 raft_consensus.cc:482] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:52:26.079116 25634 raft_consensus.cc:3037] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:26.082381 25634 raft_consensus.cc:504] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26db4449a0bd46bdb1d86efd3cf7a6cb" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 39359 } } peers { permanent_uuid: "7da4786507ab4476bbc74ebb4ecaa349" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 38737 } } peers { permanent_uuid: "ec5fe8c09449462caee2937483332ae9" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 40469 } }
I20260811 18:52:26.083245 25634 leader_election.cc:288] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb [CANDIDATE]: Term 1 election: Requested vote from peers 7da4786507ab4476bbc74ebb4ecaa349 (127.25.25.3:38737), ec5fe8c09449462caee2937483332ae9 (127.25.25.1:40469)
I20260811 18:52:26.083981 25012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a20e784bae7400aa890ffbf25384c3e" candidate_uuid: "26db4449a0bd46bdb1d86efd3cf7a6cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec5fe8c09449462caee2937483332ae9"
I20260811 18:52:26.084033 25504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a20e784bae7400aa890ffbf25384c3e" candidate_uuid: "26db4449a0bd46bdb1d86efd3cf7a6cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7da4786507ab4476bbc74ebb4ecaa349"
I20260811 18:52:26.084245 25012 raft_consensus.cc:3037] T 2a20e784bae7400aa890ffbf25384c3e P ec5fe8c09449462caee2937483332ae9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:26.084316 25504 raft_consensus.cc:3037] T 2a20e784bae7400aa890ffbf25384c3e P 7da4786507ab4476bbc74ebb4ecaa349 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:26.086874 25012 raft_consensus.cc:2454] T 2a20e784bae7400aa890ffbf25384c3e P ec5fe8c09449462caee2937483332ae9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26db4449a0bd46bdb1d86efd3cf7a6cb in term 1.
I20260811 18:52:26.087577 25143 leader_election.cc:302] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26db4449a0bd46bdb1d86efd3cf7a6cb, ec5fe8c09449462caee2937483332ae9; no voters:
I20260811 18:52:26.087720 25504 raft_consensus.cc:2454] T 2a20e784bae7400aa890ffbf25384c3e P 7da4786507ab4476bbc74ebb4ecaa349 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26db4449a0bd46bdb1d86efd3cf7a6cb in term 1.
I20260811 18:52:26.087981 25634 raft_consensus.cc:2781] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:26.088624 25634 raft_consensus.cc:686] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb [term 1 LEADER]: Becoming Leader. State: Replica: 26db4449a0bd46bdb1d86efd3cf7a6cb, State: Running, Role: LEADER
I20260811 18:52:26.089298 25634 consensus_queue.cc:237] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26db4449a0bd46bdb1d86efd3cf7a6cb" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 39359 } } peers { permanent_uuid: "7da4786507ab4476bbc74ebb4ecaa349" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 38737 } } peers { permanent_uuid: "ec5fe8c09449462caee2937483332ae9" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 40469 } }
I20260811 18:52:26.095005 24779 catalog_manager.cc:5495] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 26db4449a0bd46bdb1d86efd3cf7a6cb (127.25.25.2). New cstate: current_term: 1 leader_uuid: "26db4449a0bd46bdb1d86efd3cf7a6cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26db4449a0bd46bdb1d86efd3cf7a6cb" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 39359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7da4786507ab4476bbc74ebb4ecaa349" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 38737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec5fe8c09449462caee2937483332ae9" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 40469 } health_report { overall_health: UNKNOWN } } }
I20260811 18:52:26.130548 25611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:26.124630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40750 (local address 127.25.25.2:39359)
0811 18:52:26.124898 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:26.124903 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:26.124925 (+ 22us) server_negotiation.cc:407] Connection header received
0811 18:52:26.125106 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:26.125110 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:26.125213 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:26.125374 (+ 161us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:52:26.125766 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:26.126551 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:26.128311 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:26.128768 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:26.128897 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:26.129368 (+ 471us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:52:26.129969 (+ 601us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:52:26.130078 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:26.130179 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 18:52:26.130255 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 18:52:26.139817 25012 raft_consensus.cc:1261] T 2a20e784bae7400aa890ffbf25384c3e P ec5fe8c09449462caee2937483332ae9 [term 1 FOLLOWER]: Refusing update from remote peer 26db4449a0bd46bdb1d86efd3cf7a6cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:26.139817 25504 raft_consensus.cc:1261] T 2a20e784bae7400aa890ffbf25384c3e P 7da4786507ab4476bbc74ebb4ecaa349 [term 1 FOLLOWER]: Refusing update from remote peer 26db4449a0bd46bdb1d86efd3cf7a6cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:26.141192 25634 consensus_queue.cc:1035] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7da4786507ab4476bbc74ebb4ecaa349" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 38737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:52:26.141633 25645 consensus_queue.cc:1035] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec5fe8c09449462caee2937483332ae9" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 40469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:52:26.153982 25650 mvcc.cc:205] Tried to move back new op lower bound from 7317398921775828992 to 7317398921586499584. Current Snapshot: MvccSnapshot[applied={T|T < 7317398921775828992}]
I20260811 18:52:26.155527 25653 mvcc.cc:205] Tried to move back new op lower bound from 7317398921775828992 to 7317398921586499584. Current Snapshot: MvccSnapshot[applied={T|T < 7317398921775828992}]
I20260811 18:52:26.158823 25652 mvcc.cc:205] Tried to move back new op lower bound from 7317398921775828992 to 7317398921586499584. Current Snapshot: MvccSnapshot[applied={T|T < 7317398921775828992}]
I20260811 18:52:26.174877 24779 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33208:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:52:26.175168 24779 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33208:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:52:26.179232 24779 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2c7a30a578bd45679e950651915e3730: Sending DeleteTablet for 3 replicas of tablet 2a20e784bae7400aa890ffbf25384c3e
I20260811 18:52:26.180763 24973 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a20e784bae7400aa890ffbf25384c3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:26 UTC) from {username='slave'} at 127.0.0.1:35232
I20260811 18:52:26.180927 25242 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a20e784bae7400aa890ffbf25384c3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:26 UTC) from {username='slave'} at 127.0.0.1:40742
I20260811 18:52:26.181813 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 24884
I20260811 18:52:26.182025 25465 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a20e784bae7400aa890ffbf25384c3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:26 UTC) from {username='slave'} at 127.0.0.1:46594
I20260811 18:52:26.192813 25671 tablet_replica.cc:330] T 2a20e784bae7400aa890ffbf25384c3e P 7da4786507ab4476bbc74ebb4ecaa349: stopping tablet replica
I20260811 18:52:26.193459 25671 raft_consensus.cc:2229] T 2a20e784bae7400aa890ffbf25384c3e P 7da4786507ab4476bbc74ebb4ecaa349 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:52:26.195099 25671 raft_consensus.cc:2258] T 2a20e784bae7400aa890ffbf25384c3e P 7da4786507ab4476bbc74ebb4ecaa349 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:26.198027 25671 ts_tablet_manager.cc:1905] T 2a20e784bae7400aa890ffbf25384c3e P 7da4786507ab4476bbc74ebb4ecaa349: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:26.198094 25668 tablet_replica.cc:330] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb: stopping tablet replica
I20260811 18:52:26.198730 25668 raft_consensus.cc:2229] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:52:26.199950 25668 raft_consensus.cc:2258] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:26.202500 25668 ts_tablet_manager.cc:1905] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:26.205078 25667 tablet_replica.cc:330] T 2a20e784bae7400aa890ffbf25384c3e P ec5fe8c09449462caee2937483332ae9: stopping tablet replica
I20260811 18:52:26.206115 25671 ts_tablet_manager.cc:1918] T 2a20e784bae7400aa890ffbf25384c3e P 7da4786507ab4476bbc74ebb4ecaa349: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:52:26.206316 25671 log.cc:1196] T 2a20e784bae7400aa890ffbf25384c3e P 7da4786507ab4476bbc74ebb4ecaa349: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-2/wal/wals/2a20e784bae7400aa890ffbf25384c3e
I20260811 18:52:26.206882 25671 ts_tablet_manager.cc:1939] T 2a20e784bae7400aa890ffbf25384c3e P 7da4786507ab4476bbc74ebb4ecaa349: Deleting consensus metadata
I20260811 18:52:26.208328 25615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:26.183246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35248 (local address 127.25.25.1:40469)
0811 18:52:26.183467 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:26.183475 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:26.194544 (+ 11069us) server_negotiation.cc:407] Connection header received
0811 18:52:26.194878 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:26.194884 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:26.195019 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:26.195138 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:26.195870 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:26.197111 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:26.199132 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:26.199896 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:26.200021 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:26.206032 (+ 6011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:26.206049 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:26.206070 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:26.206982 (+ 912us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:26.207061 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:26.207098 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:26.207210 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:26.207718 (+ 508us) server_negotiation.cc:299] Negotiation successful
0811 18:52:26.207876 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 18:52:26.208353 25667 raft_consensus.cc:2229] T 2a20e784bae7400aa890ffbf25384c3e P ec5fe8c09449462caee2937483332ae9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:52:26.209075 24755 catalog_manager.cc:4841] TS 7da4786507ab4476bbc74ebb4ecaa349 (127.25.25.3:38737): tablet 2a20e784bae7400aa890ffbf25384c3e (table test-table [id=5391035ad25c412da35c6d92ad8f8153]) successfully deleted
I20260811 18:52:26.209460 25667 raft_consensus.cc:2258] T 2a20e784bae7400aa890ffbf25384c3e P ec5fe8c09449462caee2937483332ae9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:26.209965 25091 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:26.213088 25668 ts_tablet_manager.cc:1918] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:52:26.213320 25668 log.cc:1196] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474012733352-25700-0/minicluster-data/ts-1/wal/wals/2a20e784bae7400aa890ffbf25384c3e
I20260811 18:52:26.213943 25668 ts_tablet_manager.cc:1939] T 2a20e784bae7400aa890ffbf25384c3e P 26db4449a0bd46bdb1d86efd3cf7a6cb: Deleting consensus metadata
I20260811 18:52:26.215608 24755 catalog_manager.cc:4841] TS 26db4449a0bd46bdb1d86efd3cf7a6cb (127.25.25.2:39359): tablet 2a20e784bae7400aa890ffbf25384c3e (table test-table [id=5391035ad25c412da35c6d92ad8f8153]) successfully deleted
I20260811 18:52:26.362986 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 24884
W20260811 18:52:26.393738 24754 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.25.1:40469 (error 108)
I20260811 18:52:26.393957 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 25105
I20260811 18:52:26.396652 25679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:26.395501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:40469 (local address 127.0.0.1:35252)
0811 18:52:26.396306 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:26.396451 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:40469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":421,"threads_started":1}
W20260811 18:52:26.397032 24754 catalog_manager.cc:4584] TS ec5fe8c09449462caee2937483332ae9 (127.25.25.1:40469): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2a20e784bae7400aa890ffbf25384c3e: Network error: Client connection negotiation failed: client connection to 127.25.25.1:40469: connect: Connection refused (error 111)
I20260811 18:52:26.402741 25611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:26.394823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40760 (local address 127.25.25.2:39359)
0811 18:52:26.395061 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:26.395068 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:26.395117 (+ 49us) server_negotiation.cc:407] Connection header received
0811 18:52:26.395349 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:26.395356 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:26.395521 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:26.395650 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:26.396187 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:26.397430 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:26.398851 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:26.399605 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:26.399745 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:26.400976 (+ 1231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:26.400990 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:26.401011 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:26.401860 (+ 849us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:26.401932 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:26.401961 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:26.402087 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:26.402198 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 18:52:26.402333 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 18:52:26.403573 25346 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:26.450996 25679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:26.450406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:40469 (local address 127.0.0.1:35256)
0811 18:52:26.450672 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:26.450792 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:40469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260811 18:52:26.452314 25679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:26.451801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:40469 (local address 127.0.0.1:35270)
0811 18:52:26.451978 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:26.452126 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:40469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 18:52:26.513087 25679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:26.512491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:40469 (local address 127.0.0.1:35284)
0811 18:52:26.512769 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:26.512895 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:40469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260811 18:52:26.514350 25679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:26.513837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:40469 (local address 127.0.0.1:35292)
0811 18:52:26.514033 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:26.514133 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:40469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260811 18:52:26.521848 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 25105
I20260811 18:52:26.553306 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 25359
I20260811 18:52:26.560663 25620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:26.554251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46604 (local address 127.25.25.3:38737)
0811 18:52:26.554490 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:26.554495 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:26.554517 (+ 22us) server_negotiation.cc:407] Connection header received
0811 18:52:26.554612 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:26.554616 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:26.554707 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:26.554804 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:26.555235 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:26.556012 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:26.557532 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:26.557961 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:26.558067 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:26.559178 (+ 1111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:26.559189 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:26.559206 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:26.559828 (+ 622us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:26.559889 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:26.559913 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:26.560008 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:26.560246 (+ 238us) server_negotiation.cc:299] Negotiation successful
0811 18:52:26.560346 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 18:52:26.561455 25577 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:26.595244 25679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:26.594660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:40469 (local address 127.0.0.1:35298)
0811 18:52:26.594965 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:26.595096 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:40469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260811 18:52:26.596503 25679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:26.596004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:40469 (local address 127.0.0.1:35314)
0811 18:52:26.596237 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:26.596320 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:40469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
I20260811 18:52:26.652908 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 25359
I20260811 18:52:26.676275 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 24721
I20260811 18:52:26.677677 24832 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:26.790395 25679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:26.789641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:40469 (local address 127.0.0.1:35316)
0811 18:52:26.790052 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:26.790207 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:40469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260811 18:52:26.790706 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 24721
2026-08-11T18:52:26Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3307 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:52:26 dist-test-slave-lgr5 krb5kdc[25694](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:52:26 dist-test-slave-lgr5 krb5kdc[25694](info): set up 2 sockets
Aug 11 18:52:26 dist-test-slave-lgr5 krb5kdc[25694](info): commencing operation
krb5kdc: starting...
W20260811 18:52:28.132843 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.290s user 0.000s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:52:28 dist-test-slave-lgr5 krb5kdc[25694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474348, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:52:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:52:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:52:28.473587 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:42203
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:38103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:42203
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:28.854640 25729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:28.855003 25729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:28.855173 25729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:28.863111 25729 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:52:28.863268 25729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:28.863371 25729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:28.863466 25729 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:52:28.863529 25729 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:52:28.874563 25729 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:38103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:42203
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:42203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:28.876166 25729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:28.877704 25729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:28.890532 25737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:28.890597 25738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:28.891180 25743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:28.892354 25729 server_base.cc:1034] running on GCE node
I20260811 18:52:28.893224 25729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:28.894773 25729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:28.895982 25729 hybrid_clock.cc:648] HybridClock initialized: now 1786474348895931 us; error 49 us; skew 500 ppm
I20260811 18:52:28.896373 25729 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:52:28 dist-test-slave-lgr5 krb5kdc[25694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474348, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:28.899664 25729 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:52:28.901381 25729 webserver.cc:460] Webserver started at http://127.25.25.62:38719/ using document root <none> and password file <none>
I20260811 18:52:28.902148 25729 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:28.902276 25729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:28.902612 25729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:28.906427 25729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "6aa63157836a4658aa7505d1363212d1"
format_stamp: "Formatted at 2026-08-11 18:52:28 on dist-test-slave-lgr5"
server_key: "ee9320ae609d1989360c60442b2dd5ec"
server_key_iv: "9175ea9ed6c9f55d24bdf1cbbbaa8d30"
server_key_version: "encryptionkey@0"
I20260811 18:52:28.907490 25729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "6aa63157836a4658aa7505d1363212d1"
format_stamp: "Formatted at 2026-08-11 18:52:28 on dist-test-slave-lgr5"
server_key: "ee9320ae609d1989360c60442b2dd5ec"
server_key_iv: "9175ea9ed6c9f55d24bdf1cbbbaa8d30"
server_key_version: "encryptionkey@0"
I20260811 18:52:28.913918 25729 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.007s
I20260811 18:52:28.918001 25757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:28.919559 25729 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 18:52:28.919762 25729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "6aa63157836a4658aa7505d1363212d1"
format_stamp: "Formatted at 2026-08-11 18:52:28 on dist-test-slave-lgr5"
server_key: "ee9320ae609d1989360c60442b2dd5ec"
server_key_iv: "9175ea9ed6c9f55d24bdf1cbbbaa8d30"
server_key_version: "encryptionkey@0"
I20260811 18:52:28.920003 25729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:28.939776 25729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:28.944506 25729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:28.944810 25729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:28.964766 25729 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:42203
I20260811 18:52:28.964849 25837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:42203 every 8 connection(s)
I20260811 18:52:28.966325 25729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:52:28.969636 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 25729
I20260811 18:52:28.969835 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:52:28.970294 25700 external_mini_cluster.cc:1428] Setting key c4b90a844ab733a31c264a6e0107ffc6
I20260811 18:52:28.970840 25839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:28.984861 25839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6aa63157836a4658aa7505d1363212d1: Bootstrap starting.
Aug 11 18:52:28 dist-test-slave-lgr5 krb5kdc[25694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474348, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:52:28.989184 25839 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6aa63157836a4658aa7505d1363212d1: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:28.990674 25839 log.cc:824] T 00000000000000000000000000000000 P 6aa63157836a4658aa7505d1363212d1: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:28.994196 25839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6aa63157836a4658aa7505d1363212d1: No bootstrap required, opened a new log
I20260811 18:52:28.996619 25845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:28.972298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54888 (local address 127.25.25.62:42203)
0811 18:52:28.973214 (+ 916us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:28.973233 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:28.973594 (+ 361us) server_negotiation.cc:407] Connection header received
0811 18:52:28.976362 (+ 2768us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:28.976393 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:28.976904 (+ 511us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:28.977338 (+ 434us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:28.979044 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:28.980484 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:28.982015 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:28.982812 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:28.983011 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:28.988274 (+ 5263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:28.988284 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:28.988302 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:28.988353 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:28.991913 (+ 3560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:28.992830 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:28.992839 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:28.992847 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:28.993049 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:28.993503 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:28.993507 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:28.993510 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:28.994114 (+ 604us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:28.994437 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:28.994992 (+ 555us) server_negotiation.cc:299] Negotiation successful
0811 18:52:28.995450 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":642,"thread_start_us":385,"threads_started":1}
I20260811 18:52:29.003696 25839 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6aa63157836a4658aa7505d1363212d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6aa63157836a4658aa7505d1363212d1" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42203 } }
I20260811 18:52:29.004259 25839 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6aa63157836a4658aa7505d1363212d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:29.004384 25839 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6aa63157836a4658aa7505d1363212d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aa63157836a4658aa7505d1363212d1, State: Initialized, Role: FOLLOWER
I20260811 18:52:29.005095 25839 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6aa63157836a4658aa7505d1363212d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6aa63157836a4658aa7505d1363212d1" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42203 } }
I20260811 18:52:29.005373 25839 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6aa63157836a4658aa7505d1363212d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:52:29.005537 25839 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6aa63157836a4658aa7505d1363212d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:52:29.005739 25839 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6aa63157836a4658aa7505d1363212d1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:29.008661 25839 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6aa63157836a4658aa7505d1363212d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6aa63157836a4658aa7505d1363212d1" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42203 } }
I20260811 18:52:29.009292 25839 leader_election.cc:302] T 00000000000000000000000000000000 P 6aa63157836a4658aa7505d1363212d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6aa63157836a4658aa7505d1363212d1; no voters:
I20260811 18:52:29.009989 25839 leader_election.cc:288] T 00000000000000000000000000000000 P 6aa63157836a4658aa7505d1363212d1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:52:29.010135 25850 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6aa63157836a4658aa7505d1363212d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:29.010890 25850 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6aa63157836a4658aa7505d1363212d1 [term 1 LEADER]: Becoming Leader. State: Replica: 6aa63157836a4658aa7505d1363212d1, State: Running, Role: LEADER
I20260811 18:52:29.011483 25850 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6aa63157836a4658aa7505d1363212d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6aa63157836a4658aa7505d1363212d1" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42203 } }
I20260811 18:52:29.012538 25839 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6aa63157836a4658aa7505d1363212d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:52:29.014636 25854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6aa63157836a4658aa7505d1363212d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6aa63157836a4658aa7505d1363212d1. Latest consensus state: current_term: 1 leader_uuid: "6aa63157836a4658aa7505d1363212d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6aa63157836a4658aa7505d1363212d1" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42203 } } }
I20260811 18:52:29.014628 25853 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6aa63157836a4658aa7505d1363212d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6aa63157836a4658aa7505d1363212d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6aa63157836a4658aa7505d1363212d1" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 42203 } } }
I20260811 18:52:29.015121 25854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6aa63157836a4658aa7505d1363212d1 [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:29.016980 25853 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6aa63157836a4658aa7505d1363212d1 [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:29.030153 25859 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:52:29.035039 25859 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:52:29.045300 25859 catalog_manager.cc:1347] Generated new cluster ID: 576c00b0c8d84661b240b8d7f450538e
I20260811 18:52:29.045441 25859 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:52:29.077755 25859 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:52:29.079216 25859 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:52:29.088984 25859 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6aa63157836a4658aa7505d1363212d1: Generated new TSK 0
I20260811 18:52:29.089917 25859 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.25.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
I20260811 18:52:29.168768 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:0
--local_ip_for_outbound_sockets=127.25.25.1
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:42203
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:38103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:29.549077 25884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:29.549422 25884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:29.549530 25884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:29.557358 25884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:29.557512 25884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:29.557637 25884 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:52:29.569226 25884 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:38103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:42203
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:29.571009 25884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:29.572747 25884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:29.587261 25894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:29.587225 25897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:29.587335 25902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:29.588333 25884 server_base.cc:1034] running on GCE node
I20260811 18:52:29.589080 25884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:29.590161 25884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:29.591392 25884 hybrid_clock.cc:648] HybridClock initialized: now 1786474349591322 us; error 65 us; skew 500 ppm
I20260811 18:52:29.591764 25884 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:52:29 dist-test-slave-lgr5 krb5kdc[25694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474349, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:29.595161 25884 init.cc:377] Logged in from keytab as kudu/127.25.25.1@KRBTEST.COM (short username kudu)
I20260811 18:52:29.596786 25884 webserver.cc:460] Webserver started at http://127.25.25.1:36611/ using document root <none> and password file <none>
I20260811 18:52:29.597545 25884 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:29.597674 25884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:29.598008 25884 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:29.601275 25884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-0/data/instance:
uuid: "1ae089d41f734a28b426e42ea09c3c10"
format_stamp: "Formatted at 2026-08-11 18:52:29 on dist-test-slave-lgr5"
server_key: "553a81715a238fa1ebe3a58d9639b691"
server_key_iv: "501d0bfa3486c77cecea7dbd944f0ebb"
server_key_version: "encryptionkey@0"
I20260811 18:52:29.602131 25884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance:
uuid: "1ae089d41f734a28b426e42ea09c3c10"
format_stamp: "Formatted at 2026-08-11 18:52:29 on dist-test-slave-lgr5"
server_key: "553a81715a238fa1ebe3a58d9639b691"
server_key_iv: "501d0bfa3486c77cecea7dbd944f0ebb"
server_key_version: "encryptionkey@0"
I20260811 18:52:29.607960 25884 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 18:52:29.612366 25913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:29.614231 25884 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260811 18:52:29.614449 25884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "1ae089d41f734a28b426e42ea09c3c10"
format_stamp: "Formatted at 2026-08-11 18:52:29 on dist-test-slave-lgr5"
server_key: "553a81715a238fa1ebe3a58d9639b691"
server_key_iv: "501d0bfa3486c77cecea7dbd944f0ebb"
server_key_version: "encryptionkey@0"
I20260811 18:52:29.614677 25884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:29.653630 25884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:29.658815 25884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:29.659157 25884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:29.660392 25884 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:29.662030 25884 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:29.662129 25884 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:29.662289 25884 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:29.662356 25884 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:29.697784 25884 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:45401
I20260811 18:52:29.697816 26099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:45401 every 8 connection(s)
I20260811 18:52:29.699339 25884 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:52:29.704875 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 25884
I20260811 18:52:29.705049 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance
I20260811 18:52:29.705538 25700 external_mini_cluster.cc:1428] Setting key 7f10ab5b7009a58bc1c98fa7bc139cbb
Aug 11 18:52:29 dist-test-slave-lgr5 krb5kdc[25694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474349, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:52:29.723788 26102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:29.702184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:35937 (local address 127.25.25.62:42203)
0811 18:52:29.702690 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:29.702697 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:29.703909 (+ 1212us) server_negotiation.cc:407] Connection header received
0811 18:52:29.706292 (+ 2383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:29.706298 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:29.706399 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:29.706525 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:29.708832 (+ 2307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:29.709862 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:29.711671 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:29.712266 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:29.712411 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:29.716775 (+ 4364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:29.716783 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:29.716787 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:29.716834 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:29.720165 (+ 3331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:29.721112 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:29.721118 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:29.721122 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:29.721280 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:29.721749 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:29.721754 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:29.721756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:29.722096 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:29.722240 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:29.723128 (+ 888us) server_negotiation.cc:299] Negotiation successful
0811 18:52:29.723391 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":258,"threads_started":1}
I20260811 18:52:29.725230 26105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:29.702817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42203 (local address 127.25.25.1:35937)
0811 18:52:29.703690 (+ 873us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:29.703751 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:29.705899 (+ 2148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:29.706912 (+ 1013us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:29.706927 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:29.707834 (+ 907us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:29.708619 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:29.708643 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:29.710076 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:29.710080 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:29.711488 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:29.711504 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:29.712573 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:29.712579 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:29.712878 (+ 299us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:29.713670 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:29.713706 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:29.716457 (+ 2751us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:29.720363 (+ 3906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:29.720373 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:29.720387 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:29.720930 (+ 543us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:29.721394 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:29.721397 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:29.721400 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:29.721617 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:29.722244 (+ 627us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:29.722253 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:29.722668 (+ 415us) client_negotiation.cc:769] Sending connection context
0811 18:52:29.722983 (+ 315us) client_negotiation.cc:240] Negotiation successful
0811 18:52:29.723609 (+ 626us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":349,"threads_started":1}
I20260811 18:52:29.726979 26100 heartbeater.cc:347] Connected to a master server at 127.25.25.62:42203
I20260811 18:52:29.727288 26100 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:29.728108 26100 heartbeater.cc:511] Master 127.25.25.62:42203 requested a full tablet report, sending...
I20260811 18:52:29.730360 25786 ts_manager.cc:194] Registered new tserver with Master: 1ae089d41f734a28b426e42ea09c3c10 (127.25.25.1:45401)
I20260811 18:52:29.731878 25786 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.1@KRBTEST.COM'} at 127.25.25.1:35937
WARNING: no policy specified for kudu/127.25.25.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
I20260811 18:52:29.779922 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:0
--local_ip_for_outbound_sockets=127.25.25.2
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:42203
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:38103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:30.144850 26112 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:30.145212 26112 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:30.145381 26112 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:30.153174 26112 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:30.153344 26112 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:30.153522 26112 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:52:30.164361 26112 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:38103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:42203
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:30.166061 26112 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:30.167591 26112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:30.182513 26126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:30.182789 26129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:30.183024 26124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:30.183703 26112 server_base.cc:1034] running on GCE node
I20260811 18:52:30.184499 26112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:30.185624 26112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:30.186883 26112 hybrid_clock.cc:648] HybridClock initialized: now 1786474350186784 us; error 90 us; skew 500 ppm
I20260811 18:52:30.187270 26112 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:52:30 dist-test-slave-lgr5 krb5kdc[25694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474350, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:30.190956 26112 init.cc:377] Logged in from keytab as kudu/127.25.25.2@KRBTEST.COM (short username kudu)
I20260811 18:52:30.192797 26112 webserver.cc:460] Webserver started at http://127.25.25.2:41759/ using document root <none> and password file <none>
I20260811 18:52:30.193562 26112 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:30.193697 26112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:30.194075 26112 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:30.197558 26112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-1/data/instance:
uuid: "e068758051d04c9db7975cf26fa759d1"
format_stamp: "Formatted at 2026-08-11 18:52:30 on dist-test-slave-lgr5"
server_key: "07bf38c94ff7f999996b9829b0b74876"
server_key_iv: "b5aa964d64daac6e84c64fe22cb484e7"
server_key_version: "encryptionkey@0"
I20260811 18:52:30.198472 26112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance:
uuid: "e068758051d04c9db7975cf26fa759d1"
format_stamp: "Formatted at 2026-08-11 18:52:30 on dist-test-slave-lgr5"
server_key: "07bf38c94ff7f999996b9829b0b74876"
server_key_iv: "b5aa964d64daac6e84c64fe22cb484e7"
server_key_version: "encryptionkey@0"
I20260811 18:52:30.204653 26112 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 18:52:30.208477 26137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:30.209960 26112 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 18:52:30.210147 26112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "e068758051d04c9db7975cf26fa759d1"
format_stamp: "Formatted at 2026-08-11 18:52:30 on dist-test-slave-lgr5"
server_key: "07bf38c94ff7f999996b9829b0b74876"
server_key_iv: "b5aa964d64daac6e84c64fe22cb484e7"
server_key_version: "encryptionkey@0"
I20260811 18:52:30.210376 26112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:30.237082 26112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:30.241977 26112 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:30.242293 26112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:30.243417 26112 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:30.244994 26112 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:30.245081 26112 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:30.245214 26112 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:30.245270 26112 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:30.281932 26112 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:43779
I20260811 18:52:30.282006 26319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:43779 every 8 connection(s)
I20260811 18:52:30.283530 26112 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:52:30.283849 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 26112
I20260811 18:52:30.284067 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance
I20260811 18:52:30.284813 25700 external_mini_cluster.cc:1428] Setting key 2d9512e365ddd3b3b341b2039a9d625c
Aug 11 18:52:30 dist-test-slave-lgr5 krb5kdc[25694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474350, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:52:30.308178 26325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:30.287087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:46401 (local address 127.25.25.62:42203)
0811 18:52:30.287670 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:30.287677 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:30.289054 (+ 1377us) server_negotiation.cc:407] Connection header received
0811 18:52:30.291290 (+ 2236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:30.291296 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:30.291392 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:30.291524 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:30.293510 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:30.294491 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:30.296311 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:30.296943 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:30.297080 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:30.301369 (+ 4289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:30.301377 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:30.301382 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:30.301432 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:30.304733 (+ 3301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:30.305587 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:30.305592 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:30.305595 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:30.305750 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:30.306185 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:30.306189 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:30.306192 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:30.306570 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:30.306739 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:30.307516 (+ 777us) server_negotiation.cc:299] Negotiation successful
0811 18:52:30.307749 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":334,"threads_started":1}
I20260811 18:52:30.309152 26327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:30.287801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42203 (local address 127.25.25.2:46401)
0811 18:52:30.288826 (+ 1025us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:30.288884 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:30.290923 (+ 2039us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:30.291832 (+ 909us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:30.291843 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:30.292582 (+ 739us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:30.293262 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:30.293283 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:30.294690 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:30.294695 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:30.296063 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:30.296118 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:30.297204 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:30.297210 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:30.297435 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:30.298182 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:30.298211 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:30.301066 (+ 2855us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:30.304916 (+ 3850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:30.304924 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:30.304959 (+ 35us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:30.305432 (+ 473us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:30.305844 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:30.305847 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:30.305850 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:30.306065 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:30.306725 (+ 660us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:30.306732 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:30.307107 (+ 375us) client_negotiation.cc:769] Sending connection context
0811 18:52:30.307355 (+ 248us) client_negotiation.cc:240] Negotiation successful
0811 18:52:30.307784 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":687,"thread_start_us":434,"threads_started":1}
I20260811 18:52:30.310704 26322 heartbeater.cc:347] Connected to a master server at 127.25.25.62:42203
I20260811 18:52:30.311033 26322 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:30.311769 26322 heartbeater.cc:511] Master 127.25.25.62:42203 requested a full tablet report, sending...
I20260811 18:52:30.313473 25786 ts_manager.cc:194] Registered new tserver with Master: e068758051d04c9db7975cf26fa759d1 (127.25.25.2:43779)
I20260811 18:52:30.314638 25786 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.2@KRBTEST.COM'} at 127.25.25.2:46401
WARNING: no policy specified for kudu/127.25.25.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
I20260811 18:52:30.360596 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:0
--local_ip_for_outbound_sockets=127.25.25.3
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:42203
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:38103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:30.720404 26330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:30.720726 26330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:30.720860 26330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:30.728807 26330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:30.728948 26330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:30.729097 26330 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:52:30.735157 26100 heartbeater.cc:503] Master 127.25.25.62:42203 was elected leader, sending a full tablet report...
I20260811 18:52:30.739866 26330 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:38103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:42203
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:30.741329 26330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:30.742791 26330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:30.756762 26336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:30.756726 26337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:30.756812 26340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:30.758049 26330 server_base.cc:1034] running on GCE node
I20260811 18:52:30.758693 26330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:30.759697 26330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:30.760927 26330 hybrid_clock.cc:648] HybridClock initialized: now 1786474350760857 us; error 48 us; skew 500 ppm
I20260811 18:52:30.761255 26330 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:52:30 dist-test-slave-lgr5 krb5kdc[25694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474350, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:30.764516 26330 init.cc:377] Logged in from keytab as kudu/127.25.25.3@KRBTEST.COM (short username kudu)
I20260811 18:52:30.766141 26330 webserver.cc:460] Webserver started at http://127.25.25.3:39971/ using document root <none> and password file <none>
I20260811 18:52:30.766892 26330 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:30.767035 26330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:30.767381 26330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:30.770700 26330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-2/data/instance:
uuid: "1c002e40fe5a4e48afa2cd7303c389f8"
format_stamp: "Formatted at 2026-08-11 18:52:30 on dist-test-slave-lgr5"
server_key: "4e0a6807bd38822bf6fd3acd150d3572"
server_key_iv: "cf8536ac75cd25751f48ce4aadba9100"
server_key_version: "encryptionkey@0"
I20260811 18:52:30.771564 26330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance:
uuid: "1c002e40fe5a4e48afa2cd7303c389f8"
format_stamp: "Formatted at 2026-08-11 18:52:30 on dist-test-slave-lgr5"
server_key: "4e0a6807bd38822bf6fd3acd150d3572"
server_key_iv: "cf8536ac75cd25751f48ce4aadba9100"
server_key_version: "encryptionkey@0"
I20260811 18:52:30.777529 26330 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 18:52:30.781473 26365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:30.783061 26330 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:52:30.783262 26330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "1c002e40fe5a4e48afa2cd7303c389f8"
format_stamp: "Formatted at 2026-08-11 18:52:30 on dist-test-slave-lgr5"
server_key: "4e0a6807bd38822bf6fd3acd150d3572"
server_key_iv: "cf8536ac75cd25751f48ce4aadba9100"
server_key_version: "encryptionkey@0"
I20260811 18:52:30.783540 26330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:30.799492 26330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:30.804006 26330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:30.804328 26330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:30.805385 26330 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:30.806824 26330 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:30.806900 26330 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:30.807003 26330 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:30.807050 26330 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:30.842482 26330 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:39247
I20260811 18:52:30.842531 26554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:39247 every 8 connection(s)
I20260811 18:52:30.844008 26330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:52:30.854508 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 26330
I20260811 18:52:30.854712 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance
I20260811 18:52:30.855324 25700 external_mini_cluster.cc:1428] Setting key 6420422d9712a801dcd710e73f271f58
Aug 11 18:52:30 dist-test-slave-lgr5 krb5kdc[25694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474350, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:52:30.869750 26558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:30.847196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:49379 (local address 127.25.25.62:42203)
0811 18:52:30.847799 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:30.847804 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:30.849070 (+ 1266us) server_negotiation.cc:407] Connection header received
0811 18:52:30.851305 (+ 2235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:30.851310 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:30.851404 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:30.851523 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:30.853614 (+ 2091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:30.854695 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:30.857205 (+ 2510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:30.857828 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:30.857975 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:30.862353 (+ 4378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:30.862361 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:30.862364 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:30.862413 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:30.865752 (+ 3339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:30.866771 (+ 1019us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:30.866776 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:30.866779 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:30.866956 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:30.867615 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:30.867621 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:30.867623 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:30.867970 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:30.868160 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:30.869117 (+ 957us) server_negotiation.cc:299] Negotiation successful
0811 18:52:30.869338 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":301,"threads_started":1}
I20260811 18:52:30.870946 26559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:30.847827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:42203 (local address 127.25.25.3:49379)
0811 18:52:30.848834 (+ 1007us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:30.848884 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:30.850887 (+ 2003us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:30.851850 (+ 963us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:30.851861 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:30.852618 (+ 757us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:30.853344 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:30.853367 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:30.855009 (+ 1642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:30.855017 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:30.857011 (+ 1994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:30.857033 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:30.858118 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:30.858125 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:30.858376 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:30.859170 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:30.859198 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:30.861915 (+ 2717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:30.866009 (+ 4094us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:30.866020 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:30.866037 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:30.866578 (+ 541us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:30.867109 (+ 531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:30.867113 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:30.867121 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:30.867374 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:30.868180 (+ 806us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:30.868187 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:30.868631 (+ 444us) client_negotiation.cc:769] Sending connection context
0811 18:52:30.868917 (+ 286us) client_negotiation.cc:240] Negotiation successful
0811 18:52:30.869530 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":688,"thread_start_us":420,"threads_started":1}
I20260811 18:52:30.872612 26556 heartbeater.cc:347] Connected to a master server at 127.25.25.62:42203
I20260811 18:52:30.872947 26556 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:30.873795 26556 heartbeater.cc:511] Master 127.25.25.62:42203 requested a full tablet report, sending...
I20260811 18:52:30.875613 25786 ts_manager.cc:194] Registered new tserver with Master: 1c002e40fe5a4e48afa2cd7303c389f8 (127.25.25.3:39247)
I20260811 18:52:30.876580 25786 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.3@KRBTEST.COM'} at 127.25.25.3:49379
I20260811 18:52:30.885180 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:52:30.905447 26558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:30.889905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52818 (local address 127.25.25.62:42203)
0811 18:52:30.890080 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:30.890085 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:30.890418 (+ 333us) server_negotiation.cc:407] Connection header received
0811 18:52:30.890643 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:30.890648 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:30.890725 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:30.890838 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:30.892501 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:30.893358 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:30.894929 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:30.895402 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:30.895564 (+ 162us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:30.898766 (+ 3202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:30.898773 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:30.898778 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:30.898840 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:30.902020 (+ 3180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:30.903012 (+ 992us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:30.903016 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:30.903019 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:30.903153 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:30.903769 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:30.903775 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:30.903780 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:30.904283 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:30.904541 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:30.904940 (+ 399us) server_negotiation.cc:299] Negotiation successful
0811 18:52:30.905130 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 18:52:30.909981 25786 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52818:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:52:30.917387 25786 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:52:30.941637 26573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:30.931443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:39247 (local address 127.0.0.1:46522)
0811 18:52:30.932975 (+ 1532us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:30.932994 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:30.933107 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:30.933914 (+ 807us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:30.933920 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:30.933973 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:30.934429 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:30.934454 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:30.936753 (+ 2299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:30.936758 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:30.938914 (+ 2156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:30.938927 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:30.940474 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:30.940481 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:30.940694 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:30.940760 (+ 66us) client_negotiation.cc:769] Sending connection context
0811 18:52:30.940902 (+ 142us) client_negotiation.cc:240] Negotiation successful
0811 18:52:30.941156 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1409,"mutex_wait_us":25,"spinlock_wait_cycles":1280,"thread_start_us":350,"threads_started":1}
I20260811 18:52:30.942348 26582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:30.931725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46522 (local address 127.25.25.3:39247)
0811 18:52:30.933191 (+ 1466us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:30.933201 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:30.933235 (+ 34us) server_negotiation.cc:407] Connection header received
0811 18:52:30.933360 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:30.933369 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:30.933659 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:30.934639 (+ 980us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:30.934936 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:30.936594 (+ 1658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:30.939082 (+ 2488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:30.940225 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:30.941461 (+ 1236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:30.941729 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:30.941821 (+ 92us) server_negotiation.cc:299] Negotiation successful
0811 18:52:30.941994 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1306,"thread_start_us":1144,"threads_started":1}
I20260811 18:52:30.942826 26581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:30.931121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:45401 (local address 127.0.0.1:51780)
0811 18:52:30.932291 (+ 1170us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:30.932339 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:30.932557 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:30.935615 (+ 3058us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:30.935620 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:30.935650 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:30.936045 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:30.936057 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:30.937942 (+ 1885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:30.937947 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:30.940205 (+ 2258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:30.940219 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:30.941993 (+ 1774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:30.941999 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:30.942152 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:30.942178 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 18:52:30.942226 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 18:52:30.942397 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":849,"mutex_wait_us":52,"thread_start_us":1569,"threads_started":1}
I20260811 18:52:30.943146 26584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:30.933961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43018 (local address 127.25.25.2:43779)
0811 18:52:30.934597 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:30.934605 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:30.934634 (+ 29us) server_negotiation.cc:407] Connection header received
0811 18:52:30.934734 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:30.934741 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:30.935018 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:30.935247 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:30.935920 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:30.937389 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:30.940173 (+ 2784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:30.941662 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:30.942371 (+ 709us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:30.942579 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:30.942650 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 18:52:30.942827 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":354,"threads_started":1}
I20260811 18:52:30.943300 26583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:30.933107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:43779 (local address 127.0.0.1:43018)
0811 18:52:30.933807 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:30.933825 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:30.933951 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:30.935252 (+ 1301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:30.935257 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:30.935283 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:30.935732 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:30.935750 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:30.937572 (+ 1822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:30.937578 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:30.939942 (+ 2364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:30.939958 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:30.941904 (+ 1946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:30.941911 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:30.942119 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:30.942155 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 18:52:30.942226 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 18:52:30.942947 (+ 721us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"mutex_wait_us":618,"thread_start_us":457,"threads_started":1}
I20260811 18:52:30.944636 26575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:30.931308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51780 (local address 127.25.25.1:45401)
0811 18:52:30.935056 (+ 3748us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:30.935062 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:30.935085 (+ 23us) server_negotiation.cc:407] Connection header received
0811 18:52:30.935160 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:30.935165 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:30.935388 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:30.935601 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:30.936253 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:30.937776 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:30.940386 (+ 2610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:30.941793 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:30.943715 (+ 1922us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:30.943986 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:30.944069 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 18:52:30.944270 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3579,"thread_start_us":3419,"threads_started":1}
I20260811 18:52:30.946790 26446 tablet_service.cc:1467] Processing CreateTablet for tablet 062cd126c2c344cdb638c18fbdc1de7a (DEFAULT_TABLE table=test-table [id=5ca96f724bde49528a8e08e9057e8a3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:30.947161 26223 tablet_service.cc:1467] Processing CreateTablet for tablet 062cd126c2c344cdb638c18fbdc1de7a (DEFAULT_TABLE table=test-table [id=5ca96f724bde49528a8e08e9057e8a3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:30.947990 25992 tablet_service.cc:1467] Processing CreateTablet for tablet 062cd126c2c344cdb638c18fbdc1de7a (DEFAULT_TABLE table=test-table [id=5ca96f724bde49528a8e08e9057e8a3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:30.948585 26446 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 062cd126c2c344cdb638c18fbdc1de7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:30.948586 26223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 062cd126c2c344cdb638c18fbdc1de7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:30.949252 25992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 062cd126c2c344cdb638c18fbdc1de7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:30.961789 26585 tablet_bootstrap.cc:492] T 062cd126c2c344cdb638c18fbdc1de7a P 1ae089d41f734a28b426e42ea09c3c10: Bootstrap starting.
I20260811 18:52:30.967727 26585 tablet_bootstrap.cc:654] T 062cd126c2c344cdb638c18fbdc1de7a P 1ae089d41f734a28b426e42ea09c3c10: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:30.969410 26585 log.cc:824] T 062cd126c2c344cdb638c18fbdc1de7a P 1ae089d41f734a28b426e42ea09c3c10: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:30.971028 26586 tablet_bootstrap.cc:492] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8: Bootstrap starting.
I20260811 18:52:30.974150 26589 tablet_bootstrap.cc:492] T 062cd126c2c344cdb638c18fbdc1de7a P e068758051d04c9db7975cf26fa759d1: Bootstrap starting.
I20260811 18:52:30.979033 26586 tablet_bootstrap.cc:654] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:30.980134 26589 tablet_bootstrap.cc:654] T 062cd126c2c344cdb638c18fbdc1de7a P e068758051d04c9db7975cf26fa759d1: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:30.980680 26586 log.cc:824] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:30.981581 26589 log.cc:824] T 062cd126c2c344cdb638c18fbdc1de7a P e068758051d04c9db7975cf26fa759d1: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:30.981652 26585 tablet_bootstrap.cc:492] T 062cd126c2c344cdb638c18fbdc1de7a P 1ae089d41f734a28b426e42ea09c3c10: No bootstrap required, opened a new log
I20260811 18:52:30.981961 26585 ts_tablet_manager.cc:1397] T 062cd126c2c344cdb638c18fbdc1de7a P 1ae089d41f734a28b426e42ea09c3c10: Time spent bootstrapping tablet: real 0.020s user 0.010s sys 0.003s
I20260811 18:52:30.990571 26586 tablet_bootstrap.cc:492] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8: No bootstrap required, opened a new log
I20260811 18:52:30.990741 26589 tablet_bootstrap.cc:492] T 062cd126c2c344cdb638c18fbdc1de7a P e068758051d04c9db7975cf26fa759d1: No bootstrap required, opened a new log
I20260811 18:52:30.990995 26589 ts_tablet_manager.cc:1397] T 062cd126c2c344cdb638c18fbdc1de7a P e068758051d04c9db7975cf26fa759d1: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.006s
I20260811 18:52:30.990990 26586 ts_tablet_manager.cc:1397] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8: Time spent bootstrapping tablet: real 0.020s user 0.008s sys 0.007s
I20260811 18:52:30.993463 26585 raft_consensus.cc:348] T 062cd126c2c344cdb638c18fbdc1de7a P 1ae089d41f734a28b426e42ea09c3c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ae089d41f734a28b426e42ea09c3c10" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45401 } } peers { permanent_uuid: "e068758051d04c9db7975cf26fa759d1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 43779 } } peers { permanent_uuid: "1c002e40fe5a4e48afa2cd7303c389f8" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 39247 } }
I20260811 18:52:30.993883 26585 raft_consensus.cc:374] T 062cd126c2c344cdb638c18fbdc1de7a P 1ae089d41f734a28b426e42ea09c3c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:30.994007 26585 raft_consensus.cc:729] T 062cd126c2c344cdb638c18fbdc1de7a P 1ae089d41f734a28b426e42ea09c3c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ae089d41f734a28b426e42ea09c3c10, State: Initialized, Role: FOLLOWER
I20260811 18:52:30.994624 26585 consensus_queue.cc:260] T 062cd126c2c344cdb638c18fbdc1de7a P 1ae089d41f734a28b426e42ea09c3c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ae089d41f734a28b426e42ea09c3c10" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45401 } } peers { permanent_uuid: "e068758051d04c9db7975cf26fa759d1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 43779 } } peers { permanent_uuid: "1c002e40fe5a4e48afa2cd7303c389f8" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 39247 } }
I20260811 18:52:30.996527 26585 ts_tablet_manager.cc:1428] T 062cd126c2c344cdb638c18fbdc1de7a P 1ae089d41f734a28b426e42ea09c3c10: Time spent starting tablet: real 0.014s user 0.011s sys 0.001s
I20260811 18:52:31.001943 26586 raft_consensus.cc:348] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ae089d41f734a28b426e42ea09c3c10" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45401 } } peers { permanent_uuid: "e068758051d04c9db7975cf26fa759d1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 43779 } } peers { permanent_uuid: "1c002e40fe5a4e48afa2cd7303c389f8" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 39247 } }
I20260811 18:52:31.001943 26589 raft_consensus.cc:348] T 062cd126c2c344cdb638c18fbdc1de7a P e068758051d04c9db7975cf26fa759d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ae089d41f734a28b426e42ea09c3c10" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45401 } } peers { permanent_uuid: "e068758051d04c9db7975cf26fa759d1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 43779 } } peers { permanent_uuid: "1c002e40fe5a4e48afa2cd7303c389f8" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 39247 } }
I20260811 18:52:31.002461 26589 raft_consensus.cc:374] T 062cd126c2c344cdb638c18fbdc1de7a P e068758051d04c9db7975cf26fa759d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:31.002461 26586 raft_consensus.cc:374] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:31.002573 26586 raft_consensus.cc:729] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c002e40fe5a4e48afa2cd7303c389f8, State: Initialized, Role: FOLLOWER
I20260811 18:52:31.002573 26589 raft_consensus.cc:729] T 062cd126c2c344cdb638c18fbdc1de7a P e068758051d04c9db7975cf26fa759d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e068758051d04c9db7975cf26fa759d1, State: Initialized, Role: FOLLOWER
I20260811 18:52:31.003283 26586 consensus_queue.cc:260] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ae089d41f734a28b426e42ea09c3c10" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45401 } } peers { permanent_uuid: "e068758051d04c9db7975cf26fa759d1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 43779 } } peers { permanent_uuid: "1c002e40fe5a4e48afa2cd7303c389f8" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 39247 } }
I20260811 18:52:31.003283 26589 consensus_queue.cc:260] T 062cd126c2c344cdb638c18fbdc1de7a P e068758051d04c9db7975cf26fa759d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ae089d41f734a28b426e42ea09c3c10" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45401 } } peers { permanent_uuid: "e068758051d04c9db7975cf26fa759d1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 43779 } } peers { permanent_uuid: "1c002e40fe5a4e48afa2cd7303c389f8" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 39247 } }
I20260811 18:52:31.004594 26322 heartbeater.cc:503] Master 127.25.25.62:42203 was elected leader, sending a full tablet report...
I20260811 18:52:31.004876 26556 heartbeater.cc:503] Master 127.25.25.62:42203 was elected leader, sending a full tablet report...
I20260811 18:52:31.005491 26586 ts_tablet_manager.cc:1428] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8: Time spent starting tablet: real 0.014s user 0.006s sys 0.008s
I20260811 18:52:31.006676 26589 ts_tablet_manager.cc:1428] T 062cd126c2c344cdb638c18fbdc1de7a P e068758051d04c9db7975cf26fa759d1: Time spent starting tablet: real 0.016s user 0.013s sys 0.003s
W20260811 18:52:31.036406 26323 tablet.cc:2369] T 062cd126c2c344cdb638c18fbdc1de7a P e068758051d04c9db7975cf26fa759d1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:52:31.073879 26596 raft_consensus.cc:482] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:52:31.074244 26596 raft_consensus.cc:504] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ae089d41f734a28b426e42ea09c3c10" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45401 } } peers { permanent_uuid: "e068758051d04c9db7975cf26fa759d1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 43779 } } peers { permanent_uuid: "1c002e40fe5a4e48afa2cd7303c389f8" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 39247 } }
I20260811 18:52:31.076423 26596 leader_election.cc:288] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ae089d41f734a28b426e42ea09c3c10 (127.25.25.1:45401), e068758051d04c9db7975cf26fa759d1 (127.25.25.2:43779)
I20260811 18:52:31.082449 26575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:31.076918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:51539 (local address 127.25.25.1:45401)
0811 18:52:31.077123 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:31.077128 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:31.077197 (+ 69us) server_negotiation.cc:407] Connection header received
0811 18:52:31.077654 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:31.077660 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:31.077765 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:31.077870 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:31.078291 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:31.079080 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:31.080765 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:31.081556 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:31.081683 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:31.081794 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:31.082063 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 18:52:31.082195 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 18:52:31.082464 26559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:31.076863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:45401 (local address 127.25.25.3:51539)
0811 18:52:31.077107 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:31.077128 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:31.077278 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:31.077936 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:31.077941 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:31.077972 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:31.078149 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:31.078158 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:31.079219 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:31.079223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:31.080604 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:31.080618 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:31.081725 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:31.081731 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:31.081910 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:31.081935 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 18:52:31.082017 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 18:52:31.082152 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71,"mutex_wait_us":33}
I20260811 18:52:31.083329 26584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:31.077472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:38703 (local address 127.25.25.2:43779)
0811 18:52:31.077669 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:31.077674 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:31.078185 (+ 511us) server_negotiation.cc:407] Connection header received
0811 18:52:31.078347 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:31.078351 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:31.078422 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:31.078499 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:31.079041 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:31.079737 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:31.081526 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:31.082305 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:31.082445 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:31.082559 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:31.082929 (+ 370us) server_negotiation.cc:299] Negotiation successful
0811 18:52:31.083071 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 18:52:31.083410 26598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:31.077308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:43779 (local address 127.25.25.3:38703)
0811 18:52:31.078067 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:31.078083 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:31.078206 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:31.078537 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:31.078541 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:31.078566 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:31.078886 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:31.078896 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:31.079899 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:31.079903 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:31.081360 (+ 1457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:31.081375 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:31.082542 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:31.082548 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:31.082720 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:31.082754 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 18:52:31.082891 (+ 137us) client_negotiation.cc:240] Negotiation successful
0811 18:52:31.083028 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":654,"mutex_wait_us":28,"thread_start_us":413,"threads_started":1}
I20260811 18:52:31.083571 26032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "062cd126c2c344cdb638c18fbdc1de7a" candidate_uuid: "1c002e40fe5a4e48afa2cd7303c389f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ae089d41f734a28b426e42ea09c3c10" is_pre_election: true
I20260811 18:52:31.084278 26032 raft_consensus.cc:2454] T 062cd126c2c344cdb638c18fbdc1de7a P 1ae089d41f734a28b426e42ea09c3c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c002e40fe5a4e48afa2cd7303c389f8 in term 0.
I20260811 18:52:31.084582 26249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "062cd126c2c344cdb638c18fbdc1de7a" candidate_uuid: "1c002e40fe5a4e48afa2cd7303c389f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e068758051d04c9db7975cf26fa759d1" is_pre_election: true
I20260811 18:52:31.085106 26249 raft_consensus.cc:2454] T 062cd126c2c344cdb638c18fbdc1de7a P e068758051d04c9db7975cf26fa759d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c002e40fe5a4e48afa2cd7303c389f8 in term 0.
I20260811 18:52:31.085119 26366 leader_election.cc:302] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ae089d41f734a28b426e42ea09c3c10, 1c002e40fe5a4e48afa2cd7303c389f8; no voters:
I20260811 18:52:31.085513 26596 raft_consensus.cc:2781] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:52:31.085649 26596 raft_consensus.cc:482] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:52:31.085764 26596 raft_consensus.cc:3037] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:31.088168 26596 raft_consensus.cc:504] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ae089d41f734a28b426e42ea09c3c10" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45401 } } peers { permanent_uuid: "e068758051d04c9db7975cf26fa759d1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 43779 } } peers { permanent_uuid: "1c002e40fe5a4e48afa2cd7303c389f8" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 39247 } }
I20260811 18:52:31.088799 26596 leader_election.cc:288] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8 [CANDIDATE]: Term 1 election: Requested vote from peers 1ae089d41f734a28b426e42ea09c3c10 (127.25.25.1:45401), e068758051d04c9db7975cf26fa759d1 (127.25.25.2:43779)
I20260811 18:52:31.089401 26032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "062cd126c2c344cdb638c18fbdc1de7a" candidate_uuid: "1c002e40fe5a4e48afa2cd7303c389f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ae089d41f734a28b426e42ea09c3c10"
I20260811 18:52:31.089493 26249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "062cd126c2c344cdb638c18fbdc1de7a" candidate_uuid: "1c002e40fe5a4e48afa2cd7303c389f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e068758051d04c9db7975cf26fa759d1"
I20260811 18:52:31.089695 26249 raft_consensus.cc:3037] T 062cd126c2c344cdb638c18fbdc1de7a P e068758051d04c9db7975cf26fa759d1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:31.089659 26032 raft_consensus.cc:3037] T 062cd126c2c344cdb638c18fbdc1de7a P 1ae089d41f734a28b426e42ea09c3c10 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:31.092509 26249 raft_consensus.cc:2454] T 062cd126c2c344cdb638c18fbdc1de7a P e068758051d04c9db7975cf26fa759d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c002e40fe5a4e48afa2cd7303c389f8 in term 1.
I20260811 18:52:31.092509 26032 raft_consensus.cc:2454] T 062cd126c2c344cdb638c18fbdc1de7a P 1ae089d41f734a28b426e42ea09c3c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c002e40fe5a4e48afa2cd7303c389f8 in term 1.
I20260811 18:52:31.093070 26366 leader_election.cc:302] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ae089d41f734a28b426e42ea09c3c10, 1c002e40fe5a4e48afa2cd7303c389f8; no voters:
I20260811 18:52:31.093405 26596 raft_consensus.cc:2781] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:31.093966 26596 raft_consensus.cc:686] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8 [term 1 LEADER]: Becoming Leader. State: Replica: 1c002e40fe5a4e48afa2cd7303c389f8, State: Running, Role: LEADER
I20260811 18:52:31.094549 26596 consensus_queue.cc:237] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ae089d41f734a28b426e42ea09c3c10" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45401 } } peers { permanent_uuid: "e068758051d04c9db7975cf26fa759d1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 43779 } } peers { permanent_uuid: "1c002e40fe5a4e48afa2cd7303c389f8" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 39247 } }
W20260811 18:52:31.095860 26557 tablet.cc:2369] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:52:31.099642 25786 catalog_manager.cc:5495] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c002e40fe5a4e48afa2cd7303c389f8 (127.25.25.3). New cstate: current_term: 1 leader_uuid: "1c002e40fe5a4e48afa2cd7303c389f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ae089d41f734a28b426e42ea09c3c10" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e068758051d04c9db7975cf26fa759d1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c002e40fe5a4e48afa2cd7303c389f8" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 39247 } health_report { overall_health: HEALTHY } } }
I20260811 18:52:31.141700 26582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:31.136057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46538 (local address 127.25.25.3:39247)
0811 18:52:31.136311 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:31.136316 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:31.136336 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:52:31.136520 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:31.136524 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:31.136611 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:31.136749 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:52:31.137129 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:31.137860 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:31.139248 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:31.139694 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:31.139796 (+ 102us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:31.140423 (+ 627us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:52:31.141013 (+ 590us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:52:31.141159 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:31.141336 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 18:52:31.141381 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260811 18:52:31.150270 26032 raft_consensus.cc:1261] T 062cd126c2c344cdb638c18fbdc1de7a P 1ae089d41f734a28b426e42ea09c3c10 [term 1 FOLLOWER]: Refusing update from remote peer 1c002e40fe5a4e48afa2cd7303c389f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:31.150270 26249 raft_consensus.cc:1261] T 062cd126c2c344cdb638c18fbdc1de7a P e068758051d04c9db7975cf26fa759d1 [term 1 FOLLOWER]: Refusing update from remote peer 1c002e40fe5a4e48afa2cd7303c389f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:31.151300 26599 consensus_queue.cc:1035] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e068758051d04c9db7975cf26fa759d1" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:52:31.151736 26596 consensus_queue.cc:1035] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ae089d41f734a28b426e42ea09c3c10" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:52:31.164067 26605 mvcc.cc:205] Tried to move back new op lower bound from 7317398942300938240 to 7317398942087856128. Current Snapshot: MvccSnapshot[applied={T|T < 7317398942300938240}]
I20260811 18:52:31.183264 25786 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52818:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:52:31.183547 25786 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52818:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:52:31.187733 25786 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6aa63157836a4658aa7505d1363212d1: Sending DeleteTablet for 3 replicas of tablet 062cd126c2c344cdb638c18fbdc1de7a
I20260811 18:52:31.189234 26446 tablet_service.cc:1514] Processing DeleteTablet for tablet 062cd126c2c344cdb638c18fbdc1de7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:31 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:46522
I20260811 18:52:31.189625 25992 tablet_service.cc:1514] Processing DeleteTablet for tablet 062cd126c2c344cdb638c18fbdc1de7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:31 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:51780
I20260811 18:52:31.189973 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 25884
I20260811 18:52:31.190402 26223 tablet_service.cc:1514] Processing DeleteTablet for tablet 062cd126c2c344cdb638c18fbdc1de7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:31 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:43018
I20260811 18:52:31.201686 26620 tablet_replica.cc:330] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8: stopping tablet replica
I20260811 18:52:31.202450 26620 raft_consensus.cc:2229] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:52:31.203481 26620 raft_consensus.cc:2258] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:31.207033 26620 ts_tablet_manager.cc:1905] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:31.207803 26624 tablet_replica.cc:330] T 062cd126c2c344cdb638c18fbdc1de7a P e068758051d04c9db7975cf26fa759d1: stopping tablet replica
I20260811 18:52:31.208525 26624 raft_consensus.cc:2229] T 062cd126c2c344cdb638c18fbdc1de7a P e068758051d04c9db7975cf26fa759d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:52:31.209290 26624 raft_consensus.cc:2258] T 062cd126c2c344cdb638c18fbdc1de7a P e068758051d04c9db7975cf26fa759d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:31.209935 26622 tablet_replica.cc:330] T 062cd126c2c344cdb638c18fbdc1de7a P 1ae089d41f734a28b426e42ea09c3c10: stopping tablet replica
I20260811 18:52:31.210338 26622 raft_consensus.cc:2229] T 062cd126c2c344cdb638c18fbdc1de7a P 1ae089d41f734a28b426e42ea09c3c10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:52:31.210778 26622 raft_consensus.cc:2258] T 062cd126c2c344cdb638c18fbdc1de7a P 1ae089d41f734a28b426e42ea09c3c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:31.215013 26624 ts_tablet_manager.cc:1905] T 062cd126c2c344cdb638c18fbdc1de7a P e068758051d04c9db7975cf26fa759d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:31.220270 26622 ts_tablet_manager.cc:1905] T 062cd126c2c344cdb638c18fbdc1de7a P 1ae089d41f734a28b426e42ea09c3c10: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:31.222860 26624 ts_tablet_manager.cc:1918] T 062cd126c2c344cdb638c18fbdc1de7a P e068758051d04c9db7975cf26fa759d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:52:31.223217 26624 log.cc:1196] T 062cd126c2c344cdb638c18fbdc1de7a P e068758051d04c9db7975cf26fa759d1: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-1/wal/wals/062cd126c2c344cdb638c18fbdc1de7a
Aug 11 18:52:31 dist-test-slave-lgr5 krb5kdc[25694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474348, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.1@KRBTEST.COM
I20260811 18:52:31.224049 26624 ts_tablet_manager.cc:1939] T 062cd126c2c344cdb638c18fbdc1de7a P e068758051d04c9db7975cf26fa759d1: Deleting consensus metadata
I20260811 18:52:31.226599 25758 catalog_manager.cc:4841] TS e068758051d04c9db7975cf26fa759d1 (127.25.25.2:43779): tablet 062cd126c2c344cdb638c18fbdc1de7a (table test-table [id=5ca96f724bde49528a8e08e9057e8a3e]) successfully deleted
I20260811 18:52:31.230118 26620 ts_tablet_manager.cc:1918] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:52:31.230681 26620 log.cc:1196] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-2/wal/wals/062cd126c2c344cdb638c18fbdc1de7a
I20260811 18:52:31.231424 26622 ts_tablet_manager.cc:1918] T 062cd126c2c344cdb638c18fbdc1de7a P 1ae089d41f734a28b426e42ea09c3c10: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:52:31.231582 26620 ts_tablet_manager.cc:1939] T 062cd126c2c344cdb638c18fbdc1de7a P 1c002e40fe5a4e48afa2cd7303c389f8: Deleting consensus metadata
I20260811 18:52:31.231737 26622 log.cc:1196] T 062cd126c2c344cdb638c18fbdc1de7a P 1ae089d41f734a28b426e42ea09c3c10: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474012733352-25700-0/minicluster-data/ts-0/wal/wals/062cd126c2c344cdb638c18fbdc1de7a
I20260811 18:52:31.232503 26622 ts_tablet_manager.cc:1939] T 062cd126c2c344cdb638c18fbdc1de7a P 1ae089d41f734a28b426e42ea09c3c10: Deleting consensus metadata
I20260811 18:52:31.234067 25764 catalog_manager.cc:4841] TS 1c002e40fe5a4e48afa2cd7303c389f8 (127.25.25.3:39247): tablet 062cd126c2c344cdb638c18fbdc1de7a (table test-table [id=5ca96f724bde49528a8e08e9057e8a3e]) successfully deleted
I20260811 18:52:31.234671 25758 catalog_manager.cc:4841] TS 1ae089d41f734a28b426e42ea09c3c10 (127.25.25.1:45401): tablet 062cd126c2c344cdb638c18fbdc1de7a (table test-table [id=5ca96f724bde49528a8e08e9057e8a3e]) successfully deleted
I20260811 18:52:31.234793 26575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:31.191339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51792 (local address 127.25.25.1:45401)
0811 18:52:31.191540 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:31.191547 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:31.205144 (+ 13597us) server_negotiation.cc:407] Connection header received
0811 18:52:31.205346 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:31.205352 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:31.205461 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:31.205587 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:31.207579 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:31.208960 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:31.211294 (+ 2334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:31.211993 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:31.212161 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:31.225264 (+ 13103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:31.225287 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:31.225309 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:31.225365 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:31.229886 (+ 4521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:31.231339 (+ 1453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:31.231352 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:31.231356 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:31.231614 (+ 258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:31.232346 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:31.232351 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:31.232354 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:31.232955 (+ 601us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:31.233287 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:31.234079 (+ 792us) server_negotiation.cc:299] Negotiation successful
0811 18:52:31.234398 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 18:52:31.235909 26093 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:31.381404 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 25884
I20260811 18:52:31.416363 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 26112
Aug 11 18:52:31 dist-test-slave-lgr5 krb5kdc[25694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474348, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.2@KRBTEST.COM
I20260811 18:52:31.434037 26584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:31.417242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43022 (local address 127.25.25.2:43779)
0811 18:52:31.417431 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:31.417436 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:31.417457 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:52:31.417654 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:31.417659 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:31.417727 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:31.417814 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:31.419196 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:31.419967 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:31.421298 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:31.421711 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:31.421864 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:31.427053 (+ 5189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:31.427074 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:31.427098 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:31.427150 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:31.430494 (+ 3344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:31.431684 (+ 1190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:31.431694 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:31.431696 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:31.431858 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:31.432393 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:31.432396 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:31.432398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:31.432825 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:31.433099 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:31.433505 (+ 406us) server_negotiation.cc:299] Negotiation successful
0811 18:52:31.433704 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 18:52:31.434881 26311 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:31.527343 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 26112
I20260811 18:52:31.551627 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 26330
Aug 11 18:52:31 dist-test-slave-lgr5 krb5kdc[25694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474348, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.3@KRBTEST.COM
I20260811 18:52:31.571156 26582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:31.552544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46548 (local address 127.25.25.3:39247)
0811 18:52:31.552748 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:31.552755 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:31.552805 (+ 50us) server_negotiation.cc:407] Connection header received
0811 18:52:31.552898 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:31.552905 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:31.552995 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:31.553099 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:31.554409 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:31.555642 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:31.557071 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:31.557747 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:31.557928 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:31.562771 (+ 4843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:31.562791 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:31.562815 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:31.562900 (+ 85us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:31.567353 (+ 4453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:31.568359 (+ 1006us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:31.568375 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:31.568379 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:31.568598 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:31.569142 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:31.569147 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:31.569151 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:31.569696 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:31.570075 (+ 379us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:31.570443 (+ 368us) server_negotiation.cc:299] Negotiation successful
0811 18:52:31.570710 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 18:52:31.572194 26547 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:31.699229 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 26330
I20260811 18:52:31.733711 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 25729
I20260811 18:52:31.734972 25832 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:31.855197 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 25729
2026-08-11T18:52:31Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (5067 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T18:52:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:52:31Z Disabled control of system clock
I20260811 18:52:31.960772 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:38457
--webserver_interface=127.25.25.62
--webserver_port=0
--builtin_ntp_servers=127.25.25.20:40209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:38457
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 18:52:32.347649 26640 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:32.347976 26640 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:32.348061 26640 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:32.355732 26640 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:52:32.355866 26640 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:32.355904 26640 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:32.355958 26640 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:52:32.356002 26640 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:52:32.365828 26640 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:38457
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:38457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:32.367193 26640 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:32.369168 26640 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:32.382095 26652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:32.384485 26655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:32.384512 26658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:32.385674 26640 server_base.cc:1034] running on GCE node
I20260811 18:52:32.386696 26640 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:32.388393 26640 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:32.389629 26640 hybrid_clock.cc:648] HybridClock initialized: now 1786474352389564 us; error 60 us; skew 500 ppm
I20260811 18:52:32.389992 26640 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:52:32.392577 26640 webserver.cc:460] Webserver started at http://127.25.25.62:33605/ using document root <none> and password file <none>
I20260811 18:52:32.393337 26640 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:32.393501 26640 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:32.393903 26640 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:32.397212 26640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "6a4e97f809d346dc9ad8847d679f5c01"
format_stamp: "Formatted at 2026-08-11 18:52:32 on dist-test-slave-lgr5"
server_key: "c5fc2563017f58f57a52cdba765680a5"
server_key_iv: "ed50d92e10fb2a96b1da7182cad23890"
server_key_version: "encryptionkey@0"
I20260811 18:52:32.398190 26640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "6a4e97f809d346dc9ad8847d679f5c01"
format_stamp: "Formatted at 2026-08-11 18:52:32 on dist-test-slave-lgr5"
server_key: "c5fc2563017f58f57a52cdba765680a5"
server_key_iv: "ed50d92e10fb2a96b1da7182cad23890"
server_key_version: "encryptionkey@0"
I20260811 18:52:32.404186 26640 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 18:52:32.408205 26668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:32.409835 26640 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260811 18:52:32.410045 26640 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "6a4e97f809d346dc9ad8847d679f5c01"
format_stamp: "Formatted at 2026-08-11 18:52:32 on dist-test-slave-lgr5"
server_key: "c5fc2563017f58f57a52cdba765680a5"
server_key_iv: "ed50d92e10fb2a96b1da7182cad23890"
server_key_version: "encryptionkey@0"
I20260811 18:52:32.410276 26640 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:32.435523 26640 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:32.436745 26640 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:32.437237 26640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:32.457852 26640 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:38457
I20260811 18:52:32.457863 26755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:38457 every 8 connection(s)
I20260811 18:52:32.459336 26640 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:52:32.463626 26760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:32.468540 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 26640
I20260811 18:52:32.468734 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:52:32.469231 25700 external_mini_cluster.cc:1428] Setting key efd60f492b5572df5078e7905c7caa8f
I20260811 18:52:32.477648 26760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a4e97f809d346dc9ad8847d679f5c01: Bootstrap starting.
I20260811 18:52:32.481837 26760 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a4e97f809d346dc9ad8847d679f5c01: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:32.483202 26760 log.cc:824] T 00000000000000000000000000000000 P 6a4e97f809d346dc9ad8847d679f5c01: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:32.486790 26766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:32.471520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53768 (local address 127.25.25.62:38457)
0811 18:52:32.472927 (+ 1407us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:32.472942 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:32.472998 (+ 56us) server_negotiation.cc:407] Connection header received
0811 18:52:32.475605 (+ 2607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:32.475649 (+ 44us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:32.476433 (+ 784us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:32.476957 (+ 524us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:32.477601 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:32.479613 (+ 2012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:32.481243 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:32.482354 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:32.482547 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:32.483698 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:32.483710 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:32.483733 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:32.484476 (+ 743us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:32.484612 (+ 136us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:32.484637 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:32.484729 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:32.485082 (+ 353us) server_negotiation.cc:299] Negotiation successful
0811 18:52:32.485465 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":792,"thread_start_us":524,"threads_started":1}
I20260811 18:52:32.487134 26760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a4e97f809d346dc9ad8847d679f5c01: No bootstrap required, opened a new log
I20260811 18:52:32.495735 26760 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a4e97f809d346dc9ad8847d679f5c01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a4e97f809d346dc9ad8847d679f5c01" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38457 } }
I20260811 18:52:32.496227 26760 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6a4e97f809d346dc9ad8847d679f5c01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:32.496325 26760 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a4e97f809d346dc9ad8847d679f5c01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a4e97f809d346dc9ad8847d679f5c01, State: Initialized, Role: FOLLOWER
I20260811 18:52:32.496933 26760 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a4e97f809d346dc9ad8847d679f5c01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a4e97f809d346dc9ad8847d679f5c01" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38457 } }
I20260811 18:52:32.497174 26760 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a4e97f809d346dc9ad8847d679f5c01 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:52:32.497278 26760 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a4e97f809d346dc9ad8847d679f5c01 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:52:32.497435 26760 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a4e97f809d346dc9ad8847d679f5c01 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:32.499706 26760 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a4e97f809d346dc9ad8847d679f5c01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a4e97f809d346dc9ad8847d679f5c01" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38457 } }
I20260811 18:52:32.500324 26760 leader_election.cc:302] T 00000000000000000000000000000000 P 6a4e97f809d346dc9ad8847d679f5c01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a4e97f809d346dc9ad8847d679f5c01; no voters:
I20260811 18:52:32.501070 26760 leader_election.cc:288] T 00000000000000000000000000000000 P 6a4e97f809d346dc9ad8847d679f5c01 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:52:32.501222 26770 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a4e97f809d346dc9ad8847d679f5c01 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:32.502035 26770 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a4e97f809d346dc9ad8847d679f5c01 [term 1 LEADER]: Becoming Leader. State: Replica: 6a4e97f809d346dc9ad8847d679f5c01, State: Running, Role: LEADER
I20260811 18:52:32.502650 26770 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a4e97f809d346dc9ad8847d679f5c01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a4e97f809d346dc9ad8847d679f5c01" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38457 } }
I20260811 18:52:32.503777 26760 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a4e97f809d346dc9ad8847d679f5c01 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:52:32.506049 26776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a4e97f809d346dc9ad8847d679f5c01 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a4e97f809d346dc9ad8847d679f5c01. Latest consensus state: current_term: 1 leader_uuid: "6a4e97f809d346dc9ad8847d679f5c01" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a4e97f809d346dc9ad8847d679f5c01" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38457 } } }
I20260811 18:52:32.506542 26776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a4e97f809d346dc9ad8847d679f5c01 [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:32.506645 26772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a4e97f809d346dc9ad8847d679f5c01 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a4e97f809d346dc9ad8847d679f5c01" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a4e97f809d346dc9ad8847d679f5c01" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 38457 } } }
I20260811 18:52:32.507108 26772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a4e97f809d346dc9ad8847d679f5c01 [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:32.513547 26781 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:52:32.521061 26781 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:52:32.532145 26781 catalog_manager.cc:1347] Generated new cluster ID: c91b2e71c6ae42d6a1ef3161ee19a6fb
I20260811 18:52:32.532316 26781 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:52:32.550953 26781 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:52:32.553045 26781 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:52:32.564184 26781 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6a4e97f809d346dc9ad8847d679f5c01: Generated new TSK 0
I20260811 18:52:32.565477 26781 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:52:32.576119 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:0
--local_ip_for_outbound_sockets=127.25.25.1
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38457
--builtin_ntp_servers=127.25.25.20:40209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 18:52:32.950331 26800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:32.950663 26800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:32.950753 26800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:32.958329 26800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:32.958455 26800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:32.958570 26800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:52:32.968222 26800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38457
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:32.969671 26800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:32.971788 26800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:32.986987 26807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:32.987007 26808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:32.987286 26811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:32.988292 26800 server_base.cc:1034] running on GCE node
I20260811 18:52:32.989089 26800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:32.990218 26800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:32.991472 26800 hybrid_clock.cc:648] HybridClock initialized: now 1786474352991400 us; error 64 us; skew 500 ppm
I20260811 18:52:32.991887 26800 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:52:32.994745 26800 webserver.cc:460] Webserver started at http://127.25.25.1:38249/ using document root <none> and password file <none>
I20260811 18:52:32.995569 26800 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:32.995692 26800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:32.996045 26800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:32.999300 26800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-0/data/instance:
uuid: "008d56e593fb4a5f85973d335f742526"
format_stamp: "Formatted at 2026-08-11 18:52:32 on dist-test-slave-lgr5"
server_key: "81782425e74c4f549213f7c037e33fce"
server_key_iv: "a6f87b7b0d52f8b6f6fa507113be1f1b"
server_key_version: "encryptionkey@0"
I20260811 18:52:33.000249 26800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance:
uuid: "008d56e593fb4a5f85973d335f742526"
format_stamp: "Formatted at 2026-08-11 18:52:32 on dist-test-slave-lgr5"
server_key: "81782425e74c4f549213f7c037e33fce"
server_key_iv: "a6f87b7b0d52f8b6f6fa507113be1f1b"
server_key_version: "encryptionkey@0"
I20260811 18:52:33.006328 26800 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 18:52:33.010398 26822 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:33.012066 26800 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 18:52:33.012339 26800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "008d56e593fb4a5f85973d335f742526"
format_stamp: "Formatted at 2026-08-11 18:52:32 on dist-test-slave-lgr5"
server_key: "81782425e74c4f549213f7c037e33fce"
server_key_iv: "a6f87b7b0d52f8b6f6fa507113be1f1b"
server_key_version: "encryptionkey@0"
I20260811 18:52:33.012629 26800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:33.025745 26800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:33.026824 26800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:33.027125 26800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:33.028255 26800 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:33.029875 26800 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:33.029983 26800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:33.030093 26800 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:33.030164 26800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:33.063791 26800 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:42661
I20260811 18:52:33.063799 27018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:42661 every 8 connection(s)
I20260811 18:52:33.065522 26800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:52:33.070633 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 26800
I20260811 18:52:33.070864 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance
I20260811 18:52:33.071349 25700 external_mini_cluster.cc:1428] Setting key ab520e0fcd66657eb839ddea1dc915e4
I20260811 18:52:33.074869 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:0
--local_ip_for_outbound_sockets=127.25.25.2
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38457
--builtin_ntp_servers=127.25.25.20:40209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 18:52:33.080415 27024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:33.068725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:50549 (local address 127.25.25.62:38457)
0811 18:52:33.069208 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:33.069213 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:33.070664 (+ 1451us) server_negotiation.cc:407] Connection header received
0811 18:52:33.072920 (+ 2256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:33.072925 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:33.073002 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:33.073112 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:33.074574 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:33.075374 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:33.077212 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:33.077666 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:33.077797 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:33.079391 (+ 1594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:33.079397 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:33.079401 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:33.079425 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:33.079472 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:33.079486 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:33.079564 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:33.079823 (+ 259us) server_negotiation.cc:299] Negotiation successful
0811 18:52:33.079968 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":71,"server-negotiator.queue_time_us":367,"thread_start_us":250,"threads_started":1}
I20260811 18:52:33.081565 27026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:33.069303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38457 (local address 127.25.25.1:50549)
0811 18:52:33.070462 (+ 1159us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:33.070508 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:33.072533 (+ 2025us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:33.073447 (+ 914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:33.073461 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:33.073620 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:33.074369 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:33.074392 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:33.075572 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:33.075577 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:33.077026 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:33.077043 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:33.077952 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:33.077961 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:33.078230 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:33.078989 (+ 759us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:52:33.078992 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:33.079048 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:52:33.079155 (+ 107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:33.079590 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:33.079604 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:33.079611 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 18:52:33.079795 (+ 184us) client_negotiation.cc:240] Negotiation successful
0811 18:52:33.080317 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":363,"threads_started":1}
I20260811 18:52:33.083608 27019 heartbeater.cc:347] Connected to a master server at 127.25.25.62:38457
I20260811 18:52:33.083978 27019 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:33.084879 27019 heartbeater.cc:511] Master 127.25.25.62:38457 requested a full tablet report, sending...
I20260811 18:52:33.087584 26700 ts_manager.cc:194] Registered new tserver with Master: 008d56e593fb4a5f85973d335f742526 (127.25.25.1:42661)
I20260811 18:52:33.089587 26700 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.25.1:50549
W20260811 18:52:33.453014 27027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:33.453382 27027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:33.453528 27027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:33.461964 27027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:33.462095 27027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:33.462235 27027 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:52:33.472590 27027 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38457
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:33.474390 27027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:33.476573 27027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 18:52:33.493180 27027 server_base.cc:1034] running on GCE node
W20260811 18:52:33.493281 27035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:33.493202 27036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:33.493148 27038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:33.494572 27027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:33.495741 27027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:33.497159 27027 hybrid_clock.cc:648] HybridClock initialized: now 1786474353497039 us; error 58 us; skew 500 ppm
I20260811 18:52:33.497833 27027 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:52:33.501122 27027 webserver.cc:460] Webserver started at http://127.25.25.2:43357/ using document root <none> and password file <none>
I20260811 18:52:33.502177 27027 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:33.502336 27027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:33.502732 27027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:33.506757 27027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-1/data/instance:
uuid: "2e0cf2a784e14a8795eb300d1b1b9152"
format_stamp: "Formatted at 2026-08-11 18:52:33 on dist-test-slave-lgr5"
server_key: "195cd8e17825e1ed1c00008570480c76"
server_key_iv: "c944254cef244009362ab7c3f46a37bd"
server_key_version: "encryptionkey@0"
I20260811 18:52:33.508530 27027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance:
uuid: "2e0cf2a784e14a8795eb300d1b1b9152"
format_stamp: "Formatted at 2026-08-11 18:52:33 on dist-test-slave-lgr5"
server_key: "195cd8e17825e1ed1c00008570480c76"
server_key_iv: "c944254cef244009362ab7c3f46a37bd"
server_key_version: "encryptionkey@0"
I20260811 18:52:33.516587 27027 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.007s sys 0.000s
I20260811 18:52:33.521454 27049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:33.523833 27027 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 18:52:33.524144 27027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "2e0cf2a784e14a8795eb300d1b1b9152"
format_stamp: "Formatted at 2026-08-11 18:52:33 on dist-test-slave-lgr5"
server_key: "195cd8e17825e1ed1c00008570480c76"
server_key_iv: "c944254cef244009362ab7c3f46a37bd"
server_key_version: "encryptionkey@0"
I20260811 18:52:33.524442 27027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:33.537364 27027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:33.538355 27027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:33.538654 27027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:33.539899 27027 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:33.541923 27027 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:33.542058 27027 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:33.542202 27027 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:33.542295 27027 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:33.578991 27027 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:37649
I20260811 18:52:33.579093 27251 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:37649 every 8 connection(s)
I20260811 18:52:33.580984 27027 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:52:33.584270 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 27027
I20260811 18:52:33.584533 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance
I20260811 18:52:33.585141 25700 external_mini_cluster.cc:1428] Setting key 3376f2cb520fcbc7362a2aaf5a62265c
I20260811 18:52:33.589257 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:0
--local_ip_for_outbound_sockets=127.25.25.3
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38457
--builtin_ntp_servers=127.25.25.20:40209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 18:52:33.604240 27257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:33.590925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:34159 (local address 127.25.25.62:38457)
0811 18:52:33.591462 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:33.591469 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:33.593444 (+ 1975us) server_negotiation.cc:407] Connection header received
0811 18:52:33.595853 (+ 2409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:33.595860 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:33.595944 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:33.596050 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:33.597616 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:33.598411 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:33.600701 (+ 2290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:33.601153 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:33.601269 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:33.603074 (+ 1805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:33.603080 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:33.603084 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:33.603108 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:33.603168 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:33.603182 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:33.603257 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:33.603633 (+ 376us) server_negotiation.cc:299] Negotiation successful
0811 18:52:33.603811 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":249,"threads_started":1}
I20260811 18:52:33.605238 27258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:33.591817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38457 (local address 127.25.25.2:34159)
0811 18:52:33.593168 (+ 1351us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:33.593218 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:33.595480 (+ 2262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:33.596375 (+ 895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:33.596387 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:33.596521 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:33.597386 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:33.597412 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:33.598587 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:33.598592 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:33.600502 (+ 1910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:33.600520 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:33.601406 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:33.601413 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:33.601729 (+ 316us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:33.602578 (+ 849us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:52:33.602582 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:33.602652 (+ 70us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:52:33.602772 (+ 120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:33.603280 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:33.603291 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:33.603300 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 18:52:33.603504 (+ 204us) client_negotiation.cc:240] Negotiation successful
0811 18:52:33.603940 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":704,"thread_start_us":414,"threads_started":1}
I20260811 18:52:33.606841 27254 heartbeater.cc:347] Connected to a master server at 127.25.25.62:38457
I20260811 18:52:33.607161 27254 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:33.608074 27254 heartbeater.cc:511] Master 127.25.25.62:38457 requested a full tablet report, sending...
I20260811 18:52:33.609864 26700 ts_manager.cc:194] Registered new tserver with Master: 2e0cf2a784e14a8795eb300d1b1b9152 (127.25.25.2:37649)
I20260811 18:52:33.611091 26700 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.25.2:34159
W20260811 18:52:33.964692 27259 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:33.965134 27259 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:33.965289 27259 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:33.974495 27259 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:33.974747 27259 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:33.974997 27259 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:52:33.986301 27259 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:38457
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:33.987788 27259 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:33.989830 27259 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:34.005298 27271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:34.005263 27269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:34.005232 27273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:34.006625 27259 server_base.cc:1034] running on GCE node
I20260811 18:52:34.007362 27259 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:34.008545 27259 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:34.009795 27259 hybrid_clock.cc:648] HybridClock initialized: now 1786474354009734 us; error 57 us; skew 500 ppm
I20260811 18:52:34.010180 27259 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:52:34.013335 27259 webserver.cc:460] Webserver started at http://127.25.25.3:41123/ using document root <none> and password file <none>
I20260811 18:52:34.014279 27259 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:34.014433 27259 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:34.014783 27259 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:34.018360 27259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-2/data/instance:
uuid: "133f227e08fe4397870440e7d8534ebc"
format_stamp: "Formatted at 2026-08-11 18:52:34 on dist-test-slave-lgr5"
server_key: "56e3d1c0b0b0824be13bd1be026a8b32"
server_key_iv: "781589e23e01b34a35c9008bb0b5db4e"
server_key_version: "encryptionkey@0"
I20260811 18:52:34.019332 27259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance:
uuid: "133f227e08fe4397870440e7d8534ebc"
format_stamp: "Formatted at 2026-08-11 18:52:34 on dist-test-slave-lgr5"
server_key: "56e3d1c0b0b0824be13bd1be026a8b32"
server_key_iv: "781589e23e01b34a35c9008bb0b5db4e"
server_key_version: "encryptionkey@0"
I20260811 18:52:34.025492 27259 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 18:52:34.030011 27280 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:34.031788 27259 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 18:52:34.032009 27259 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "133f227e08fe4397870440e7d8534ebc"
format_stamp: "Formatted at 2026-08-11 18:52:34 on dist-test-slave-lgr5"
server_key: "56e3d1c0b0b0824be13bd1be026a8b32"
server_key_iv: "781589e23e01b34a35c9008bb0b5db4e"
server_key_version: "encryptionkey@0"
I20260811 18:52:34.032323 27259 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:34.052246 27259 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:34.053179 27259 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:34.053475 27259 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:34.054643 27259 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:34.056365 27259 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:34.056473 27259 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:34.056586 27259 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:34.056665 27259 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:34.092499 27259 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:44373
I20260811 18:52:34.092568 27478 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:44373 every 8 connection(s)
I20260811 18:52:34.094190 27019 heartbeater.cc:503] Master 127.25.25.62:38457 was elected leader, sending a full tablet report...
I20260811 18:52:34.094261 27259 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:52:34.098505 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 27259
I20260811 18:52:34.098695 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance
I20260811 18:52:34.099161 25700 external_mini_cluster.cc:1428] Setting key 7cc9fbea9a9aa861cb11fb942840a118
I20260811 18:52:34.109054 27257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:34.097723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:33071 (local address 127.25.25.62:38457)
0811 18:52:34.097971 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:34.097975 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:34.099728 (+ 1753us) server_negotiation.cc:407] Connection header received
0811 18:52:34.102085 (+ 2357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:34.102091 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:34.102212 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:34.102392 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:34.103678 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.104556 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.106342 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.106744 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.106864 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:34.108303 (+ 1439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:34.108308 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:34.108312 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:34.108360 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:34.108396 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:34.108410 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:34.108493 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:34.108696 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 18:52:34.108789 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260811 18:52:34.110215 27482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:34.098241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:38457 (local address 127.25.25.3:33071)
0811 18:52:34.099503 (+ 1262us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:34.099568 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:34.101732 (+ 2164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:34.102646 (+ 914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:34.102660 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:34.102775 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:34.103445 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:34.103466 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.104721 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.104725 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:34.106139 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:34.106155 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.106947 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.106952 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:34.107193 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:34.107908 (+ 715us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:52:34.107911 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:34.107957 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:52:34.108062 (+ 105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:34.108505 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:34.108512 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:34.108519 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 18:52:34.108676 (+ 157us) client_negotiation.cc:240] Negotiation successful
0811 18:52:34.109036 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"thread_start_us":411,"threads_started":1}
I20260811 18:52:34.111856 27479 heartbeater.cc:347] Connected to a master server at 127.25.25.62:38457
I20260811 18:52:34.112224 27479 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:34.113194 27479 heartbeater.cc:511] Master 127.25.25.62:38457 requested a full tablet report, sending...
I20260811 18:52:34.114929 26698 ts_manager.cc:194] Registered new tserver with Master: 133f227e08fe4397870440e7d8534ebc (127.25.25.3:44373)
I20260811 18:52:34.115989 26698 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.25.3:33071
I20260811 18:52:34.129719 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:52:34.140996 27257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:34.134352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53782 (local address 127.25.25.62:38457)
0811 18:52:34.134578 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:34.134582 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:34.135019 (+ 437us) server_negotiation.cc:407] Connection header received
0811 18:52:34.135174 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:34.135178 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:34.135252 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:34.135350 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:34.135855 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.136780 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.138436 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.138937 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.139057 (+ 120us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:34.140284 (+ 1227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:34.140290 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:34.140294 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:34.140316 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:34.140353 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:34.140367 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:34.140517 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:34.140646 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 18:52:34.140702 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 18:52:34.145498 26698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53782:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:52:34.152684 26698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:52:34.179880 27502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:34.166627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:44373 (local address 127.0.0.1:49758)
0811 18:52:34.167695 (+ 1068us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:34.167762 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:34.168001 (+ 239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:34.170666 (+ 2665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:34.170675 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:34.170730 (+ 55us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:34.171332 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:34.171353 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.173936 (+ 2583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.173942 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:34.176597 (+ 2655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:34.176620 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.178629 (+ 2009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.178637 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:34.178925 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:34.179006 (+ 81us) client_negotiation.cc:769] Sending connection context
0811 18:52:34.179144 (+ 138us) client_negotiation.cc:240] Negotiation successful
0811 18:52:34.179374 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":692,"mutex_wait_us":3,"thread_start_us":405,"threads_started":1}
I20260811 18:52:34.181028 27511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:34.168610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:37649 (local address 127.0.0.1:41396)
0811 18:52:34.170666 (+ 2056us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:34.170690 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:34.172492 (+ 1802us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:34.173187 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:34.173191 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:34.173218 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:34.173528 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:34.173538 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.175266 (+ 1728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.175271 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:34.177624 (+ 2353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:34.177636 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.179895 (+ 2259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.179903 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:34.180351 (+ 448us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:34.180386 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 18:52:34.180473 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 18:52:34.180613 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1910,"mutex_wait_us":343,"thread_start_us":1714,"threads_started":1}
I20260811 18:52:34.181058 27506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:34.168279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35114 (local address 127.25.25.1:42661)
0811 18:52:34.171353 (+ 3074us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:34.171364 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:34.171399 (+ 35us) server_negotiation.cc:407] Connection header received
0811 18:52:34.171511 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:34.171521 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:34.171836 (+ 315us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:34.172135 (+ 299us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:34.172786 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.174413 (+ 1627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.177503 (+ 3090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.179120 (+ 1617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.179271 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:34.179616 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:34.180498 (+ 882us) server_negotiation.cc:299] Negotiation successful
0811 18:52:34.180701 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2867,"thread_start_us":2714,"threads_started":1}
I20260811 18:52:34.181356 27505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:34.168256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41396 (local address 127.25.25.2:37649)
0811 18:52:34.170117 (+ 1861us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:34.170126 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:34.170818 (+ 692us) server_negotiation.cc:407] Connection header received
0811 18:52:34.172753 (+ 1935us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:34.172763 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:34.172987 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:34.173174 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:34.173701 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.175083 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.177815 (+ 2732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.179274 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.179432 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:34.179701 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:34.180768 (+ 1067us) server_negotiation.cc:299] Negotiation successful
0811 18:52:34.180978 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1683,"thread_start_us":1564,"threads_started":1}
I20260811 18:52:34.181679 27503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:34.167011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49758 (local address 127.25.25.3:44373)
0811 18:52:34.169776 (+ 2765us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:34.169787 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:34.169834 (+ 47us) server_negotiation.cc:407] Connection header received
0811 18:52:34.169965 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:34.169976 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:34.170330 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:34.171622 (+ 1292us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:34.171980 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.173698 (+ 1718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.176900 (+ 3202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.178335 (+ 1435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.180598 (+ 2263us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:34.180976 (+ 378us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:34.181062 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 18:52:34.181250 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2565,"thread_start_us":2383,"threads_started":1}
I20260811 18:52:34.181715 27504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:34.167504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:42661 (local address 127.0.0.1:35114)
0811 18:52:34.168917 (+ 1413us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:34.168941 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:34.169095 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:34.172143 (+ 3048us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:34.172150 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:34.172184 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:34.172571 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:34.172582 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.174607 (+ 2025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.174613 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:34.177251 (+ 2638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:34.177270 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.179786 (+ 2516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.179798 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:34.180206 (+ 408us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:34.180251 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 18:52:34.180379 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 18:52:34.180540 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1254,"mutex_wait_us":121,"thread_start_us":1014,"threads_started":1}
I20260811 18:52:34.185643 27141 tablet_service.cc:1467] Processing CreateTablet for tablet 344d3874d137495c9d9e7be61aec40b1 (DEFAULT_TABLE table=test-table [id=42efef8ac082420db1c69c755550808f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:34.186299 26900 tablet_service.cc:1467] Processing CreateTablet for tablet 344d3874d137495c9d9e7be61aec40b1 (DEFAULT_TABLE table=test-table [id=42efef8ac082420db1c69c755550808f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:34.186319 27362 tablet_service.cc:1467] Processing CreateTablet for tablet 344d3874d137495c9d9e7be61aec40b1 (DEFAULT_TABLE table=test-table [id=42efef8ac082420db1c69c755550808f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:34.187338 27141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 344d3874d137495c9d9e7be61aec40b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:34.187994 26900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 344d3874d137495c9d9e7be61aec40b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:34.187994 27362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 344d3874d137495c9d9e7be61aec40b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:34.201689 27512 tablet_bootstrap.cc:492] T 344d3874d137495c9d9e7be61aec40b1 P 2e0cf2a784e14a8795eb300d1b1b9152: Bootstrap starting.
I20260811 18:52:34.204823 27515 tablet_bootstrap.cc:492] T 344d3874d137495c9d9e7be61aec40b1 P 133f227e08fe4397870440e7d8534ebc: Bootstrap starting.
I20260811 18:52:34.205699 27512 tablet_bootstrap.cc:654] T 344d3874d137495c9d9e7be61aec40b1 P 2e0cf2a784e14a8795eb300d1b1b9152: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:34.206199 27514 tablet_bootstrap.cc:492] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526: Bootstrap starting.
I20260811 18:52:34.207681 27512 log.cc:824] T 344d3874d137495c9d9e7be61aec40b1 P 2e0cf2a784e14a8795eb300d1b1b9152: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:34.209553 27514 tablet_bootstrap.cc:654] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:34.209620 27515 tablet_bootstrap.cc:654] T 344d3874d137495c9d9e7be61aec40b1 P 133f227e08fe4397870440e7d8534ebc: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:34.210775 27515 log.cc:824] T 344d3874d137495c9d9e7be61aec40b1 P 133f227e08fe4397870440e7d8534ebc: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:34.210875 27514 log.cc:824] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:34.212826 27512 tablet_bootstrap.cc:492] T 344d3874d137495c9d9e7be61aec40b1 P 2e0cf2a784e14a8795eb300d1b1b9152: No bootstrap required, opened a new log
I20260811 18:52:34.213115 27512 ts_tablet_manager.cc:1397] T 344d3874d137495c9d9e7be61aec40b1 P 2e0cf2a784e14a8795eb300d1b1b9152: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260811 18:52:34.213958 27514 tablet_bootstrap.cc:492] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526: No bootstrap required, opened a new log
I20260811 18:52:34.214265 27514 ts_tablet_manager.cc:1397] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260811 18:52:34.215356 27515 tablet_bootstrap.cc:492] T 344d3874d137495c9d9e7be61aec40b1 P 133f227e08fe4397870440e7d8534ebc: No bootstrap required, opened a new log
I20260811 18:52:34.215677 27515 ts_tablet_manager.cc:1397] T 344d3874d137495c9d9e7be61aec40b1 P 133f227e08fe4397870440e7d8534ebc: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260811 18:52:34.221818 27512 raft_consensus.cc:348] T 344d3874d137495c9d9e7be61aec40b1 P 2e0cf2a784e14a8795eb300d1b1b9152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "133f227e08fe4397870440e7d8534ebc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 44373 } } peers { permanent_uuid: "2e0cf2a784e14a8795eb300d1b1b9152" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 37649 } } peers { permanent_uuid: "008d56e593fb4a5f85973d335f742526" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 42661 } }
I20260811 18:52:34.222261 27512 raft_consensus.cc:374] T 344d3874d137495c9d9e7be61aec40b1 P 2e0cf2a784e14a8795eb300d1b1b9152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:34.222365 27512 raft_consensus.cc:729] T 344d3874d137495c9d9e7be61aec40b1 P 2e0cf2a784e14a8795eb300d1b1b9152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e0cf2a784e14a8795eb300d1b1b9152, State: Initialized, Role: FOLLOWER
I20260811 18:52:34.223042 27512 consensus_queue.cc:260] T 344d3874d137495c9d9e7be61aec40b1 P 2e0cf2a784e14a8795eb300d1b1b9152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "133f227e08fe4397870440e7d8534ebc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 44373 } } peers { permanent_uuid: "2e0cf2a784e14a8795eb300d1b1b9152" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 37649 } } peers { permanent_uuid: "008d56e593fb4a5f85973d335f742526" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 42661 } }
I20260811 18:52:34.224359 27254 heartbeater.cc:503] Master 127.25.25.62:38457 was elected leader, sending a full tablet report...
I20260811 18:52:34.225126 27512 ts_tablet_manager.cc:1428] T 344d3874d137495c9d9e7be61aec40b1 P 2e0cf2a784e14a8795eb300d1b1b9152: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260811 18:52:34.225371 27514 raft_consensus.cc:348] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "133f227e08fe4397870440e7d8534ebc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 44373 } } peers { permanent_uuid: "2e0cf2a784e14a8795eb300d1b1b9152" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 37649 } } peers { permanent_uuid: "008d56e593fb4a5f85973d335f742526" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 42661 } }
I20260811 18:52:34.225893 27514 raft_consensus.cc:374] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:34.226001 27514 raft_consensus.cc:729] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 008d56e593fb4a5f85973d335f742526, State: Initialized, Role: FOLLOWER
I20260811 18:52:34.226682 27514 consensus_queue.cc:260] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "133f227e08fe4397870440e7d8534ebc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 44373 } } peers { permanent_uuid: "2e0cf2a784e14a8795eb300d1b1b9152" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 37649 } } peers { permanent_uuid: "008d56e593fb4a5f85973d335f742526" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 42661 } }
I20260811 18:52:34.226760 27515 raft_consensus.cc:348] T 344d3874d137495c9d9e7be61aec40b1 P 133f227e08fe4397870440e7d8534ebc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "133f227e08fe4397870440e7d8534ebc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 44373 } } peers { permanent_uuid: "2e0cf2a784e14a8795eb300d1b1b9152" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 37649 } } peers { permanent_uuid: "008d56e593fb4a5f85973d335f742526" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 42661 } }
I20260811 18:52:34.227223 27515 raft_consensus.cc:374] T 344d3874d137495c9d9e7be61aec40b1 P 133f227e08fe4397870440e7d8534ebc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:34.227341 27515 raft_consensus.cc:729] T 344d3874d137495c9d9e7be61aec40b1 P 133f227e08fe4397870440e7d8534ebc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 133f227e08fe4397870440e7d8534ebc, State: Initialized, Role: FOLLOWER
I20260811 18:52:34.227989 27515 consensus_queue.cc:260] T 344d3874d137495c9d9e7be61aec40b1 P 133f227e08fe4397870440e7d8534ebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "133f227e08fe4397870440e7d8534ebc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 44373 } } peers { permanent_uuid: "2e0cf2a784e14a8795eb300d1b1b9152" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 37649 } } peers { permanent_uuid: "008d56e593fb4a5f85973d335f742526" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 42661 } }
I20260811 18:52:34.228858 27514 ts_tablet_manager.cc:1428] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526: Time spent starting tablet: real 0.014s user 0.016s sys 0.000s
I20260811 18:52:34.230420 27479 heartbeater.cc:503] Master 127.25.25.62:38457 was elected leader, sending a full tablet report...
I20260811 18:52:34.231218 27515 ts_tablet_manager.cc:1428] T 344d3874d137495c9d9e7be61aec40b1 P 133f227e08fe4397870440e7d8534ebc: Time spent starting tablet: real 0.015s user 0.011s sys 0.004s
I20260811 18:52:34.312127 27523 raft_consensus.cc:482] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:52:34.312611 27523 raft_consensus.cc:504] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "133f227e08fe4397870440e7d8534ebc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 44373 } } peers { permanent_uuid: "2e0cf2a784e14a8795eb300d1b1b9152" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 37649 } } peers { permanent_uuid: "008d56e593fb4a5f85973d335f742526" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 42661 } }
I20260811 18:52:34.314611 27523 leader_election.cc:288] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 133f227e08fe4397870440e7d8534ebc (127.25.25.3:44373), 2e0cf2a784e14a8795eb300d1b1b9152 (127.25.25.2:37649)
W20260811 18:52:34.318276 27020 tablet.cc:2369] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:52:34.323813 27505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:34.316510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:43557 (local address 127.25.25.2:37649)
0811 18:52:34.316681 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:34.316686 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:34.316808 (+ 122us) server_negotiation.cc:407] Connection header received
0811 18:52:34.316970 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:34.316976 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:34.317068 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:34.317197 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:34.317960 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.318971 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.321398 (+ 2427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.322604 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.322721 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:34.322802 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:34.323371 (+ 569us) server_negotiation.cc:299] Negotiation successful
0811 18:52:34.323550 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 18:52:34.323812 27503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:34.315117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:51753 (local address 127.25.25.3:44373)
0811 18:52:34.315351 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:34.315358 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:34.315935 (+ 577us) server_negotiation.cc:407] Connection header received
0811 18:52:34.316181 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:34.316186 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:34.316268 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:34.316376 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:34.317395 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.318460 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.321237 (+ 2777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.322526 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.322688 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:34.322809 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:34.323371 (+ 562us) server_negotiation.cc:299] Negotiation successful
0811 18:52:34.323523 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 18:52:34.324043 27526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:34.315103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:44373 (local address 127.25.25.1:51753)
0811 18:52:34.315794 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:34.315814 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:34.315996 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:34.316720 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:34.316724 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:34.316750 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:34.317207 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:34.317221 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.318629 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.318633 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:34.320983 (+ 2350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:34.321002 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.322806 (+ 1804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.322814 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:34.323103 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:34.323183 (+ 80us) client_negotiation.cc:769] Sending connection context
0811 18:52:34.323280 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 18:52:34.323527 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"mutex_wait_us":166,"spinlock_wait_cycles":26496,"thread_start_us":379,"threads_started":1}
I20260811 18:52:34.324476 27527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:34.316101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:37649 (local address 127.25.25.1:43557)
0811 18:52:34.316706 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:34.316721 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:34.316846 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:34.317264 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:34.317269 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:34.317300 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:34.317733 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:34.317747 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.319133 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.319139 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:34.321200 (+ 2061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:34.321213 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.322850 (+ 1637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.322858 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:34.323104 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:34.323171 (+ 67us) client_negotiation.cc:769] Sending connection context
0811 18:52:34.323280 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 18:52:34.323527 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"mutex_wait_us":96,"thread_start_us":299,"threads_started":1}
I20260811 18:52:34.325145 27396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "344d3874d137495c9d9e7be61aec40b1" candidate_uuid: "008d56e593fb4a5f85973d335f742526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "133f227e08fe4397870440e7d8534ebc" is_pre_election: true
I20260811 18:52:34.325415 27168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "344d3874d137495c9d9e7be61aec40b1" candidate_uuid: "008d56e593fb4a5f85973d335f742526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e0cf2a784e14a8795eb300d1b1b9152" is_pre_election: true
I20260811 18:52:34.325714 27396 raft_consensus.cc:2454] T 344d3874d137495c9d9e7be61aec40b1 P 133f227e08fe4397870440e7d8534ebc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 008d56e593fb4a5f85973d335f742526 in term 0.
I20260811 18:52:34.325917 27168 raft_consensus.cc:2454] T 344d3874d137495c9d9e7be61aec40b1 P 2e0cf2a784e14a8795eb300d1b1b9152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 008d56e593fb4a5f85973d335f742526 in term 0.
I20260811 18:52:34.326534 26823 leader_election.cc:302] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 008d56e593fb4a5f85973d335f742526, 133f227e08fe4397870440e7d8534ebc; no voters:
I20260811 18:52:34.326933 27523 raft_consensus.cc:2781] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:52:34.327103 27523 raft_consensus.cc:482] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:52:34.327221 27523 raft_consensus.cc:3037] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:34.329669 27523 raft_consensus.cc:504] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "133f227e08fe4397870440e7d8534ebc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 44373 } } peers { permanent_uuid: "2e0cf2a784e14a8795eb300d1b1b9152" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 37649 } } peers { permanent_uuid: "008d56e593fb4a5f85973d335f742526" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 42661 } }
I20260811 18:52:34.330330 27523 leader_election.cc:288] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526 [CANDIDATE]: Term 1 election: Requested vote from peers 133f227e08fe4397870440e7d8534ebc (127.25.25.3:44373), 2e0cf2a784e14a8795eb300d1b1b9152 (127.25.25.2:37649)
I20260811 18:52:34.330818 27396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "344d3874d137495c9d9e7be61aec40b1" candidate_uuid: "008d56e593fb4a5f85973d335f742526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "133f227e08fe4397870440e7d8534ebc"
I20260811 18:52:34.330859 27168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "344d3874d137495c9d9e7be61aec40b1" candidate_uuid: "008d56e593fb4a5f85973d335f742526" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e0cf2a784e14a8795eb300d1b1b9152"
I20260811 18:52:34.331027 27396 raft_consensus.cc:3037] T 344d3874d137495c9d9e7be61aec40b1 P 133f227e08fe4397870440e7d8534ebc [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:34.331079 27168 raft_consensus.cc:3037] T 344d3874d137495c9d9e7be61aec40b1 P 2e0cf2a784e14a8795eb300d1b1b9152 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:34.333462 27396 raft_consensus.cc:2454] T 344d3874d137495c9d9e7be61aec40b1 P 133f227e08fe4397870440e7d8534ebc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 008d56e593fb4a5f85973d335f742526 in term 1.
I20260811 18:52:34.333482 27168 raft_consensus.cc:2454] T 344d3874d137495c9d9e7be61aec40b1 P 2e0cf2a784e14a8795eb300d1b1b9152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 008d56e593fb4a5f85973d335f742526 in term 1.
I20260811 18:52:34.333879 26823 leader_election.cc:302] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 008d56e593fb4a5f85973d335f742526, 2e0cf2a784e14a8795eb300d1b1b9152; no voters:
I20260811 18:52:34.334266 27523 raft_consensus.cc:2781] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:34.334797 27523 raft_consensus.cc:686] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526 [term 1 LEADER]: Becoming Leader. State: Replica: 008d56e593fb4a5f85973d335f742526, State: Running, Role: LEADER
I20260811 18:52:34.335330 27523 consensus_queue.cc:237] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "133f227e08fe4397870440e7d8534ebc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 44373 } } peers { permanent_uuid: "2e0cf2a784e14a8795eb300d1b1b9152" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 37649 } } peers { permanent_uuid: "008d56e593fb4a5f85973d335f742526" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 42661 } }
W20260811 18:52:34.339972 27255 tablet.cc:2369] T 344d3874d137495c9d9e7be61aec40b1 P 2e0cf2a784e14a8795eb300d1b1b9152: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:52:34.340900 26697 catalog_manager.cc:5495] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526 reported cstate change: term changed from 0 to 1, leader changed from <none> to 008d56e593fb4a5f85973d335f742526 (127.25.25.1). New cstate: current_term: 1 leader_uuid: "008d56e593fb4a5f85973d335f742526" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "133f227e08fe4397870440e7d8534ebc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 44373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e0cf2a784e14a8795eb300d1b1b9152" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 37649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "008d56e593fb4a5f85973d335f742526" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 42661 } health_report { overall_health: HEALTHY } } }
W20260811 18:52:34.346302 27480 tablet.cc:2369] T 344d3874d137495c9d9e7be61aec40b1 P 133f227e08fe4397870440e7d8534ebc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:52:34.390878 27506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:34.385121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35126 (local address 127.25.25.1:42661)
0811 18:52:34.385384 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:34.385391 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:34.385412 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:52:34.385547 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:34.385551 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:34.385645 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:34.385795 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:52:34.386267 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.386983 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.388466 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.388908 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.389026 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:34.389696 (+ 670us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:52:34.390221 (+ 525us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:52:34.390391 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:34.390577 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 18:52:34.390629 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260811 18:52:34.400281 27168 raft_consensus.cc:1261] T 344d3874d137495c9d9e7be61aec40b1 P 2e0cf2a784e14a8795eb300d1b1b9152 [term 1 FOLLOWER]: Refusing update from remote peer 008d56e593fb4a5f85973d335f742526: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:34.400281 27396 raft_consensus.cc:1261] T 344d3874d137495c9d9e7be61aec40b1 P 133f227e08fe4397870440e7d8534ebc [term 1 FOLLOWER]: Refusing update from remote peer 008d56e593fb4a5f85973d335f742526: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:34.401571 27523 consensus_queue.cc:1035] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133f227e08fe4397870440e7d8534ebc" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 44373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:52:34.401969 27529 consensus_queue.cc:1035] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e0cf2a784e14a8795eb300d1b1b9152" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 37649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:52:34.436574 26697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53782:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:52:34.436947 26697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53782:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:52:34.441691 26697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6a4e97f809d346dc9ad8847d679f5c01: Sending DeleteTablet for 3 replicas of tablet 344d3874d137495c9d9e7be61aec40b1
I20260811 18:52:34.443097 27362 tablet_service.cc:1514] Processing DeleteTablet for tablet 344d3874d137495c9d9e7be61aec40b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:34 UTC) from {username='slave'} at 127.0.0.1:49758
I20260811 18:52:34.443109 26900 tablet_service.cc:1514] Processing DeleteTablet for tablet 344d3874d137495c9d9e7be61aec40b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:34 UTC) from {username='slave'} at 127.0.0.1:35114
I20260811 18:52:34.443281 27141 tablet_service.cc:1514] Processing DeleteTablet for tablet 344d3874d137495c9d9e7be61aec40b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:34 UTC) from {username='slave'} at 127.0.0.1:41396
I20260811 18:52:34.445531 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 26800
I20260811 18:52:34.454818 27556 tablet_replica.cc:330] T 344d3874d137495c9d9e7be61aec40b1 P 2e0cf2a784e14a8795eb300d1b1b9152: stopping tablet replica
I20260811 18:52:34.455430 27556 raft_consensus.cc:2229] T 344d3874d137495c9d9e7be61aec40b1 P 2e0cf2a784e14a8795eb300d1b1b9152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:52:34.456050 27556 raft_consensus.cc:2258] T 344d3874d137495c9d9e7be61aec40b1 P 2e0cf2a784e14a8795eb300d1b1b9152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:34.458839 27556 ts_tablet_manager.cc:1905] T 344d3874d137495c9d9e7be61aec40b1 P 2e0cf2a784e14a8795eb300d1b1b9152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:34.463707 27552 tablet_replica.cc:330] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526: stopping tablet replica
I20260811 18:52:34.464564 27552 raft_consensus.cc:2229] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:52:34.465528 27552 raft_consensus.cc:2258] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:34.466770 27554 tablet_replica.cc:330] T 344d3874d137495c9d9e7be61aec40b1 P 133f227e08fe4397870440e7d8534ebc: stopping tablet replica
I20260811 18:52:34.466969 27556 ts_tablet_manager.cc:1918] T 344d3874d137495c9d9e7be61aec40b1 P 2e0cf2a784e14a8795eb300d1b1b9152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:52:34.467171 27556 log.cc:1196] T 344d3874d137495c9d9e7be61aec40b1 P 2e0cf2a784e14a8795eb300d1b1b9152: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-1/wal/wals/344d3874d137495c9d9e7be61aec40b1
I20260811 18:52:34.467792 27556 ts_tablet_manager.cc:1939] T 344d3874d137495c9d9e7be61aec40b1 P 2e0cf2a784e14a8795eb300d1b1b9152: Deleting consensus metadata
I20260811 18:52:34.468819 27552 ts_tablet_manager.cc:1905] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:34.469579 27554 raft_consensus.cc:2229] T 344d3874d137495c9d9e7be61aec40b1 P 133f227e08fe4397870440e7d8534ebc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:52:34.469911 26669 catalog_manager.cc:4841] TS 2e0cf2a784e14a8795eb300d1b1b9152 (127.25.25.2:37649): tablet 344d3874d137495c9d9e7be61aec40b1 (table test-table [id=42efef8ac082420db1c69c755550808f]) successfully deleted
I20260811 18:52:34.470306 27554 raft_consensus.cc:2258] T 344d3874d137495c9d9e7be61aec40b1 P 133f227e08fe4397870440e7d8534ebc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:34.477949 27554 ts_tablet_manager.cc:1905] T 344d3874d137495c9d9e7be61aec40b1 P 133f227e08fe4397870440e7d8534ebc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:34.478039 27552 ts_tablet_manager.cc:1918] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:52:34.478258 27552 log.cc:1196] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-0/wal/wals/344d3874d137495c9d9e7be61aec40b1
I20260811 18:52:34.478899 27552 ts_tablet_manager.cc:1939] T 344d3874d137495c9d9e7be61aec40b1 P 008d56e593fb4a5f85973d335f742526: Deleting consensus metadata
I20260811 18:52:34.481012 26676 catalog_manager.cc:4841] TS 008d56e593fb4a5f85973d335f742526 (127.25.25.1:42661): tablet 344d3874d137495c9d9e7be61aec40b1 (table test-table [id=42efef8ac082420db1c69c755550808f]) successfully deleted
I20260811 18:52:34.487710 27554 ts_tablet_manager.cc:1918] T 344d3874d137495c9d9e7be61aec40b1 P 133f227e08fe4397870440e7d8534ebc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:52:34.488032 27554 log.cc:1196] T 344d3874d137495c9d9e7be61aec40b1 P 133f227e08fe4397870440e7d8534ebc: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474012733352-25700-0/minicluster-data/ts-2/wal/wals/344d3874d137495c9d9e7be61aec40b1
I20260811 18:52:34.488659 27554 ts_tablet_manager.cc:1939] T 344d3874d137495c9d9e7be61aec40b1 P 133f227e08fe4397870440e7d8534ebc: Deleting consensus metadata
I20260811 18:52:34.489686 27506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:34.447236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35138 (local address 127.25.25.1:42661)
0811 18:52:34.447482 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:34.447489 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:34.479567 (+ 32078us) server_negotiation.cc:407] Connection header received
0811 18:52:34.479759 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:34.479764 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:34.479873 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:34.479975 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:34.481778 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.483046 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.485192 (+ 2146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.485904 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.486012 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:34.487659 (+ 1647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:34.487672 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:34.487694 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:34.488682 (+ 988us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:34.488759 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:34.488789 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:34.488902 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:34.489164 (+ 262us) server_negotiation.cc:299] Negotiation successful
0811 18:52:34.489295 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 18:52:34.490940 26669 catalog_manager.cc:4841] TS 133f227e08fe4397870440e7d8534ebc (127.25.25.3:44373): tablet 344d3874d137495c9d9e7be61aec40b1 (table test-table [id=42efef8ac082420db1c69c755550808f]) successfully deleted
I20260811 18:52:34.491065 27008 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:34.593519 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 26800
I20260811 18:52:34.621865 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 27027
I20260811 18:52:34.629737 27505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:34.622809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41398 (local address 127.25.25.2:37649)
0811 18:52:34.623043 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:34.623048 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:34.623070 (+ 22us) server_negotiation.cc:407] Connection header received
0811 18:52:34.623192 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:34.623196 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:34.623298 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:34.623387 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:34.623831 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.624744 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.626191 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.626650 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.626762 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:34.627939 (+ 1177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:34.627950 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:34.627967 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:34.628746 (+ 779us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:34.628828 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:34.628873 (+ 45us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:34.628978 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:34.629188 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 18:52:34.629307 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 18:52:34.630533 27245 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:34.721753 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 27027
I20260811 18:52:34.752174 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 27259
I20260811 18:52:34.759644 27503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:34.752976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49760 (local address 127.25.25.3:44373)
0811 18:52:34.753185 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:34.753192 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:34.753282 (+ 90us) server_negotiation.cc:407] Connection header received
0811 18:52:34.753551 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:34.753556 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:34.753663 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:34.753754 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:34.754185 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.754920 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.756324 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:34.756737 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:34.756872 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:34.758133 (+ 1261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:34.758144 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:34.758162 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:34.758794 (+ 632us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:34.758853 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:34.758878 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:34.759021 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:34.759162 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 18:52:34.759305 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 18:52:34.760423 27468 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:34.853842 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 27259
I20260811 18:52:34.883800 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 26640
I20260811 18:52:34.885021 26749 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:34.998322 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 26640
2026-08-11T18:52:35Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (3143 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:52:35 dist-test-slave-lgr5 krb5kdc[27569](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:52:35 dist-test-slave-lgr5 krb5kdc[27569](info): set up 2 sockets
Aug 11 18:52:35 dist-test-slave-lgr5 krb5kdc[27569](info): commencing operation
krb5kdc: starting...
W20260811 18:52:36.314954 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.261s user 0.002s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:52:36 dist-test-slave-lgr5 krb5kdc[27569](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:52:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:52:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:52:36.667562 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:34113
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:40197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:34113
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:37.047478 27593 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:37.047843 27593 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:37.047950 27593 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:37.056036 27593 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:52:37.056237 27593 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:37.056303 27593 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:37.056372 27593 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:52:37.056424 27593 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:52:37.067695 27593 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:34113
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:34113
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:37.069303 27593 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:37.071017 27593 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:37.085652 27601 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:37.085711 27603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:37.085690 27605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:37.086782 27593 server_base.cc:1034] running on GCE node
I20260811 18:52:37.087736 27593 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:37.089494 27593 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:37.090757 27593 hybrid_clock.cc:648] HybridClock initialized: now 1786474357090687 us; error 50 us; skew 500 ppm
I20260811 18:52:37.091174 27593 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:52:37 dist-test-slave-lgr5 krb5kdc[27569](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474357, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:37.094487 27593 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:52:37.096325 27593 webserver.cc:460] Webserver started at http://127.25.25.62:46241/ using document root <none> and password file <none>
I20260811 18:52:37.097162 27593 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:37.097302 27593 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:37.097632 27593 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:37.100941 27593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "fc3c1445bc654c7c88a4746aa7d1e063"
format_stamp: "Formatted at 2026-08-11 18:52:37 on dist-test-slave-lgr5"
server_key: "8b3130d4d450f79f6a2bb2d8eddd1db1"
server_key_iv: "8a8a03d1277e1ccfb990e69976e2e43b"
server_key_version: "encryptionkey@0"
I20260811 18:52:37.101778 27593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "fc3c1445bc654c7c88a4746aa7d1e063"
format_stamp: "Formatted at 2026-08-11 18:52:37 on dist-test-slave-lgr5"
server_key: "8b3130d4d450f79f6a2bb2d8eddd1db1"
server_key_iv: "8a8a03d1277e1ccfb990e69976e2e43b"
server_key_version: "encryptionkey@0"
I20260811 18:52:37.107452 27593 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 18:52:37.112139 27614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:37.114059 27593 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 18:52:37.114295 27593 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "fc3c1445bc654c7c88a4746aa7d1e063"
format_stamp: "Formatted at 2026-08-11 18:52:37 on dist-test-slave-lgr5"
server_key: "8b3130d4d450f79f6a2bb2d8eddd1db1"
server_key_iv: "8a8a03d1277e1ccfb990e69976e2e43b"
server_key_version: "encryptionkey@0"
I20260811 18:52:37.114535 27593 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:37.129524 27593 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:37.134323 27593 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:37.134622 27593 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:37.153587 27593 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:34113
I20260811 18:52:37.153606 27705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:34113 every 8 connection(s)
I20260811 18:52:37.155282 27593 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:52:37.159451 27708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:37.162921 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 27593
I20260811 18:52:37.163123 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:52:37.163571 25700 external_mini_cluster.cc:1428] Setting key a11b1afefe7addb5400198f2c7f7379b
I20260811 18:52:37.173367 27708 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc3c1445bc654c7c88a4746aa7d1e063: Bootstrap starting.
I20260811 18:52:37.177582 27708 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc3c1445bc654c7c88a4746aa7d1e063: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:37.179044 27708 log.cc:824] T 00000000000000000000000000000000 P fc3c1445bc654c7c88a4746aa7d1e063: Log is configured to *not* fsync() on all Append() calls
Aug 11 18:52:37 dist-test-slave-lgr5 krb5kdc[27569](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:52:37.182895 27708 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc3c1445bc654c7c88a4746aa7d1e063: No bootstrap required, opened a new log
I20260811 18:52:37.190532 27711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:37.165776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33370 (local address 127.25.25.62:34113)
0811 18:52:37.166621 (+ 845us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:37.166634 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:37.166680 (+ 46us) server_negotiation.cc:407] Connection header received
0811 18:52:37.168814 (+ 2134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:37.168851 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:37.169404 (+ 553us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:37.169839 (+ 435us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:37.171896 (+ 2057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:37.173447 (+ 1551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:37.175359 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:37.176191 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:37.176361 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:37.181752 (+ 5391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:37.181762 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:37.181779 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:37.181831 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:37.185163 (+ 3332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:37.186275 (+ 1112us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:37.186288 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:37.186297 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:37.186544 (+ 247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:37.187061 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:37.187065 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:37.187067 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:37.187869 (+ 802us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:37.188216 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:37.188726 (+ 510us) server_negotiation.cc:299] Negotiation successful
0811 18:52:37.189215 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":616,"thread_start_us":382,"threads_started":1}
I20260811 18:52:37.192853 27708 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc3c1445bc654c7c88a4746aa7d1e063 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3c1445bc654c7c88a4746aa7d1e063" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 34113 } }
I20260811 18:52:37.193286 27708 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc3c1445bc654c7c88a4746aa7d1e063 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:37.193392 27708 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc3c1445bc654c7c88a4746aa7d1e063 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc3c1445bc654c7c88a4746aa7d1e063, State: Initialized, Role: FOLLOWER
I20260811 18:52:37.193984 27708 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc3c1445bc654c7c88a4746aa7d1e063 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3c1445bc654c7c88a4746aa7d1e063" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 34113 } }
I20260811 18:52:37.194372 27708 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc3c1445bc654c7c88a4746aa7d1e063 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:52:37.194555 27708 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc3c1445bc654c7c88a4746aa7d1e063 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:52:37.194708 27708 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc3c1445bc654c7c88a4746aa7d1e063 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:37.197124 27708 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc3c1445bc654c7c88a4746aa7d1e063 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3c1445bc654c7c88a4746aa7d1e063" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 34113 } }
I20260811 18:52:37.197803 27708 leader_election.cc:302] T 00000000000000000000000000000000 P fc3c1445bc654c7c88a4746aa7d1e063 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc3c1445bc654c7c88a4746aa7d1e063; no voters:
I20260811 18:52:37.198480 27708 leader_election.cc:288] T 00000000000000000000000000000000 P fc3c1445bc654c7c88a4746aa7d1e063 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:52:37.198621 27713 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc3c1445bc654c7c88a4746aa7d1e063 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:37.199293 27713 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc3c1445bc654c7c88a4746aa7d1e063 [term 1 LEADER]: Becoming Leader. State: Replica: fc3c1445bc654c7c88a4746aa7d1e063, State: Running, Role: LEADER
I20260811 18:52:37.199889 27713 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc3c1445bc654c7c88a4746aa7d1e063 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3c1445bc654c7c88a4746aa7d1e063" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 34113 } }
I20260811 18:52:37.200707 27708 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc3c1445bc654c7c88a4746aa7d1e063 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:52:37.203047 27715 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc3c1445bc654c7c88a4746aa7d1e063 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc3c1445bc654c7c88a4746aa7d1e063. Latest consensus state: current_term: 1 leader_uuid: "fc3c1445bc654c7c88a4746aa7d1e063" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3c1445bc654c7c88a4746aa7d1e063" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 34113 } } }
I20260811 18:52:37.203011 27714 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc3c1445bc654c7c88a4746aa7d1e063 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc3c1445bc654c7c88a4746aa7d1e063" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3c1445bc654c7c88a4746aa7d1e063" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 34113 } } }
I20260811 18:52:37.203617 27714 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc3c1445bc654c7c88a4746aa7d1e063 [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:37.204432 27715 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc3c1445bc654c7c88a4746aa7d1e063 [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:37.205437 27721 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:52:37.210448 27721 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:52:37.222838 27721 catalog_manager.cc:1347] Generated new cluster ID: 6f7209a8c7634ab0b2c1e1a681a3601a
I20260811 18:52:37.222973 27721 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:52:37.243897 27721 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:52:37.245409 27721 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:52:37.262164 27721 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fc3c1445bc654c7c88a4746aa7d1e063: Generated new TSK 0
I20260811 18:52:37.263536 27721 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.25.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
Entry for principal kudu/127.25.25.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab.
I20260811 18:52:37.344033 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:0
--local_ip_for_outbound_sockets=127.25.25.1
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:34113
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:40197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:37.725342 27750 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:37.725729 27750 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:37.725894 27750 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:37.733763 27750 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:37.733951 27750 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:37.734125 27750 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:52:37.745188 27750 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.1.keytab
--principal=kudu/127.25.25.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:34113
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:37.746745 27750 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:37.748358 27750 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:37.763314 27760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:37.763270 27761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:37.763356 27765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:37.764590 27750 server_base.cc:1034] running on GCE node
I20260811 18:52:37.765468 27750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:37.766626 27750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:37.767896 27750 hybrid_clock.cc:648] HybridClock initialized: now 1786474357767833 us; error 42 us; skew 500 ppm
I20260811 18:52:37.768302 27750 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:52:37 dist-test-slave-lgr5 krb5kdc[27569](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474357, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:37.771641 27750 init.cc:377] Logged in from keytab as kudu/127.25.25.1@KRBTEST.COM (short username kudu)
I20260811 18:52:37.773382 27750 webserver.cc:460] Webserver started at http://127.25.25.1:34927/ using document root <none> and password file <none>
I20260811 18:52:37.774127 27750 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:37.774247 27750 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:37.774672 27750 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:37.778077 27750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-0/data/instance:
uuid: "e1ac90bb4bff4bf59a9fa7b402c40719"
format_stamp: "Formatted at 2026-08-11 18:52:37 on dist-test-slave-lgr5"
server_key: "8503a03bc413e04c0321043dcda1043d"
server_key_iv: "48ae00106fa7ff4bcdf52fd8b976a30d"
server_key_version: "encryptionkey@0"
I20260811 18:52:37.779066 27750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance:
uuid: "e1ac90bb4bff4bf59a9fa7b402c40719"
format_stamp: "Formatted at 2026-08-11 18:52:37 on dist-test-slave-lgr5"
server_key: "8503a03bc413e04c0321043dcda1043d"
server_key_iv: "48ae00106fa7ff4bcdf52fd8b976a30d"
server_key_version: "encryptionkey@0"
I20260811 18:52:37.785300 27750 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 18:52:37.789800 27775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:37.791409 27750 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 18:52:37.791641 27750 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "e1ac90bb4bff4bf59a9fa7b402c40719"
format_stamp: "Formatted at 2026-08-11 18:52:37 on dist-test-slave-lgr5"
server_key: "8503a03bc413e04c0321043dcda1043d"
server_key_iv: "48ae00106fa7ff4bcdf52fd8b976a30d"
server_key_version: "encryptionkey@0"
I20260811 18:52:37.791873 27750 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:37.813297 27750 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:37.818848 27750 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:37.819329 27750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:37.820614 27750 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:37.822254 27750 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:37.822336 27750 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:37.822482 27750 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:37.822527 27750 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:37.857237 27750 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:34725
I20260811 18:52:37.857280 27980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:34725 every 8 connection(s)
I20260811 18:52:37.858841 27750 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:52:37.862890 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 27750
I20260811 18:52:37.863077 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance
I20260811 18:52:37.863572 25700 external_mini_cluster.cc:1428] Setting key af298a11ee39ca66290b2e17e78b2e17
Aug 11 18:52:37 dist-test-slave-lgr5 krb5kdc[27569](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474357, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.1@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:52:37.884027 27984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:37.861952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:56347 (local address 127.25.25.62:34113)
0811 18:52:37.862598 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:37.862604 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:37.864551 (+ 1947us) server_negotiation.cc:407] Connection header received
0811 18:52:37.866643 (+ 2092us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:37.866650 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:37.866754 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:37.866902 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:37.868782 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:37.869872 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:37.871711 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:37.872379 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:37.872547 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:37.876398 (+ 3851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:37.876406 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:37.876411 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:37.876460 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:37.879685 (+ 3225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:37.880913 (+ 1228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:37.880921 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:37.880925 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:37.881120 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:37.881821 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:37.881826 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:37.881828 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:37.882232 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:37.882405 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:37.883269 (+ 864us) server_negotiation.cc:299] Negotiation successful
0811 18:52:37.883546 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":495,"thread_start_us":310,"threads_started":1}
I20260811 18:52:37.884758 27990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:37.862619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:34113 (local address 127.25.25.1:56347)
0811 18:52:37.864329 (+ 1710us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:37.864390 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:37.866295 (+ 1905us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:37.867164 (+ 869us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:37.867173 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:37.867779 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:37.868546 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:37.868570 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:37.870127 (+ 1557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:37.870132 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:37.871512 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:37.871529 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:37.872655 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:37.872661 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:37.872901 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:37.873690 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:37.873722 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:37.876059 (+ 2337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:37.879969 (+ 3910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:37.879980 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:37.879997 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:37.880693 (+ 696us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:37.881251 (+ 558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:37.881256 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:37.881260 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:37.881570 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:37.882380 (+ 810us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:37.882387 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:37.882791 (+ 404us) client_negotiation.cc:769] Sending connection context
0811 18:52:37.883079 (+ 288us) client_negotiation.cc:240] Negotiation successful
0811 18:52:37.883548 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1189,"thread_start_us":618,"threads_started":1}
I20260811 18:52:37.886576 27982 heartbeater.cc:347] Connected to a master server at 127.25.25.62:34113
I20260811 18:52:37.886883 27982 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:37.887693 27982 heartbeater.cc:511] Master 127.25.25.62:34113 requested a full tablet report, sending...
I20260811 18:52:37.890282 27646 ts_manager.cc:194] Registered new tserver with Master: e1ac90bb4bff4bf59a9fa7b402c40719 (127.25.25.1:34725)
I20260811 18:52:37.891920 27646 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.1@KRBTEST.COM'} at 127.25.25.1:56347
WARNING: no policy specified for kudu/127.25.25.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
Entry for principal kudu/127.25.25.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab.
I20260811 18:52:37.939435 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:0
--local_ip_for_outbound_sockets=127.25.25.2
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:34113
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:40197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:38.312566 27996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:38.312922 27996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:38.313033 27996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:38.321074 27996 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:38.321224 27996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:38.321368 27996 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:52:38.332427 27996 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.2.keytab
--principal=kudu/127.25.25.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:34113
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:38.333889 27996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:38.335494 27996 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:38.350601 28002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:38.350601 28008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:38.350630 28005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:38.351379 27996 server_base.cc:1034] running on GCE node
I20260811 18:52:38.352257 27996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:38.353328 27996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:38.354588 27996 hybrid_clock.cc:648] HybridClock initialized: now 1786474358354526 us; error 51 us; skew 500 ppm
I20260811 18:52:38.354960 27996 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:52:38 dist-test-slave-lgr5 krb5kdc[27569](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474358, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:38.358394 27996 init.cc:377] Logged in from keytab as kudu/127.25.25.2@KRBTEST.COM (short username kudu)
I20260811 18:52:38.359918 27996 webserver.cc:460] Webserver started at http://127.25.25.2:37569/ using document root <none> and password file <none>
I20260811 18:52:38.360668 27996 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:38.360780 27996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:38.361121 27996 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:38.364262 27996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-1/data/instance:
uuid: "cd4bd54a529a42a2ad1a02609bb8a003"
format_stamp: "Formatted at 2026-08-11 18:52:38 on dist-test-slave-lgr5"
server_key: "770e817ed7a6c0236abe6b2cee4ba049"
server_key_iv: "db3a6497afcda15b6b514698fdf30983"
server_key_version: "encryptionkey@0"
I20260811 18:52:38.365068 27996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance:
uuid: "cd4bd54a529a42a2ad1a02609bb8a003"
format_stamp: "Formatted at 2026-08-11 18:52:38 on dist-test-slave-lgr5"
server_key: "770e817ed7a6c0236abe6b2cee4ba049"
server_key_iv: "db3a6497afcda15b6b514698fdf30983"
server_key_version: "encryptionkey@0"
I20260811 18:52:38.370630 27996 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 18:52:38.374300 28022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:38.375833 27996 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 18:52:38.376029 27996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "cd4bd54a529a42a2ad1a02609bb8a003"
format_stamp: "Formatted at 2026-08-11 18:52:38 on dist-test-slave-lgr5"
server_key: "770e817ed7a6c0236abe6b2cee4ba049"
server_key_iv: "db3a6497afcda15b6b514698fdf30983"
server_key_version: "encryptionkey@0"
I20260811 18:52:38.376331 27996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:38.397291 27996 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:38.402324 27996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:38.402618 27996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:38.403640 27996 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:38.405191 27996 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:38.405272 27996 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:38.405402 27996 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:38.405464 27996 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:38.437744 27996 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:46055
I20260811 18:52:38.437819 28230 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:46055 every 8 connection(s)
I20260811 18:52:38.439097 27996 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:52:38.444330 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 27996
I20260811 18:52:38.444522 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance
I20260811 18:52:38.444976 25700 external_mini_cluster.cc:1428] Setting key 5d24ab54fd8cea0940944106c4618a63
Aug 11 18:52:38 dist-test-slave-lgr5 krb5kdc[27569](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474358, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.2@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:52:38.461090 28238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:38.441759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:35779 (local address 127.25.25.62:34113)
0811 18:52:38.442221 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:38.442225 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:38.443061 (+ 836us) server_negotiation.cc:407] Connection header received
0811 18:52:38.445054 (+ 1993us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:38.445060 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:38.445143 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:38.445241 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:38.446979 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:38.448068 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:38.449832 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:38.450402 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:38.450528 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:38.454573 (+ 4045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:38.454580 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:38.454585 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:38.454627 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:38.457622 (+ 2995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:38.458568 (+ 946us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:38.458573 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:38.458576 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:38.458716 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:38.459191 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:38.459194 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:38.459197 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:38.459520 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:38.459645 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:38.460516 (+ 871us) server_negotiation.cc:299] Negotiation successful
0811 18:52:38.460732 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":250,"threads_started":1}
I20260811 18:52:38.462484 28240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:38.442166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:34113 (local address 127.25.25.2:35779)
0811 18:52:38.442889 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:38.442937 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:38.444758 (+ 1821us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:38.445544 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:38.445557 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:38.446168 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:38.446781 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:38.446809 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:38.448307 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:38.448312 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:38.449664 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:38.449680 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:38.450675 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:38.450681 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:38.450917 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:38.451618 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:38.451648 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:38.454269 (+ 2621us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:38.457797 (+ 3528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:38.457807 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:38.457827 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:38.458461 (+ 634us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:38.458817 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:38.458822 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:38.458826 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:38.459090 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:38.459642 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:38.459649 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:38.460128 (+ 479us) client_negotiation.cc:769] Sending connection context
0811 18:52:38.460460 (+ 332us) client_negotiation.cc:240] Negotiation successful
0811 18:52:38.461013 (+ 553us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":270,"threads_started":1}
I20260811 18:52:38.464151 28233 heartbeater.cc:347] Connected to a master server at 127.25.25.62:34113
I20260811 18:52:38.464504 28233 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:38.465478 28233 heartbeater.cc:511] Master 127.25.25.62:34113 requested a full tablet report, sending...
I20260811 18:52:38.467347 27646 ts_manager.cc:194] Registered new tserver with Master: cd4bd54a529a42a2ad1a02609bb8a003 (127.25.25.2:46055)
I20260811 18:52:38.468307 27646 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.2@KRBTEST.COM'} at 127.25.25.2:35779
WARNING: no policy specified for kudu/127.25.25.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
Entry for principal kudu/127.25.25.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab.
I20260811 18:52:38.520231 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:0
--local_ip_for_outbound_sockets=127.25.25.3
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:34113
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:40197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:52:38.895462 27982 heartbeater.cc:503] Master 127.25.25.62:34113 was elected leader, sending a full tablet report...
W20260811 18:52:38.899185 28244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:38.899528 28244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:38.899675 28244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:38.907611 28244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:38.907761 28244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:38.907920 28244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:52:38.918553 28244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:40197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.3.keytab
--principal=kudu/127.25.25.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:34113
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:38.920070 28244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:38.921572 28244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:38.935760 28253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:38.935868 28255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:38.935671 28250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:38.937026 28244 server_base.cc:1034] running on GCE node
I20260811 18:52:38.937731 28244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:38.938822 28244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:38.940054 28244 hybrid_clock.cc:648] HybridClock initialized: now 1786474358939990 us; error 58 us; skew 500 ppm
I20260811 18:52:38.940425 28244 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:52:38 dist-test-slave-lgr5 krb5kdc[27569](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474358, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:38.943765 28244 init.cc:377] Logged in from keytab as kudu/127.25.25.3@KRBTEST.COM (short username kudu)
I20260811 18:52:38.945649 28244 webserver.cc:460] Webserver started at http://127.25.25.3:37007/ using document root <none> and password file <none>
I20260811 18:52:38.946441 28244 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:38.946585 28244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:38.946954 28244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:38.950574 28244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-2/data/instance:
uuid: "768743baee5d4efd865990c7a90cbf53"
format_stamp: "Formatted at 2026-08-11 18:52:38 on dist-test-slave-lgr5"
server_key: "e548a9d5f9276176d381ac778777a84e"
server_key_iv: "872af06dc3229f19ed8544c7df5bdf7a"
server_key_version: "encryptionkey@0"
I20260811 18:52:38.951562 28244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance:
uuid: "768743baee5d4efd865990c7a90cbf53"
format_stamp: "Formatted at 2026-08-11 18:52:38 on dist-test-slave-lgr5"
server_key: "e548a9d5f9276176d381ac778777a84e"
server_key_iv: "872af06dc3229f19ed8544c7df5bdf7a"
server_key_version: "encryptionkey@0"
I20260811 18:52:38.957965 28244 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.004s
I20260811 18:52:38.962222 28265 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:38.963954 28244 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 18:52:38.964164 28244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "768743baee5d4efd865990c7a90cbf53"
format_stamp: "Formatted at 2026-08-11 18:52:38 on dist-test-slave-lgr5"
server_key: "e548a9d5f9276176d381ac778777a84e"
server_key_iv: "872af06dc3229f19ed8544c7df5bdf7a"
server_key_version: "encryptionkey@0"
I20260811 18:52:38.964388 28244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:38.982151 28244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:38.986841 28244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:38.987140 28244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:38.988255 28244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:38.989743 28244 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:38.989820 28244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:38.989936 28244 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:38.989991 28244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:39.022786 28244 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:41783
I20260811 18:52:39.022825 28481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:41783 every 8 connection(s)
I20260811 18:52:39.024197 28244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:52:39.025666 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 28244
I20260811 18:52:39.025849 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance
I20260811 18:52:39.026434 25700 external_mini_cluster.cc:1428] Setting key cf6283ffd30d4b5cf9ab865dad5d8264
Aug 11 18:52:39 dist-test-slave-lgr5 krb5kdc[27569](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474358, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.3@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:52:39.049393 28488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:39.026932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:42265 (local address 127.25.25.62:34113)
0811 18:52:39.032527 (+ 5595us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:39.032532 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:39.032548 (+ 16us) server_negotiation.cc:407] Connection header received
0811 18:52:39.032603 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:39.032606 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:39.032685 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:39.032782 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:39.034775 (+ 1993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.035677 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.037745 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.038268 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.038416 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:39.043165 (+ 4749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:39.043172 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:39.043176 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:39.043217 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:39.045844 (+ 2627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:39.046715 (+ 871us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:39.046720 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:39.046722 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:39.046862 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:39.047355 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:39.047359 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:39.047362 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:39.047676 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:39.047832 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:39.048723 (+ 891us) server_negotiation.cc:299] Negotiation successful
0811 18:52:39.048988 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5479,"thread_start_us":5334,"threads_started":1}
I20260811 18:52:39.050428 28490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:39.027541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:34113 (local address 127.25.25.3:42265)
0811 18:52:39.028614 (+ 1073us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:39.028675 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:39.031368 (+ 2693us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:39.033144 (+ 1776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:39.033156 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:39.033799 (+ 643us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:39.034517 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:39.034542 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.035933 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.035938 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:39.037507 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:39.037528 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.038592 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.038599 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:39.038852 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:39.039615 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:39.039649 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:39.042876 (+ 3227us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:39.046032 (+ 3156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:39.046043 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:39.046060 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:39.046563 (+ 503us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:39.046993 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:39.047000 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:39.047004 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:39.047226 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:39.047836 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:39.047847 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:39.048322 (+ 475us) client_negotiation.cc:769] Sending connection context
0811 18:52:39.048591 (+ 269us) client_negotiation.cc:240] Negotiation successful
0811 18:52:39.049204 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":728,"thread_start_us":494,"threads_started":1}
I20260811 18:52:39.052136 28484 heartbeater.cc:347] Connected to a master server at 127.25.25.62:34113
I20260811 18:52:39.052479 28484 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:39.053359 28484 heartbeater.cc:511] Master 127.25.25.62:34113 requested a full tablet report, sending...
I20260811 18:52:39.055063 27646 ts_manager.cc:194] Registered new tserver with Master: 768743baee5d4efd865990c7a90cbf53 (127.25.25.3:41783)
I20260811 18:52:39.055922 27646 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.25.3@KRBTEST.COM'} at 127.25.25.3:42265
I20260811 18:52:39.069065 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:52:39.087895 28488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:39.073956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33378 (local address 127.25.25.62:34113)
0811 18:52:39.074150 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:39.074158 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:39.074551 (+ 393us) server_negotiation.cc:407] Connection header received
0811 18:52:39.074764 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:39.074768 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:39.074844 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:39.074933 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:39.076506 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.077271 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.078693 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.079186 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.079330 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:39.082026 (+ 2696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:39.082032 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:39.082035 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:39.082077 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:39.084899 (+ 2822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:39.085735 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:39.085740 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:39.085742 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:39.085898 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:39.086313 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:39.086318 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:39.086320 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:39.086686 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:39.086930 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:39.087309 (+ 379us) server_negotiation.cc:299] Negotiation successful
0811 18:52:39.087564 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 18:52:39.092918 27646 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33378:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:52:39.101070 27646 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:52:39.132473 28506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:39.115046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57732 (local address 127.25.25.2:46055)
0811 18:52:39.115941 (+ 895us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:39.115953 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:39.116745 (+ 792us) server_negotiation.cc:407] Connection header received
0811 18:52:39.117225 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:39.117234 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:39.117509 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:39.117705 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:39.119543 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.123052 (+ 3509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.128293 (+ 5241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.130145 (+ 1852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.130274 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:39.130603 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:39.131769 (+ 1166us) server_negotiation.cc:299] Negotiation successful
0811 18:52:39.132024 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":739,"thread_start_us":639,"threads_started":1}
I20260811 18:52:39.134747 28507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:39.114771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:46055 (local address 127.0.0.1:57732)
0811 18:52:39.116588 (+ 1817us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:39.116631 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:39.116917 (+ 286us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:39.118026 (+ 1109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:39.118033 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:39.118070 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:39.119320 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:39.119337 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.123288 (+ 3951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.123294 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:39.128015 (+ 4721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:39.128040 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.130870 (+ 2830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.130877 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:39.131293 (+ 416us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:39.131378 (+ 85us) client_negotiation.cc:769] Sending connection context
0811 18:52:39.134067 (+ 2689us) client_negotiation.cc:240] Negotiation successful
0811 18:52:39.134337 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1506,"thread_start_us":2308,"threads_started":1}
I20260811 18:52:39.139331 28102 tablet_service.cc:1467] Processing CreateTablet for tablet 3794fb0d42904ef69d50da6301490128 (DEFAULT_TABLE table=test-table [id=b6ea8577130e4b3fb5c78b6a80bcb711]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:39.141631 28102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3794fb0d42904ef69d50da6301490128. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:39.141803 28510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:39.115939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34424 (local address 127.25.25.1:34725)
0811 18:52:39.133520 (+ 17581us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:39.133527 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:39.133562 (+ 35us) server_negotiation.cc:407] Connection header received
0811 18:52:39.133700 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:39.133710 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:39.134027 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:39.134541 (+ 514us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:39.135212 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.136653 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.139174 (+ 2521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.140630 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.140814 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:39.141068 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:39.141305 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 18:52:39.141480 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17392,"thread_start_us":18250,"threads_started":1}
I20260811 18:52:39.142151 28505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:39.115543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:34725 (local address 127.0.0.1:34424)
0811 18:52:39.117338 (+ 1795us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:39.117354 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:39.117458 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:39.134542 (+ 17084us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:39.134547 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:39.134576 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:39.135002 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:39.135015 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.136795 (+ 1780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.136801 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:39.138916 (+ 2115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:39.138933 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.140885 (+ 1952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.140902 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:39.141073 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:39.141142 (+ 69us) client_negotiation.cc:769] Sending connection context
0811 18:52:39.141245 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 18:52:39.141391 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1673,"mutex_wait_us":18,"thread_start_us":583,"threads_started":1}
I20260811 18:52:39.142746 28518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:39.118312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:41783 (local address 127.0.0.1:57452)
0811 18:52:39.134011 (+ 15699us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:39.134031 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:39.134178 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:39.135308 (+ 1130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:39.135312 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:39.135339 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:39.135643 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:39.135652 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.137426 (+ 1774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.137431 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:39.139486 (+ 2055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:39.139502 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.141829 (+ 2327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.141835 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:39.142113 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:39.142153 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 18:52:39.142246 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 18:52:39.142382 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15548,"mutex_wait_us":23,"thread_start_us":15392,"threads_started":1}
I20260811 18:52:39.142998 28514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:39.117953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57452 (local address 127.25.25.3:41783)
0811 18:52:39.133482 (+ 15529us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:39.133492 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:39.134387 (+ 895us) server_negotiation.cc:407] Connection header received
0811 18:52:39.134529 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:39.134537 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:39.134778 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:39.134985 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:39.135817 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.137253 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.139691 (+ 2438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.141353 (+ 1662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.141483 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:39.141701 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:39.142402 (+ 701us) server_negotiation.cc:299] Negotiation successful
0811 18:52:39.142574 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15300,"thread_start_us":16283,"threads_started":1}
I20260811 18:52:39.146339 27870 tablet_service.cc:1467] Processing CreateTablet for tablet 3794fb0d42904ef69d50da6301490128 (DEFAULT_TABLE table=test-table [id=b6ea8577130e4b3fb5c78b6a80bcb711]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:39.146329 28353 tablet_service.cc:1467] Processing CreateTablet for tablet 3794fb0d42904ef69d50da6301490128 (DEFAULT_TABLE table=test-table [id=b6ea8577130e4b3fb5c78b6a80bcb711]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:39.147841 28353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3794fb0d42904ef69d50da6301490128. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:39.147861 27870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3794fb0d42904ef69d50da6301490128. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:39.165144 28520 tablet_bootstrap.cc:492] T 3794fb0d42904ef69d50da6301490128 P cd4bd54a529a42a2ad1a02609bb8a003: Bootstrap starting.
I20260811 18:52:39.169127 28522 tablet_bootstrap.cc:492] T 3794fb0d42904ef69d50da6301490128 P 768743baee5d4efd865990c7a90cbf53: Bootstrap starting.
I20260811 18:52:39.173828 28520 tablet_bootstrap.cc:654] T 3794fb0d42904ef69d50da6301490128 P cd4bd54a529a42a2ad1a02609bb8a003: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:39.174708 28522 tablet_bootstrap.cc:654] T 3794fb0d42904ef69d50da6301490128 P 768743baee5d4efd865990c7a90cbf53: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:39.175263 28520 log.cc:824] T 3794fb0d42904ef69d50da6301490128 P cd4bd54a529a42a2ad1a02609bb8a003: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:39.175905 28524 tablet_bootstrap.cc:492] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719: Bootstrap starting.
I20260811 18:52:39.177292 28522 log.cc:824] T 3794fb0d42904ef69d50da6301490128 P 768743baee5d4efd865990c7a90cbf53: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:39.178934 28520 tablet_bootstrap.cc:492] T 3794fb0d42904ef69d50da6301490128 P cd4bd54a529a42a2ad1a02609bb8a003: No bootstrap required, opened a new log
I20260811 18:52:39.179279 28520 ts_tablet_manager.cc:1397] T 3794fb0d42904ef69d50da6301490128 P cd4bd54a529a42a2ad1a02609bb8a003: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.000s
I20260811 18:52:39.179574 28524 tablet_bootstrap.cc:654] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:39.180804 28524 log.cc:824] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:39.181102 28522 tablet_bootstrap.cc:492] T 3794fb0d42904ef69d50da6301490128 P 768743baee5d4efd865990c7a90cbf53: No bootstrap required, opened a new log
I20260811 18:52:39.181416 28522 ts_tablet_manager.cc:1397] T 3794fb0d42904ef69d50da6301490128 P 768743baee5d4efd865990c7a90cbf53: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s
I20260811 18:52:39.186940 28524 tablet_bootstrap.cc:492] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719: No bootstrap required, opened a new log
I20260811 18:52:39.187273 28524 ts_tablet_manager.cc:1397] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20260811 18:52:39.190469 28520 raft_consensus.cc:348] T 3794fb0d42904ef69d50da6301490128 P cd4bd54a529a42a2ad1a02609bb8a003 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd4bd54a529a42a2ad1a02609bb8a003" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 46055 } } peers { permanent_uuid: "768743baee5d4efd865990c7a90cbf53" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 41783 } } peers { permanent_uuid: "e1ac90bb4bff4bf59a9fa7b402c40719" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34725 } }
I20260811 18:52:39.191047 28520 raft_consensus.cc:374] T 3794fb0d42904ef69d50da6301490128 P cd4bd54a529a42a2ad1a02609bb8a003 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:39.191162 28520 raft_consensus.cc:729] T 3794fb0d42904ef69d50da6301490128 P cd4bd54a529a42a2ad1a02609bb8a003 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd4bd54a529a42a2ad1a02609bb8a003, State: Initialized, Role: FOLLOWER
I20260811 18:52:39.191923 28520 consensus_queue.cc:260] T 3794fb0d42904ef69d50da6301490128 P cd4bd54a529a42a2ad1a02609bb8a003 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd4bd54a529a42a2ad1a02609bb8a003" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 46055 } } peers { permanent_uuid: "768743baee5d4efd865990c7a90cbf53" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 41783 } } peers { permanent_uuid: "e1ac90bb4bff4bf59a9fa7b402c40719" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34725 } }
I20260811 18:52:39.192363 28522 raft_consensus.cc:348] T 3794fb0d42904ef69d50da6301490128 P 768743baee5d4efd865990c7a90cbf53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd4bd54a529a42a2ad1a02609bb8a003" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 46055 } } peers { permanent_uuid: "768743baee5d4efd865990c7a90cbf53" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 41783 } } peers { permanent_uuid: "e1ac90bb4bff4bf59a9fa7b402c40719" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34725 } }
I20260811 18:52:39.192900 28522 raft_consensus.cc:374] T 3794fb0d42904ef69d50da6301490128 P 768743baee5d4efd865990c7a90cbf53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:39.193018 28522 raft_consensus.cc:729] T 3794fb0d42904ef69d50da6301490128 P 768743baee5d4efd865990c7a90cbf53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 768743baee5d4efd865990c7a90cbf53, State: Initialized, Role: FOLLOWER
I20260811 18:52:39.193452 28233 heartbeater.cc:503] Master 127.25.25.62:34113 was elected leader, sending a full tablet report...
I20260811 18:52:39.193722 28522 consensus_queue.cc:260] T 3794fb0d42904ef69d50da6301490128 P 768743baee5d4efd865990c7a90cbf53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd4bd54a529a42a2ad1a02609bb8a003" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 46055 } } peers { permanent_uuid: "768743baee5d4efd865990c7a90cbf53" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 41783 } } peers { permanent_uuid: "e1ac90bb4bff4bf59a9fa7b402c40719" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34725 } }
I20260811 18:52:39.194103 28520 ts_tablet_manager.cc:1428] T 3794fb0d42904ef69d50da6301490128 P cd4bd54a529a42a2ad1a02609bb8a003: Time spent starting tablet: real 0.015s user 0.011s sys 0.005s
I20260811 18:52:39.196062 28484 heartbeater.cc:503] Master 127.25.25.62:34113 was elected leader, sending a full tablet report...
I20260811 18:52:39.196540 28524 raft_consensus.cc:348] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd4bd54a529a42a2ad1a02609bb8a003" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 46055 } } peers { permanent_uuid: "768743baee5d4efd865990c7a90cbf53" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 41783 } } peers { permanent_uuid: "e1ac90bb4bff4bf59a9fa7b402c40719" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34725 } }
I20260811 18:52:39.196920 28522 ts_tablet_manager.cc:1428] T 3794fb0d42904ef69d50da6301490128 P 768743baee5d4efd865990c7a90cbf53: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
I20260811 18:52:39.197012 28524 raft_consensus.cc:374] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:39.197119 28524 raft_consensus.cc:729] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1ac90bb4bff4bf59a9fa7b402c40719, State: Initialized, Role: FOLLOWER
I20260811 18:52:39.198354 28524 consensus_queue.cc:260] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd4bd54a529a42a2ad1a02609bb8a003" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 46055 } } peers { permanent_uuid: "768743baee5d4efd865990c7a90cbf53" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 41783 } } peers { permanent_uuid: "e1ac90bb4bff4bf59a9fa7b402c40719" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34725 } }
I20260811 18:52:39.200711 28524 ts_tablet_manager.cc:1428] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719: Time spent starting tablet: real 0.013s user 0.013s sys 0.001s
W20260811 18:52:39.275949 28485 tablet.cc:2369] T 3794fb0d42904ef69d50da6301490128 P 768743baee5d4efd865990c7a90cbf53: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:52:39.360644 28532 raft_consensus.cc:482] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:52:39.360975 28532 raft_consensus.cc:504] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd4bd54a529a42a2ad1a02609bb8a003" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 46055 } } peers { permanent_uuid: "768743baee5d4efd865990c7a90cbf53" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 41783 } } peers { permanent_uuid: "e1ac90bb4bff4bf59a9fa7b402c40719" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34725 } }
W20260811 18:52:39.361780 27983 tablet.cc:2369] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:52:39.362789 28532 leader_election.cc:288] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd4bd54a529a42a2ad1a02609bb8a003 (127.25.25.2:46055), 768743baee5d4efd865990c7a90cbf53 (127.25.25.3:41783)
I20260811 18:52:39.371475 28506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:39.363185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:58827 (local address 127.25.25.2:46055)
0811 18:52:39.363375 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:39.363380 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:39.363922 (+ 542us) server_negotiation.cc:407] Connection header received
0811 18:52:39.364137 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:39.364143 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:39.364226 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:39.364319 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:39.365073 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.366090 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.368888 (+ 2798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.370209 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.370375 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:39.370480 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:39.371021 (+ 541us) server_negotiation.cc:299] Negotiation successful
0811 18:52:39.371166 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 18:52:39.371450 28514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:39.364260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:36231 (local address 127.25.25.3:41783)
0811 18:52:39.364460 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:39.364464 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:39.364621 (+ 157us) server_negotiation.cc:407] Connection header received
0811 18:52:39.364814 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:39.364818 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:39.364880 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:39.364957 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:39.365462 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.366454 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.368885 (+ 2431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.370209 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.370366 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:39.370480 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:39.371020 (+ 540us) server_negotiation.cc:299] Negotiation successful
0811 18:52:39.371166 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 18:52:39.371579 28535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:39.363176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:46055 (local address 127.25.25.1:58827)
0811 18:52:39.363796 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:39.363813 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:39.363972 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:39.364501 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:39.364506 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:39.364538 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:39.364900 (+ 362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:39.364920 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.366234 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.366238 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:39.368606 (+ 2368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:39.368632 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.370521 (+ 1889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.370528 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:39.370824 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:39.370880 (+ 56us) client_negotiation.cc:769] Sending connection context
0811 18:52:39.370977 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 18:52:39.371167 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"mutex_wait_us":86,"thread_start_us":345,"threads_started":1}
I20260811 18:52:39.372128 28536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:39.363913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:41783 (local address 127.25.25.1:36231)
0811 18:52:39.364533 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:39.364549 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:39.364689 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:39.364995 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:39.364999 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:39.365025 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:39.365308 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:39.365316 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.366585 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.366591 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:39.368698 (+ 2107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:39.368709 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.370519 (+ 1810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.370528 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:39.370818 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:39.370873 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 18:52:39.370979 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 18:52:39.371165 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"mutex_wait_us":84,"thread_start_us":293,"threads_started":1}
I20260811 18:52:39.372704 28142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3794fb0d42904ef69d50da6301490128" candidate_uuid: "e1ac90bb4bff4bf59a9fa7b402c40719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd4bd54a529a42a2ad1a02609bb8a003" is_pre_election: true
I20260811 18:52:39.373214 28142 raft_consensus.cc:2454] T 3794fb0d42904ef69d50da6301490128 P cd4bd54a529a42a2ad1a02609bb8a003 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1ac90bb4bff4bf59a9fa7b402c40719 in term 0.
I20260811 18:52:39.373277 28395 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3794fb0d42904ef69d50da6301490128" candidate_uuid: "e1ac90bb4bff4bf59a9fa7b402c40719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "768743baee5d4efd865990c7a90cbf53" is_pre_election: true
I20260811 18:52:39.373746 28395 raft_consensus.cc:2454] T 3794fb0d42904ef69d50da6301490128 P 768743baee5d4efd865990c7a90cbf53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1ac90bb4bff4bf59a9fa7b402c40719 in term 0.
I20260811 18:52:39.373874 27782 leader_election.cc:302] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd4bd54a529a42a2ad1a02609bb8a003, e1ac90bb4bff4bf59a9fa7b402c40719; no voters:
I20260811 18:52:39.374306 28532 raft_consensus.cc:2781] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:52:39.374457 28532 raft_consensus.cc:482] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:52:39.374569 28532 raft_consensus.cc:3037] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:39.376910 28532 raft_consensus.cc:504] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd4bd54a529a42a2ad1a02609bb8a003" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 46055 } } peers { permanent_uuid: "768743baee5d4efd865990c7a90cbf53" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 41783 } } peers { permanent_uuid: "e1ac90bb4bff4bf59a9fa7b402c40719" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34725 } }
I20260811 18:52:39.377509 28532 leader_election.cc:288] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719 [CANDIDATE]: Term 1 election: Requested vote from peers cd4bd54a529a42a2ad1a02609bb8a003 (127.25.25.2:46055), 768743baee5d4efd865990c7a90cbf53 (127.25.25.3:41783)
I20260811 18:52:39.378103 28142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3794fb0d42904ef69d50da6301490128" candidate_uuid: "e1ac90bb4bff4bf59a9fa7b402c40719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd4bd54a529a42a2ad1a02609bb8a003"
I20260811 18:52:39.378186 28395 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3794fb0d42904ef69d50da6301490128" candidate_uuid: "e1ac90bb4bff4bf59a9fa7b402c40719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "768743baee5d4efd865990c7a90cbf53"
I20260811 18:52:39.378306 28142 raft_consensus.cc:3037] T 3794fb0d42904ef69d50da6301490128 P cd4bd54a529a42a2ad1a02609bb8a003 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:39.378404 28395 raft_consensus.cc:3037] T 3794fb0d42904ef69d50da6301490128 P 768743baee5d4efd865990c7a90cbf53 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:39.380806 28142 raft_consensus.cc:2454] T 3794fb0d42904ef69d50da6301490128 P cd4bd54a529a42a2ad1a02609bb8a003 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1ac90bb4bff4bf59a9fa7b402c40719 in term 1.
I20260811 18:52:39.380818 28395 raft_consensus.cc:2454] T 3794fb0d42904ef69d50da6301490128 P 768743baee5d4efd865990c7a90cbf53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1ac90bb4bff4bf59a9fa7b402c40719 in term 1.
I20260811 18:52:39.381256 27782 leader_election.cc:302] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 768743baee5d4efd865990c7a90cbf53, e1ac90bb4bff4bf59a9fa7b402c40719; no voters:
I20260811 18:52:39.381587 28532 raft_consensus.cc:2781] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:39.382040 28532 raft_consensus.cc:686] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719 [term 1 LEADER]: Becoming Leader. State: Replica: e1ac90bb4bff4bf59a9fa7b402c40719, State: Running, Role: LEADER
I20260811 18:52:39.382516 28532 consensus_queue.cc:237] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd4bd54a529a42a2ad1a02609bb8a003" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 46055 } } peers { permanent_uuid: "768743baee5d4efd865990c7a90cbf53" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 41783 } } peers { permanent_uuid: "e1ac90bb4bff4bf59a9fa7b402c40719" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34725 } }
I20260811 18:52:39.387849 27645 catalog_manager.cc:5495] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1ac90bb4bff4bf59a9fa7b402c40719 (127.25.25.1). New cstate: current_term: 1 leader_uuid: "e1ac90bb4bff4bf59a9fa7b402c40719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd4bd54a529a42a2ad1a02609bb8a003" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 46055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "768743baee5d4efd865990c7a90cbf53" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 41783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1ac90bb4bff4bf59a9fa7b402c40719" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 34725 } health_report { overall_health: HEALTHY } } }
I20260811 18:52:39.428798 28510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:39.423086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34430 (local address 127.25.25.1:34725)
0811 18:52:39.423298 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:39.423304 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:39.423387 (+ 83us) server_negotiation.cc:407] Connection header received
0811 18:52:39.423603 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:39.423607 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:39.423700 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:39.423840 (+ 140us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:52:39.424256 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.425019 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.426521 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.426939 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.427037 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:39.427561 (+ 524us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:52:39.428220 (+ 659us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:52:39.428339 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:39.428494 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 18:52:39.428579 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 18:52:39.438036 28395 raft_consensus.cc:1261] T 3794fb0d42904ef69d50da6301490128 P 768743baee5d4efd865990c7a90cbf53 [term 1 FOLLOWER]: Refusing update from remote peer e1ac90bb4bff4bf59a9fa7b402c40719: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:39.438169 28142 raft_consensus.cc:1261] T 3794fb0d42904ef69d50da6301490128 P cd4bd54a529a42a2ad1a02609bb8a003 [term 1 FOLLOWER]: Refusing update from remote peer e1ac90bb4bff4bf59a9fa7b402c40719: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:39.439138 28537 consensus_queue.cc:1035] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "768743baee5d4efd865990c7a90cbf53" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 41783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:52:39.439642 28532 consensus_queue.cc:1035] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd4bd54a529a42a2ad1a02609bb8a003" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 46055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 18:52:39.441459 28235 tablet.cc:2369] T 3794fb0d42904ef69d50da6301490128 P cd4bd54a529a42a2ad1a02609bb8a003: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:52:39.452003 28542 mvcc.cc:205] Tried to move back new op lower bound from 7317398976246894592 to 7317398976034414592. Current Snapshot: MvccSnapshot[applied={T|T < 7317398976246894592}]
I20260811 18:52:39.453691 28543 mvcc.cc:205] Tried to move back new op lower bound from 7317398976246894592 to 7317398976034414592. Current Snapshot: MvccSnapshot[applied={T|T < 7317398976246894592}]
I20260811 18:52:39.477175 27645 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33378:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:52:39.477550 27645 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33378:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:52:39.481907 27645 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fc3c1445bc654c7c88a4746aa7d1e063: Sending DeleteTablet for 3 replicas of tablet 3794fb0d42904ef69d50da6301490128
I20260811 18:52:39.483222 27870 tablet_service.cc:1514] Processing DeleteTablet for tablet 3794fb0d42904ef69d50da6301490128 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:39 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:34424
I20260811 18:52:39.483397 28353 tablet_service.cc:1514] Processing DeleteTablet for tablet 3794fb0d42904ef69d50da6301490128 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:39 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:57452
I20260811 18:52:39.483693 28102 tablet_service.cc:1514] Processing DeleteTablet for tablet 3794fb0d42904ef69d50da6301490128 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:39 UTC) from {username='kudu', principal='kudu/127.25.25.62@KRBTEST.COM'} at 127.0.0.1:57732
I20260811 18:52:39.486366 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 27750
I20260811 18:52:39.494602 28567 tablet_replica.cc:330] T 3794fb0d42904ef69d50da6301490128 P cd4bd54a529a42a2ad1a02609bb8a003: stopping tablet replica
I20260811 18:52:39.495427 28567 raft_consensus.cc:2229] T 3794fb0d42904ef69d50da6301490128 P cd4bd54a529a42a2ad1a02609bb8a003 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:52:39.496243 28567 raft_consensus.cc:2258] T 3794fb0d42904ef69d50da6301490128 P cd4bd54a529a42a2ad1a02609bb8a003 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:39.498795 28567 ts_tablet_manager.cc:1905] T 3794fb0d42904ef69d50da6301490128 P cd4bd54a529a42a2ad1a02609bb8a003: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:39.499279 28565 tablet_replica.cc:330] T 3794fb0d42904ef69d50da6301490128 P 768743baee5d4efd865990c7a90cbf53: stopping tablet replica
I20260811 18:52:39.499943 28566 tablet_replica.cc:330] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719: stopping tablet replica
I20260811 18:52:39.501107 28565 raft_consensus.cc:2229] T 3794fb0d42904ef69d50da6301490128 P 768743baee5d4efd865990c7a90cbf53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:52:39.501353 28566 raft_consensus.cc:2229] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:52:39.502327 28565 raft_consensus.cc:2258] T 3794fb0d42904ef69d50da6301490128 P 768743baee5d4efd865990c7a90cbf53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:39.502986 28566 raft_consensus.cc:2258] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:39.506376 28565 ts_tablet_manager.cc:1905] T 3794fb0d42904ef69d50da6301490128 P 768743baee5d4efd865990c7a90cbf53: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:39.506647 28567 ts_tablet_manager.cc:1918] T 3794fb0d42904ef69d50da6301490128 P cd4bd54a529a42a2ad1a02609bb8a003: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:52:39.506925 28567 log.cc:1196] T 3794fb0d42904ef69d50da6301490128 P cd4bd54a529a42a2ad1a02609bb8a003: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-1/wal/wals/3794fb0d42904ef69d50da6301490128
I20260811 18:52:39.507695 28567 ts_tablet_manager.cc:1939] T 3794fb0d42904ef69d50da6301490128 P cd4bd54a529a42a2ad1a02609bb8a003: Deleting consensus metadata
I20260811 18:52:39.508484 28566 ts_tablet_manager.cc:1905] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:39.510150 27623 catalog_manager.cc:4841] TS cd4bd54a529a42a2ad1a02609bb8a003 (127.25.25.2:46055): tablet 3794fb0d42904ef69d50da6301490128 (table test-table [id=b6ea8577130e4b3fb5c78b6a80bcb711]) successfully deleted
I20260811 18:52:39.513765 28565 ts_tablet_manager.cc:1918] T 3794fb0d42904ef69d50da6301490128 P 768743baee5d4efd865990c7a90cbf53: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:52:39.513949 28565 log.cc:1196] T 3794fb0d42904ef69d50da6301490128 P 768743baee5d4efd865990c7a90cbf53: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-2/wal/wals/3794fb0d42904ef69d50da6301490128
I20260811 18:52:39.514597 28565 ts_tablet_manager.cc:1939] T 3794fb0d42904ef69d50da6301490128 P 768743baee5d4efd865990c7a90cbf53: Deleting consensus metadata
I20260811 18:52:39.516112 28566 ts_tablet_manager.cc:1918] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:52:39.516363 28566 log.cc:1196] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474012733352-25700-0/minicluster-data/ts-0/wal/wals/3794fb0d42904ef69d50da6301490128
I20260811 18:52:39.516741 27623 catalog_manager.cc:4841] TS 768743baee5d4efd865990c7a90cbf53 (127.25.25.3:41783): tablet 3794fb0d42904ef69d50da6301490128 (table test-table [id=b6ea8577130e4b3fb5c78b6a80bcb711]) successfully deleted
I20260811 18:52:39.517073 28566 ts_tablet_manager.cc:1939] T 3794fb0d42904ef69d50da6301490128 P e1ac90bb4bff4bf59a9fa7b402c40719: Deleting consensus metadata
I20260811 18:52:39.518914 27618 catalog_manager.cc:4841] TS e1ac90bb4bff4bf59a9fa7b402c40719 (127.25.25.1:34725): tablet 3794fb0d42904ef69d50da6301490128 (table test-table [id=b6ea8577130e4b3fb5c78b6a80bcb711]) successfully deleted
Aug 11 18:52:39 dist-test-slave-lgr5 krb5kdc[27569](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.1@KRBTEST.COM
I20260811 18:52:39.531461 28510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:39.487915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34442 (local address 127.25.25.1:34725)
0811 18:52:39.488172 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:39.488179 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:39.503619 (+ 15440us) server_negotiation.cc:407] Connection header received
0811 18:52:39.504188 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:39.504194 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:39.504279 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:39.504372 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:39.514166 (+ 9794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.515530 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.517743 (+ 2213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.518489 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.518626 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:39.524544 (+ 5918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:39.524561 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:39.524580 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:39.524635 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:39.528143 (+ 3508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:39.529034 (+ 891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:39.529044 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:39.529046 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:39.529236 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:39.529679 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:39.529684 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:39.529686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:39.530129 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:39.530437 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:39.530807 (+ 370us) server_negotiation.cc:299] Negotiation successful
0811 18:52:39.531101 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260811 18:52:39.532253 27972 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:39.637590 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 27750
I20260811 18:52:39.667707 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 27996
Aug 11 18:52:39 dist-test-slave-lgr5 krb5kdc[27569](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.2@KRBTEST.COM
I20260811 18:52:39.683912 28506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:39.668595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43780 (local address 127.25.25.2:46055)
0811 18:52:39.668834 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:39.668839 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:39.668862 (+ 23us) server_negotiation.cc:407] Connection header received
0811 18:52:39.668934 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:39.668938 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:39.669042 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:39.669152 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:39.670513 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.671298 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.672708 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.673117 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.673216 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:39.677652 (+ 4436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:39.677673 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:39.677691 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:39.677736 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:39.680771 (+ 3035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:39.681653 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:39.681662 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:39.681665 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:39.681834 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:39.682289 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:39.682293 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:39.682296 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:39.682789 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:39.683040 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:39.683336 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 18:52:39.683571 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 18:52:39.684755 28224 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:39.776511 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 27996
I20260811 18:52:39.805290 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 28244
Aug 11 18:52:39 dist-test-slave-lgr5 krb5kdc[27569](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.3@KRBTEST.COM
I20260811 18:52:39.822867 28514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:39.806223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46344 (local address 127.25.25.3:41783)
0811 18:52:39.806391 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:39.806396 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:39.806416 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:52:39.806499 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:39.806503 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:39.806587 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:39.806726 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:39.808181 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.808938 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.810344 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:39.810761 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:39.810888 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:39.815520 (+ 4632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:39.815539 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:39.815557 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:39.815602 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:39.818563 (+ 2961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:39.819706 (+ 1143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:39.819718 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:39.819722 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:39.819987 (+ 265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:39.820607 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:39.820613 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:39.820617 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:39.821357 (+ 740us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:39.821691 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:39.822192 (+ 501us) server_negotiation.cc:299] Negotiation successful
0811 18:52:39.822482 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 18:52:39.823653 28474 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:39.915282 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 28244
I20260811 18:52:39.939582 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 27593
I20260811 18:52:39.940953 27698 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:40.058450 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 27593
2026-08-11T18:52:40Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (5059 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T18:52:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:52:40Z Disabled control of system clock
I20260811 18:52:40.166940 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:43099
--webserver_interface=127.25.25.62
--webserver_port=0
--builtin_ntp_servers=127.25.25.20:37653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:43099
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 18:52:40.541088 28584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:40.541438 28584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:40.541582 28584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:40.549309 28584 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:52:40.549454 28584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:40.549526 28584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:40.549619 28584 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:52:40.549695 28584 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:52:40.559808 28584 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:37653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:43099
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:43099
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:40.561317 28584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:40.563467 28584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:40.577055 28595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:40.577078 28594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:40.577067 28600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:40.578217 28584 server_base.cc:1034] running on GCE node
I20260811 18:52:40.579154 28584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:40.580883 28584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:40.582155 28584 hybrid_clock.cc:648] HybridClock initialized: now 1786474360582100 us; error 51 us; skew 500 ppm
I20260811 18:52:40.582579 28584 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:52:40.585204 28584 webserver.cc:460] Webserver started at http://127.25.25.62:39461/ using document root <none> and password file <none>
I20260811 18:52:40.585958 28584 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:40.586071 28584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:40.586400 28584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:40.589743 28584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "20bb179fdcbb461c9a4b4d29298b576a"
format_stamp: "Formatted at 2026-08-11 18:52:40 on dist-test-slave-lgr5"
server_key: "71c79ed8cab64ff5f53a7b65d36a72e9"
server_key_iv: "60d0405d170d837c079e01b736ba66b9"
server_key_version: "encryptionkey@0"
I20260811 18:52:40.590652 28584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "20bb179fdcbb461c9a4b4d29298b576a"
format_stamp: "Formatted at 2026-08-11 18:52:40 on dist-test-slave-lgr5"
server_key: "71c79ed8cab64ff5f53a7b65d36a72e9"
server_key_iv: "60d0405d170d837c079e01b736ba66b9"
server_key_version: "encryptionkey@0"
I20260811 18:52:40.596647 28584 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260811 18:52:40.600792 28611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:40.602434 28584 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:52:40.602670 28584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "20bb179fdcbb461c9a4b4d29298b576a"
format_stamp: "Formatted at 2026-08-11 18:52:40 on dist-test-slave-lgr5"
server_key: "71c79ed8cab64ff5f53a7b65d36a72e9"
server_key_iv: "60d0405d170d837c079e01b736ba66b9"
server_key_version: "encryptionkey@0"
I20260811 18:52:40.602926 28584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:40.620146 28584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:40.621188 28584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:40.621523 28584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:40.641812 28584 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:43099
I20260811 18:52:40.641813 28706 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:43099 every 8 connection(s)
I20260811 18:52:40.643378 28584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:52:40.647369 28707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:40.651252 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 28584
I20260811 18:52:40.651434 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:52:40.651942 25700 external_mini_cluster.cc:1428] Setting key 5bedb4f2e09c65dfdf10514ff94058c3
I20260811 18:52:40.658833 28707 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20bb179fdcbb461c9a4b4d29298b576a: Bootstrap starting.
I20260811 18:52:40.662108 28707 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 20bb179fdcbb461c9a4b4d29298b576a: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:40.663190 28707 log.cc:824] T 00000000000000000000000000000000 P 20bb179fdcbb461c9a4b4d29298b576a: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:40.666985 28707 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20bb179fdcbb461c9a4b4d29298b576a: No bootstrap required, opened a new log
I20260811 18:52:40.667745 28711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:40.653966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33732 (local address 127.25.25.62:43099)
0811 18:52:40.655073 (+ 1107us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:40.655086 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:40.655132 (+ 46us) server_negotiation.cc:407] Connection header received
0811 18:52:40.657612 (+ 2480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:40.657643 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:40.658189 (+ 546us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:40.658593 (+ 404us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:40.659299 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:40.660806 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:40.662306 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:40.663074 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:40.663270 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:40.664662 (+ 1392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:40.664674 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:40.664695 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:40.665477 (+ 782us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:40.665595 (+ 118us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:40.665626 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:40.665757 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:40.666002 (+ 245us) server_negotiation.cc:299] Negotiation successful
0811 18:52:40.666373 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":643,"thread_start_us":394,"threads_started":1}
I20260811 18:52:40.675103 28707 raft_consensus.cc:348] T 00000000000000000000000000000000 P 20bb179fdcbb461c9a4b4d29298b576a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20bb179fdcbb461c9a4b4d29298b576a" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43099 } }
I20260811 18:52:40.675591 28707 raft_consensus.cc:374] T 00000000000000000000000000000000 P 20bb179fdcbb461c9a4b4d29298b576a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:40.675698 28707 raft_consensus.cc:729] T 00000000000000000000000000000000 P 20bb179fdcbb461c9a4b4d29298b576a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20bb179fdcbb461c9a4b4d29298b576a, State: Initialized, Role: FOLLOWER
I20260811 18:52:40.676378 28707 consensus_queue.cc:260] T 00000000000000000000000000000000 P 20bb179fdcbb461c9a4b4d29298b576a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20bb179fdcbb461c9a4b4d29298b576a" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43099 } }
I20260811 18:52:40.676678 28707 raft_consensus.cc:388] T 00000000000000000000000000000000 P 20bb179fdcbb461c9a4b4d29298b576a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:52:40.676826 28707 raft_consensus.cc:482] T 00000000000000000000000000000000 P 20bb179fdcbb461c9a4b4d29298b576a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:52:40.677008 28707 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 20bb179fdcbb461c9a4b4d29298b576a [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:40.679406 28707 raft_consensus.cc:504] T 00000000000000000000000000000000 P 20bb179fdcbb461c9a4b4d29298b576a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20bb179fdcbb461c9a4b4d29298b576a" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43099 } }
I20260811 18:52:40.680030 28707 leader_election.cc:302] T 00000000000000000000000000000000 P 20bb179fdcbb461c9a4b4d29298b576a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 20bb179fdcbb461c9a4b4d29298b576a; no voters:
I20260811 18:52:40.680842 28707 leader_election.cc:288] T 00000000000000000000000000000000 P 20bb179fdcbb461c9a4b4d29298b576a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:52:40.681027 28713 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 20bb179fdcbb461c9a4b4d29298b576a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:40.681959 28713 raft_consensus.cc:686] T 00000000000000000000000000000000 P 20bb179fdcbb461c9a4b4d29298b576a [term 1 LEADER]: Becoming Leader. State: Replica: 20bb179fdcbb461c9a4b4d29298b576a, State: Running, Role: LEADER
I20260811 18:52:40.682590 28713 consensus_queue.cc:237] T 00000000000000000000000000000000 P 20bb179fdcbb461c9a4b4d29298b576a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20bb179fdcbb461c9a4b4d29298b576a" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43099 } }
I20260811 18:52:40.683527 28707 sys_catalog.cc:564] T 00000000000000000000000000000000 P 20bb179fdcbb461c9a4b4d29298b576a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:52:40.686057 28716 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20bb179fdcbb461c9a4b4d29298b576a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20bb179fdcbb461c9a4b4d29298b576a. Latest consensus state: current_term: 1 leader_uuid: "20bb179fdcbb461c9a4b4d29298b576a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20bb179fdcbb461c9a4b4d29298b576a" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43099 } } }
I20260811 18:52:40.686125 28714 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20bb179fdcbb461c9a4b4d29298b576a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "20bb179fdcbb461c9a4b4d29298b576a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20bb179fdcbb461c9a4b4d29298b576a" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 43099 } } }
I20260811 18:52:40.686555 28716 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20bb179fdcbb461c9a4b4d29298b576a [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:40.686560 28714 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20bb179fdcbb461c9a4b4d29298b576a [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:40.690147 28726 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:52:40.696180 28726 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:52:40.707762 28726 catalog_manager.cc:1347] Generated new cluster ID: 48f807539ef64a608c37b208589d441d
I20260811 18:52:40.708176 28726 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:52:40.735046 28726 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:52:40.736501 28726 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:52:40.749575 28726 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 20bb179fdcbb461c9a4b4d29298b576a: Generated new TSK 0
I20260811 18:52:40.750571 28726 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:52:40.760281 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.1:0
--local_ip_for_outbound_sockets=127.25.25.1
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:43099
--builtin_ntp_servers=127.25.25.20:37653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 18:52:41.136466 28748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:41.136762 28748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:41.136868 28748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:41.144337 28748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:41.144445 28748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:41.144582 28748 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.1
I20260811 18:52:41.154501 28748 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:37653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.25.1
--webserver_port=0
--tserver_master_addrs=127.25.25.62:43099
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.1
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:41.156126 28748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:41.158234 28748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:41.173697 28760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:41.173756 28763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:41.173731 28757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:41.174757 28748 server_base.cc:1034] running on GCE node
I20260811 18:52:41.175551 28748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:41.176748 28748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:41.178002 28748 hybrid_clock.cc:648] HybridClock initialized: now 1786474361177948 us; error 45 us; skew 500 ppm
I20260811 18:52:41.178399 28748 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:52:41.181157 28748 webserver.cc:460] Webserver started at http://127.25.25.1:38139/ using document root <none> and password file <none>
I20260811 18:52:41.181969 28748 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:41.182089 28748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:41.182427 28748 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:41.186002 28748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-0/data/instance:
uuid: "2bb41236bd0647c1ba03aee59a683d5d"
format_stamp: "Formatted at 2026-08-11 18:52:41 on dist-test-slave-lgr5"
server_key: "2e1984c68e1cd22561f826b1a816d637"
server_key_iv: "f29feda931044ab174ad848701d514dd"
server_key_version: "encryptionkey@0"
I20260811 18:52:41.186915 28748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance:
uuid: "2bb41236bd0647c1ba03aee59a683d5d"
format_stamp: "Formatted at 2026-08-11 18:52:41 on dist-test-slave-lgr5"
server_key: "2e1984c68e1cd22561f826b1a816d637"
server_key_iv: "f29feda931044ab174ad848701d514dd"
server_key_version: "encryptionkey@0"
I20260811 18:52:41.193127 28748 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260811 18:52:41.197184 28779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:41.198765 28748 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 18:52:41.198956 28748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-0/wal
uuid: "2bb41236bd0647c1ba03aee59a683d5d"
format_stamp: "Formatted at 2026-08-11 18:52:41 on dist-test-slave-lgr5"
server_key: "2e1984c68e1cd22561f826b1a816d637"
server_key_iv: "f29feda931044ab174ad848701d514dd"
server_key_version: "encryptionkey@0"
I20260811 18:52:41.199179 28748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:41.220814 28748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:41.221665 28748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:41.221909 28748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:41.223018 28748 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:41.224587 28748 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:41.224678 28748 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:41.224761 28748 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:41.224814 28748 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:41.257871 28748 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.1:37799
I20260811 18:52:41.258025 28963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.1:37799 every 8 connection(s)
I20260811 18:52:41.259568 28748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-0/data/info.pb
I20260811 18:52:41.267529 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 28748
I20260811 18:52:41.267712 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-0/wal/instance
I20260811 18:52:41.268211 25700 external_mini_cluster.cc:1428] Setting key 0433aeeca436f80f4bd20c9b823cfc1d
I20260811 18:52:41.271863 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.2:0
--local_ip_for_outbound_sockets=127.25.25.2
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:43099
--builtin_ntp_servers=127.25.25.20:37653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 18:52:41.276785 28966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:41.262974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.1:58251 (local address 127.25.25.62:43099)
0811 18:52:41.263523 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:41.263529 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:41.265180 (+ 1651us) server_negotiation.cc:407] Connection header received
0811 18:52:41.267367 (+ 2187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:41.267374 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:41.267493 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:41.267611 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:41.269244 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:41.270339 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:41.273135 (+ 2796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:41.273626 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:41.273758 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:41.275730 (+ 1972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:41.275736 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:41.275739 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:41.275766 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:41.275821 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:41.275837 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:41.275922 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:41.276322 (+ 400us) server_negotiation.cc:299] Negotiation successful
0811 18:52:41.276477 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":281,"threads_started":1}
I20260811 18:52:41.279035 28967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:41.263697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43099 (local address 127.25.25.1:58251)
0811 18:52:41.264947 (+ 1250us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:41.265006 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:41.266957 (+ 1951us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:41.267960 (+ 1003us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:41.267971 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:41.268123 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:41.268999 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:41.269036 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:41.270585 (+ 1549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:41.270591 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:41.272864 (+ 2273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:41.272904 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:41.273925 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:41.273934 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:41.274288 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:41.275180 (+ 892us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:52:41.275184 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:41.275251 (+ 67us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:52:41.275389 (+ 138us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:41.275957 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:41.275970 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:41.275988 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 18:52:41.276230 (+ 242us) client_negotiation.cc:240] Negotiation successful
0811 18:52:41.276737 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":707,"thread_start_us":449,"threads_started":1}
I20260811 18:52:41.281977 28964 heartbeater.cc:347] Connected to a master server at 127.25.25.62:43099
I20260811 18:52:41.282545 28964 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:41.283841 28964 heartbeater.cc:511] Master 127.25.25.62:43099 requested a full tablet report, sending...
I20260811 18:52:41.286855 28640 ts_manager.cc:194] Registered new tserver with Master: 2bb41236bd0647c1ba03aee59a683d5d (127.25.25.1:37799)
I20260811 18:52:41.288618 28640 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.25.1:58251
W20260811 18:52:41.640400 28969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:41.640700 28969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:41.640828 28969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:41.648396 28969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:41.648512 28969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:41.648669 28969 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.2
I20260811 18:52:41.658361 28969 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:37653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.25.2
--webserver_port=0
--tserver_master_addrs=127.25.25.62:43099
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.2
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:41.659813 28969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:41.662005 28969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:41.676847 28982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:41.676870 28988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:41.676810 28985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:41.677083 28969 server_base.cc:1034] running on GCE node
I20260811 18:52:41.678241 28969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:41.679312 28969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:41.680598 28969 hybrid_clock.cc:648] HybridClock initialized: now 1786474361680527 us; error 57 us; skew 500 ppm
I20260811 18:52:41.680990 28969 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:52:41.688427 28969 webserver.cc:460] Webserver started at http://127.25.25.2:39739/ using document root <none> and password file <none>
I20260811 18:52:41.689299 28969 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:41.689428 28969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:41.689810 28969 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:41.693183 28969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-1/data/instance:
uuid: "23210357d54e4466bb16f65b39595536"
format_stamp: "Formatted at 2026-08-11 18:52:41 on dist-test-slave-lgr5"
server_key: "cdc118d15e9a4704bf25ebd1c03e9486"
server_key_iv: "e1501dc9a075e6ac686d561a8d22858e"
server_key_version: "encryptionkey@0"
I20260811 18:52:41.694070 28969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance:
uuid: "23210357d54e4466bb16f65b39595536"
format_stamp: "Formatted at 2026-08-11 18:52:41 on dist-test-slave-lgr5"
server_key: "cdc118d15e9a4704bf25ebd1c03e9486"
server_key_iv: "e1501dc9a075e6ac686d561a8d22858e"
server_key_version: "encryptionkey@0"
I20260811 18:52:41.700026 28969 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 18:52:41.704237 28999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:41.705843 28969 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:52:41.706049 28969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-1/wal
uuid: "23210357d54e4466bb16f65b39595536"
format_stamp: "Formatted at 2026-08-11 18:52:41 on dist-test-slave-lgr5"
server_key: "cdc118d15e9a4704bf25ebd1c03e9486"
server_key_iv: "e1501dc9a075e6ac686d561a8d22858e"
server_key_version: "encryptionkey@0"
I20260811 18:52:41.706300 28969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:41.720229 28969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:41.721184 28969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:41.721478 28969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:41.722565 28969 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:41.724313 28969 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:41.724413 28969 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:41.724534 28969 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:41.724607 28969 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:41.758535 28969 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.2:35335
I20260811 18:52:41.758585 29232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.2:35335 every 8 connection(s)
I20260811 18:52:41.759984 28969 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-1/data/info.pb
I20260811 18:52:41.761345 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 28969
I20260811 18:52:41.761525 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-1/wal/instance
I20260811 18:52:41.762053 25700 external_mini_cluster.cc:1428] Setting key e7eb32fb74b06d2e950fc1fbea14beac
I20260811 18:52:41.765306 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.25.3:0
--local_ip_for_outbound_sockets=127.25.25.3
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:43099
--builtin_ntp_servers=127.25.25.20:37653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 18:52:41.774197 28966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:41.762895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.2:33329 (local address 127.25.25.62:43099)
0811 18:52:41.763137 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:41.763142 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:41.764914 (+ 1772us) server_negotiation.cc:407] Connection header received
0811 18:52:41.766964 (+ 2050us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:41.766971 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:41.767068 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:41.767158 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:41.768531 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:41.769285 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:41.771025 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:41.771471 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:41.771595 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:41.773287 (+ 1692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:41.773293 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:41.773298 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:41.773322 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:41.773359 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:41.773372 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:41.773454 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:41.773722 (+ 268us) server_negotiation.cc:299] Negotiation successful
0811 18:52:41.773844 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 18:52:41.775417 29242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:41.763565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43099 (local address 127.25.25.2:33329)
0811 18:52:41.764749 (+ 1184us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:41.764791 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:41.766613 (+ 1822us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:41.767475 (+ 862us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:41.767485 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:41.767596 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:41.768322 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:41.768346 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:41.769471 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:41.769475 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:41.770834 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:41.770852 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:41.771747 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:41.771757 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:41.772025 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:41.772856 (+ 831us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:52:41.772860 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:41.772933 (+ 73us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:52:41.773063 (+ 130us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:41.773474 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:41.773487 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:41.773496 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 18:52:41.773670 (+ 174us) client_negotiation.cc:240] Negotiation successful
0811 18:52:41.774153 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":677,"thread_start_us":425,"threads_started":1}
I20260811 18:52:41.777107 29234 heartbeater.cc:347] Connected to a master server at 127.25.25.62:43099
I20260811 18:52:41.777441 29234 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:41.778522 29234 heartbeater.cc:511] Master 127.25.25.62:43099 requested a full tablet report, sending...
I20260811 18:52:41.780376 28640 ts_manager.cc:194] Registered new tserver with Master: 23210357d54e4466bb16f65b39595536 (127.25.25.2:35335)
I20260811 18:52:41.781227 28640 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.25.2:33329
W20260811 18:52:42.134158 29243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:42.134474 29243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:42.134605 29243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:42.142151 29243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:42.142270 29243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:42.142408 29243 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.25.3
I20260811 18:52:42.151897 29243 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:37653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.25.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.25.3
--webserver_port=0
--tserver_master_addrs=127.25.25.62:43099
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.25.3
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:42.153312 29243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:42.155195 29243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:42.169010 29251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:42.169059 29258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:42.169085 29256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:42.171185 29243 server_base.cc:1034] running on GCE node
I20260811 18:52:42.171927 29243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:42.173050 29243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:42.174278 29243 hybrid_clock.cc:648] HybridClock initialized: now 1786474362174212 us; error 46 us; skew 500 ppm
I20260811 18:52:42.174623 29243 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:52:42.177171 29243 webserver.cc:460] Webserver started at http://127.25.25.3:38535/ using document root <none> and password file <none>
I20260811 18:52:42.177901 29243 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:42.178007 29243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:42.178337 29243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:42.181602 29243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-2/data/instance:
uuid: "4edcdecd527c4f358f6504a54a9b7031"
format_stamp: "Formatted at 2026-08-11 18:52:42 on dist-test-slave-lgr5"
server_key: "17662a8af2ff8ce20fb4388abd6f6d56"
server_key_iv: "1fee0a8146dbddbb2f7d808c36b8accf"
server_key_version: "encryptionkey@0"
I20260811 18:52:42.182526 29243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance:
uuid: "4edcdecd527c4f358f6504a54a9b7031"
format_stamp: "Formatted at 2026-08-11 18:52:42 on dist-test-slave-lgr5"
server_key: "17662a8af2ff8ce20fb4388abd6f6d56"
server_key_iv: "1fee0a8146dbddbb2f7d808c36b8accf"
server_key_version: "encryptionkey@0"
I20260811 18:52:42.188496 29243 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260811 18:52:42.192803 29272 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:42.194454 29243 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 18:52:42.194644 29243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-2/wal
uuid: "4edcdecd527c4f358f6504a54a9b7031"
format_stamp: "Formatted at 2026-08-11 18:52:42 on dist-test-slave-lgr5"
server_key: "17662a8af2ff8ce20fb4388abd6f6d56"
server_key_iv: "1fee0a8146dbddbb2f7d808c36b8accf"
server_key_version: "encryptionkey@0"
I20260811 18:52:42.194913 29243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:42.216598 29243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:42.217520 29243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:42.217794 29243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:42.218873 29243 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:42.220661 29243 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:42.220759 29243 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:42.220872 29243 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:42.220947 29243 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:42.254552 29243 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.3:38705
I20260811 18:52:42.254594 29467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.3:38705 every 8 connection(s)
I20260811 18:52:42.256006 29243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-2/data/info.pb
I20260811 18:52:42.262528 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 29243
I20260811 18:52:42.262706 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-2/wal/instance
I20260811 18:52:42.263130 25700 external_mini_cluster.cc:1428] Setting key 3d4c00a0d8d5a6c8259e12a09745477c
I20260811 18:52:42.271209 28966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:42.259403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:44269 (local address 127.25.25.62:43099)
0811 18:52:42.259642 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:42.259649 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:42.261556 (+ 1907us) server_negotiation.cc:407] Connection header received
0811 18:52:42.264165 (+ 2609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:42.264172 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:42.264261 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:42.264352 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:42.265613 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.266411 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.268177 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.268603 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.268725 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:42.270276 (+ 1551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:42.270281 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:42.270285 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:42.270309 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:42.270345 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:42.270358 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:42.270436 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:42.270687 (+ 251us) server_negotiation.cc:299] Negotiation successful
0811 18:52:42.270805 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 18:52:42.272414 29474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:42.259972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:43099 (local address 127.25.25.3:44269)
0811 18:52:42.261292 (+ 1320us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:42.261346 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:42.263776 (+ 2430us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:42.264654 (+ 878us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:42.264664 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:42.264777 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:42.265420 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:42.265441 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.266588 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.266592 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:42.267965 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:42.267981 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.268889 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.268898 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:42.269143 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:42.269900 (+ 757us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:52:42.269904 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:42.269954 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:52:42.270056 (+ 102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:42.270461 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:42.270473 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:42.270480 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 18:52:42.270658 (+ 178us) client_negotiation.cc:240] Negotiation successful
0811 18:52:42.271142 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":656,"thread_start_us":369,"threads_started":1}
I20260811 18:52:42.274083 29472 heartbeater.cc:347] Connected to a master server at 127.25.25.62:43099
I20260811 18:52:42.274401 29472 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:42.275259 29472 heartbeater.cc:511] Master 127.25.25.62:43099 requested a full tablet report, sending...
I20260811 18:52:42.277040 28640 ts_manager.cc:194] Registered new tserver with Master: 4edcdecd527c4f358f6504a54a9b7031 (127.25.25.3:38705)
I20260811 18:52:42.278064 28640 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.25.3:44269
I20260811 18:52:42.279208 25700 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:52:42.291066 28966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:42.283901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33744 (local address 127.25.25.62:43099)
0811 18:52:42.284196 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:42.284204 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:42.284657 (+ 453us) server_negotiation.cc:407] Connection header received
0811 18:52:42.284845 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:42.284850 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:42.284924 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:42.285009 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:42.285681 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.286480 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.288017 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.288698 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.288842 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:42.290175 (+ 1333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:42.290180 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:42.290183 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:42.290231 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:42.290296 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:42.290313 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:42.290394 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:42.290613 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 18:52:42.290714 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 18:52:42.292825 28964 heartbeater.cc:503] Master 127.25.25.62:43099 was elected leader, sending a full tablet report...
I20260811 18:52:42.296233 28639 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33744:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:52:42.304261 28639 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:52:42.343652 29499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:42.320390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44548 (local address 127.25.25.2:35335)
0811 18:52:42.335707 (+ 15317us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:42.335714 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:42.335746 (+ 32us) server_negotiation.cc:407] Connection header received
0811 18:52:42.335871 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:42.335881 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:42.336198 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:42.336437 (+ 239us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:42.337040 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.338562 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.341105 (+ 2543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.342479 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.342613 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:42.342854 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:42.343107 (+ 253us) server_negotiation.cc:299] Negotiation successful
0811 18:52:42.343287 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15160,"thread_start_us":15024,"threads_started":1}
I20260811 18:52:42.343673 29492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:42.319409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:35335 (local address 127.0.0.1:44548)
0811 18:52:42.329994 (+ 10585us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:42.330095 (+ 101us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:42.330402 (+ 307us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:42.336405 (+ 6003us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:42.336409 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:42.336442 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:42.336843 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:42.336860 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.338727 (+ 1867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.338734 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:42.340819 (+ 2085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:42.340849 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.342699 (+ 1850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.342710 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:42.342885 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:42.342918 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 18:52:42.343024 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 18:52:42.343282 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10171,"mutex_wait_us":32,"thread_start_us":9919,"threads_started":1}
I20260811 18:52:42.343784 29495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:42.319497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45674 (local address 127.25.25.1:37799)
0811 18:52:42.333800 (+ 14303us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:42.333811 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:42.333849 (+ 38us) server_negotiation.cc:407] Connection header received
0811 18:52:42.333973 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:42.333982 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:42.334325 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:42.334596 (+ 271us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:42.335717 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.337298 (+ 1581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.340277 (+ 2979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.341949 (+ 1672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.342091 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:42.342418 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:42.343205 (+ 787us) server_negotiation.cc:299] Negotiation successful
0811 18:52:42.343392 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14103,"thread_start_us":13964,"threads_started":1}
I20260811 18:52:42.344508 29493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:42.319463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:37799 (local address 127.0.0.1:45674)
0811 18:52:42.332742 (+ 13279us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:42.332769 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:42.332921 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:42.334946 (+ 2025us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:42.334954 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:42.335000 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:42.335460 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:42.335481 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.337494 (+ 2013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.337499 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:42.340024 (+ 2525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:42.340043 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.342557 (+ 2514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.342564 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:42.342825 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:42.342888 (+ 63us) client_negotiation.cc:769] Sending connection context
0811 18:52:42.343033 (+ 145us) client_negotiation.cc:240] Negotiation successful
0811 18:52:42.344160 (+ 1127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13089,"mutex_wait_us":901,"thread_start_us":13545,"threads_started":1}
I20260811 18:52:42.344674 29498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:42.319976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.3:38705 (local address 127.0.0.1:37684)
0811 18:52:42.336141 (+ 16165us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:42.336160 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:42.336302 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:42.337285 (+ 983us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:42.337290 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:42.337316 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:42.337809 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:42.337823 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.339509 (+ 1686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.339513 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:42.341598 (+ 2085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:42.341615 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.343878 (+ 2263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.343885 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:42.344061 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:42.344121 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 18:52:42.344210 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 18:52:42.344335 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16012,"mutex_wait_us":1,"thread_start_us":15849,"threads_started":1}
I20260811 18:52:42.348253 29500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:42.321096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37684 (local address 127.25.25.3:38705)
0811 18:52:42.335259 (+ 14163us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:42.335268 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:42.336284 (+ 1016us) server_negotiation.cc:407] Connection header received
0811 18:52:42.336519 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:42.336527 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:42.336758 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:42.336971 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:42.338073 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.339341 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.341862 (+ 2521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.343307 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.343449 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:42.343731 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:42.344975 (+ 1244us) server_negotiation.cc:299] Negotiation successful
0811 18:52:42.345120 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13977,"thread_start_us":13814,"threads_started":1}
I20260811 18:52:42.348556 28856 tablet_service.cc:1467] Processing CreateTablet for tablet 1f44972961d242ed94101a61e87e0ce2 (DEFAULT_TABLE table=test-table [id=ab26339db2c24762a3c4a2d124605f2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:42.348551 29085 tablet_service.cc:1467] Processing CreateTablet for tablet 1f44972961d242ed94101a61e87e0ce2 (DEFAULT_TABLE table=test-table [id=ab26339db2c24762a3c4a2d124605f2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:42.350224 28856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f44972961d242ed94101a61e87e0ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:42.350224 29085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f44972961d242ed94101a61e87e0ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:42.352114 29356 tablet_service.cc:1467] Processing CreateTablet for tablet 1f44972961d242ed94101a61e87e0ce2 (DEFAULT_TABLE table=test-table [id=ab26339db2c24762a3c4a2d124605f2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:42.353627 29356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f44972961d242ed94101a61e87e0ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:42.367396 29504 tablet_bootstrap.cc:492] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031: Bootstrap starting.
I20260811 18:52:42.371158 29504 tablet_bootstrap.cc:654] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:42.372238 29502 tablet_bootstrap.cc:492] T 1f44972961d242ed94101a61e87e0ce2 P 2bb41236bd0647c1ba03aee59a683d5d: Bootstrap starting.
I20260811 18:52:42.372305 29501 tablet_bootstrap.cc:492] T 1f44972961d242ed94101a61e87e0ce2 P 23210357d54e4466bb16f65b39595536: Bootstrap starting.
I20260811 18:52:42.372608 29504 log.cc:824] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:42.376567 29501 tablet_bootstrap.cc:654] T 1f44972961d242ed94101a61e87e0ce2 P 23210357d54e4466bb16f65b39595536: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:42.376588 29502 tablet_bootstrap.cc:654] T 1f44972961d242ed94101a61e87e0ce2 P 2bb41236bd0647c1ba03aee59a683d5d: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:42.377810 29501 log.cc:824] T 1f44972961d242ed94101a61e87e0ce2 P 23210357d54e4466bb16f65b39595536: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:42.377971 29502 log.cc:824] T 1f44972961d242ed94101a61e87e0ce2 P 2bb41236bd0647c1ba03aee59a683d5d: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:42.381258 29501 tablet_bootstrap.cc:492] T 1f44972961d242ed94101a61e87e0ce2 P 23210357d54e4466bb16f65b39595536: No bootstrap required, opened a new log
I20260811 18:52:42.381582 29502 tablet_bootstrap.cc:492] T 1f44972961d242ed94101a61e87e0ce2 P 2bb41236bd0647c1ba03aee59a683d5d: No bootstrap required, opened a new log
I20260811 18:52:42.381582 29504 tablet_bootstrap.cc:492] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031: No bootstrap required, opened a new log
I20260811 18:52:42.381587 29501 ts_tablet_manager.cc:1397] T 1f44972961d242ed94101a61e87e0ce2 P 23210357d54e4466bb16f65b39595536: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260811 18:52:42.381880 29502 ts_tablet_manager.cc:1397] T 1f44972961d242ed94101a61e87e0ce2 P 2bb41236bd0647c1ba03aee59a683d5d: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260811 18:52:42.381948 29504 ts_tablet_manager.cc:1397] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.007s
I20260811 18:52:42.389853 29501 raft_consensus.cc:348] T 1f44972961d242ed94101a61e87e0ce2 P 23210357d54e4466bb16f65b39595536 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb41236bd0647c1ba03aee59a683d5d" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 37799 } } peers { permanent_uuid: "23210357d54e4466bb16f65b39595536" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 35335 } } peers { permanent_uuid: "4edcdecd527c4f358f6504a54a9b7031" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 38705 } }
I20260811 18:52:42.390309 29501 raft_consensus.cc:374] T 1f44972961d242ed94101a61e87e0ce2 P 23210357d54e4466bb16f65b39595536 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:42.390434 29501 raft_consensus.cc:729] T 1f44972961d242ed94101a61e87e0ce2 P 23210357d54e4466bb16f65b39595536 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23210357d54e4466bb16f65b39595536, State: Initialized, Role: FOLLOWER
I20260811 18:52:42.391142 29501 consensus_queue.cc:260] T 1f44972961d242ed94101a61e87e0ce2 P 23210357d54e4466bb16f65b39595536 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb41236bd0647c1ba03aee59a683d5d" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 37799 } } peers { permanent_uuid: "23210357d54e4466bb16f65b39595536" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 35335 } } peers { permanent_uuid: "4edcdecd527c4f358f6504a54a9b7031" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 38705 } }
I20260811 18:52:42.392406 29234 heartbeater.cc:503] Master 127.25.25.62:43099 was elected leader, sending a full tablet report...
I20260811 18:52:42.393024 29501 ts_tablet_manager.cc:1428] T 1f44972961d242ed94101a61e87e0ce2 P 23210357d54e4466bb16f65b39595536: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260811 18:52:42.393795 29502 raft_consensus.cc:348] T 1f44972961d242ed94101a61e87e0ce2 P 2bb41236bd0647c1ba03aee59a683d5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb41236bd0647c1ba03aee59a683d5d" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 37799 } } peers { permanent_uuid: "23210357d54e4466bb16f65b39595536" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 35335 } } peers { permanent_uuid: "4edcdecd527c4f358f6504a54a9b7031" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 38705 } }
I20260811 18:52:42.393795 29504 raft_consensus.cc:348] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb41236bd0647c1ba03aee59a683d5d" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 37799 } } peers { permanent_uuid: "23210357d54e4466bb16f65b39595536" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 35335 } } peers { permanent_uuid: "4edcdecd527c4f358f6504a54a9b7031" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 38705 } }
I20260811 18:52:42.394317 29504 raft_consensus.cc:374] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:42.394317 29502 raft_consensus.cc:374] T 1f44972961d242ed94101a61e87e0ce2 P 2bb41236bd0647c1ba03aee59a683d5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:42.394436 29502 raft_consensus.cc:729] T 1f44972961d242ed94101a61e87e0ce2 P 2bb41236bd0647c1ba03aee59a683d5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb41236bd0647c1ba03aee59a683d5d, State: Initialized, Role: FOLLOWER
I20260811 18:52:42.394481 29504 raft_consensus.cc:729] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4edcdecd527c4f358f6504a54a9b7031, State: Initialized, Role: FOLLOWER
I20260811 18:52:42.395190 29502 consensus_queue.cc:260] T 1f44972961d242ed94101a61e87e0ce2 P 2bb41236bd0647c1ba03aee59a683d5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb41236bd0647c1ba03aee59a683d5d" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 37799 } } peers { permanent_uuid: "23210357d54e4466bb16f65b39595536" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 35335 } } peers { permanent_uuid: "4edcdecd527c4f358f6504a54a9b7031" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 38705 } }
I20260811 18:52:42.395195 29504 consensus_queue.cc:260] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb41236bd0647c1ba03aee59a683d5d" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 37799 } } peers { permanent_uuid: "23210357d54e4466bb16f65b39595536" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 35335 } } peers { permanent_uuid: "4edcdecd527c4f358f6504a54a9b7031" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 38705 } }
I20260811 18:52:42.396499 29472 heartbeater.cc:503] Master 127.25.25.62:43099 was elected leader, sending a full tablet report...
I20260811 18:52:42.397339 29504 ts_tablet_manager.cc:1428] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031: Time spent starting tablet: real 0.015s user 0.009s sys 0.004s
I20260811 18:52:42.399529 29502 ts_tablet_manager.cc:1428] T 1f44972961d242ed94101a61e87e0ce2 P 2bb41236bd0647c1ba03aee59a683d5d: Time spent starting tablet: real 0.018s user 0.014s sys 0.003s
W20260811 18:52:42.508219 29473 tablet.cc:2369] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:52:42.512180 29237 tablet.cc:2369] T 1f44972961d242ed94101a61e87e0ce2 P 23210357d54e4466bb16f65b39595536: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:52:42.512566 28965 tablet.cc:2369] T 1f44972961d242ed94101a61e87e0ce2 P 2bb41236bd0647c1ba03aee59a683d5d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:52:42.525027 29509 raft_consensus.cc:482] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:52:42.525337 29509 raft_consensus.cc:504] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb41236bd0647c1ba03aee59a683d5d" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 37799 } } peers { permanent_uuid: "23210357d54e4466bb16f65b39595536" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 35335 } } peers { permanent_uuid: "4edcdecd527c4f358f6504a54a9b7031" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 38705 } }
I20260811 18:52:42.527086 29509 leader_election.cc:288] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb41236bd0647c1ba03aee59a683d5d (127.25.25.1:37799), 23210357d54e4466bb16f65b39595536 (127.25.25.2:35335)
I20260811 18:52:42.533592 29495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:42.527471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:51831 (local address 127.25.25.1:37799)
0811 18:52:42.527697 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:42.527703 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:42.527727 (+ 24us) server_negotiation.cc:407] Connection header received
0811 18:52:42.527867 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:42.527874 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:42.527971 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:42.528100 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:42.528590 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.529475 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.531832 (+ 2357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.532707 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.532831 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:42.532946 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:42.533219 (+ 273us) server_negotiation.cc:299] Negotiation successful
0811 18:52:42.533355 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 18:52:42.533691 29474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:42.527376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:37799 (local address 127.25.25.3:51831)
0811 18:52:42.527548 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:42.527568 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:42.527701 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:42.528189 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:42.528194 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:42.528223 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:42.528431 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:42.528442 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.529636 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.529642 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:42.531655 (+ 2013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:42.531671 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.532864 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.532870 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:42.533065 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:42.533091 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 18:52:42.533175 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 18:52:42.533325 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 18:52:42.534075 29499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:42.527622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.25.3:32919 (local address 127.25.25.2:35335)
0811 18:52:42.527822 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:42.527828 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:42.528375 (+ 547us) server_negotiation.cc:407] Connection header received
0811 18:52:42.528540 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:42.528545 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:42.528635 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:42.528731 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:42.529243 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.530249 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.532452 (+ 2203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.533208 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.533325 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:42.533428 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:42.533695 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 18:52:42.533827 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 18:52:42.534126 29512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:42.527382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.2:35335 (local address 127.25.25.3:32919)
0811 18:52:42.528270 (+ 888us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:42.528290 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:42.528421 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:42.528749 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:42.528752 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:42.528772 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:42.529082 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:42.529090 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.530446 (+ 1356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.530455 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:42.532261 (+ 1806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:42.532275 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.533384 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.533390 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:42.533550 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:42.533574 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 18:52:42.533651 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 18:52:42.533778 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":765,"mutex_wait_us":244,"thread_start_us":293,"threads_started":1}
I20260811 18:52:42.535002 28891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f44972961d242ed94101a61e87e0ce2" candidate_uuid: "4edcdecd527c4f358f6504a54a9b7031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb41236bd0647c1ba03aee59a683d5d" is_pre_election: true
I20260811 18:52:42.535183 29121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f44972961d242ed94101a61e87e0ce2" candidate_uuid: "4edcdecd527c4f358f6504a54a9b7031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23210357d54e4466bb16f65b39595536" is_pre_election: true
I20260811 18:52:42.535694 28891 raft_consensus.cc:2454] T 1f44972961d242ed94101a61e87e0ce2 P 2bb41236bd0647c1ba03aee59a683d5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4edcdecd527c4f358f6504a54a9b7031 in term 0.
I20260811 18:52:42.535706 29121 raft_consensus.cc:2454] T 1f44972961d242ed94101a61e87e0ce2 P 23210357d54e4466bb16f65b39595536 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4edcdecd527c4f358f6504a54a9b7031 in term 0.
I20260811 18:52:42.536530 29277 leader_election.cc:302] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23210357d54e4466bb16f65b39595536, 4edcdecd527c4f358f6504a54a9b7031; no voters:
I20260811 18:52:42.536964 29509 raft_consensus.cc:2781] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:52:42.537117 29509 raft_consensus.cc:482] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:52:42.537225 29509 raft_consensus.cc:3037] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:42.539494 29509 raft_consensus.cc:504] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb41236bd0647c1ba03aee59a683d5d" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 37799 } } peers { permanent_uuid: "23210357d54e4466bb16f65b39595536" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 35335 } } peers { permanent_uuid: "4edcdecd527c4f358f6504a54a9b7031" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 38705 } }
I20260811 18:52:42.540278 29509 leader_election.cc:288] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb41236bd0647c1ba03aee59a683d5d (127.25.25.1:37799), 23210357d54e4466bb16f65b39595536 (127.25.25.2:35335)
I20260811 18:52:42.540877 29121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f44972961d242ed94101a61e87e0ce2" candidate_uuid: "4edcdecd527c4f358f6504a54a9b7031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23210357d54e4466bb16f65b39595536"
I20260811 18:52:42.540894 28891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f44972961d242ed94101a61e87e0ce2" candidate_uuid: "4edcdecd527c4f358f6504a54a9b7031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb41236bd0647c1ba03aee59a683d5d"
I20260811 18:52:42.541137 28891 raft_consensus.cc:3037] T 1f44972961d242ed94101a61e87e0ce2 P 2bb41236bd0647c1ba03aee59a683d5d [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:42.541138 29121 raft_consensus.cc:3037] T 1f44972961d242ed94101a61e87e0ce2 P 23210357d54e4466bb16f65b39595536 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:42.544513 28891 raft_consensus.cc:2454] T 1f44972961d242ed94101a61e87e0ce2 P 2bb41236bd0647c1ba03aee59a683d5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4edcdecd527c4f358f6504a54a9b7031 in term 1.
I20260811 18:52:42.544510 29121 raft_consensus.cc:2454] T 1f44972961d242ed94101a61e87e0ce2 P 23210357d54e4466bb16f65b39595536 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4edcdecd527c4f358f6504a54a9b7031 in term 1.
I20260811 18:52:42.545123 29274 leader_election.cc:302] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb41236bd0647c1ba03aee59a683d5d, 4edcdecd527c4f358f6504a54a9b7031; no voters:
I20260811 18:52:42.545459 29509 raft_consensus.cc:2781] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:42.545922 29509 raft_consensus.cc:686] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031 [term 1 LEADER]: Becoming Leader. State: Replica: 4edcdecd527c4f358f6504a54a9b7031, State: Running, Role: LEADER
I20260811 18:52:42.546460 29509 consensus_queue.cc:237] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb41236bd0647c1ba03aee59a683d5d" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 37799 } } peers { permanent_uuid: "23210357d54e4466bb16f65b39595536" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 35335 } } peers { permanent_uuid: "4edcdecd527c4f358f6504a54a9b7031" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 38705 } }
I20260811 18:52:42.551013 28638 catalog_manager.cc:5495] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4edcdecd527c4f358f6504a54a9b7031 (127.25.25.3). New cstate: current_term: 1 leader_uuid: "4edcdecd527c4f358f6504a54a9b7031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb41236bd0647c1ba03aee59a683d5d" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 37799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23210357d54e4466bb16f65b39595536" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 35335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4edcdecd527c4f358f6504a54a9b7031" member_type: VOTER last_known_addr { host: "127.25.25.3" port: 38705 } health_report { overall_health: HEALTHY } } }
I20260811 18:52:42.588863 29500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:42.583437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37698 (local address 127.25.25.3:38705)
0811 18:52:42.583631 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:42.583638 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:42.583659 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:52:42.583899 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:42.583903 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:42.584016 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:42.584193 (+ 177us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:52:42.584617 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.585331 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.586693 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.587109 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.587218 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:42.587723 (+ 505us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:52:42.588305 (+ 582us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:52:42.588453 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:42.588531 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 18:52:42.588618 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 18:52:42.597944 28891 raft_consensus.cc:1261] T 1f44972961d242ed94101a61e87e0ce2 P 2bb41236bd0647c1ba03aee59a683d5d [term 1 FOLLOWER]: Refusing update from remote peer 4edcdecd527c4f358f6504a54a9b7031: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:42.597931 29121 raft_consensus.cc:1261] T 1f44972961d242ed94101a61e87e0ce2 P 23210357d54e4466bb16f65b39595536 [term 1 FOLLOWER]: Refusing update from remote peer 4edcdecd527c4f358f6504a54a9b7031: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:42.599236 29509 consensus_queue.cc:1035] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23210357d54e4466bb16f65b39595536" member_type: VOTER last_known_addr { host: "127.25.25.2" port: 35335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:52:42.599582 29513 consensus_queue.cc:1035] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb41236bd0647c1ba03aee59a683d5d" member_type: VOTER last_known_addr { host: "127.25.25.1" port: 37799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:52:42.613034 29516 mvcc.cc:205] Tried to move back new op lower bound from 7317398989189488640 to 7317398988993875968. Current Snapshot: MvccSnapshot[applied={T|T < 7317398989189488640}]
I20260811 18:52:42.627907 28640 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33744:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:52:42.628224 28640 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33744:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:52:42.632520 28640 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 20bb179fdcbb461c9a4b4d29298b576a: Sending DeleteTablet for 3 replicas of tablet 1f44972961d242ed94101a61e87e0ce2
I20260811 18:52:42.633972 29085 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f44972961d242ed94101a61e87e0ce2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:42 UTC) from {username='slave'} at 127.0.0.1:44548
I20260811 18:52:42.633965 28856 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f44972961d242ed94101a61e87e0ce2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:42 UTC) from {username='slave'} at 127.0.0.1:45674
I20260811 18:52:42.634035 29356 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f44972961d242ed94101a61e87e0ce2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:42 UTC) from {username='slave'} at 127.0.0.1:37684
I20260811 18:52:42.637203 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 28748
I20260811 18:52:42.665697 29534 tablet_replica.cc:330] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031: stopping tablet replica
I20260811 18:52:42.666370 29534 raft_consensus.cc:2229] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:52:42.667243 29534 raft_consensus.cc:2258] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:42.670181 29531 tablet_replica.cc:330] T 1f44972961d242ed94101a61e87e0ce2 P 23210357d54e4466bb16f65b39595536: stopping tablet replica
I20260811 18:52:42.672343 29495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:42.638156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45690 (local address 127.25.25.1:37799)
0811 18:52:42.638346 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:42.638353 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:42.660258 (+ 21905us) server_negotiation.cc:407] Connection header received
0811 18:52:42.660855 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:42.660862 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:42.661026 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:42.661113 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:42.661896 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.663116 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.667612 (+ 4496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.668356 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.668467 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:42.670543 (+ 2076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:42.670558 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:42.670577 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:42.671340 (+ 763us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:42.671409 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:42.671453 (+ 44us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:42.671539 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:42.671776 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 18:52:42.671907 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 18:52:42.673434 29532 tablet_replica.cc:330] T 1f44972961d242ed94101a61e87e0ce2 P 2bb41236bd0647c1ba03aee59a683d5d: stopping tablet replica
I20260811 18:52:42.673391 29531 raft_consensus.cc:2229] T 1f44972961d242ed94101a61e87e0ce2 P 23210357d54e4466bb16f65b39595536 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:52:42.673617 28959 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:42.674010 29531 raft_consensus.cc:2258] T 1f44972961d242ed94101a61e87e0ce2 P 23210357d54e4466bb16f65b39595536 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:42.674957 29534 ts_tablet_manager.cc:1905] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:42.682569 29531 ts_tablet_manager.cc:1905] T 1f44972961d242ed94101a61e87e0ce2 P 23210357d54e4466bb16f65b39595536: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:42.683219 29534 ts_tablet_manager.cc:1918] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:52:42.683566 29534 log.cc:1196] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-2/wal/wals/1f44972961d242ed94101a61e87e0ce2
I20260811 18:52:42.684386 29534 ts_tablet_manager.cc:1939] T 1f44972961d242ed94101a61e87e0ce2 P 4edcdecd527c4f358f6504a54a9b7031: Deleting consensus metadata
I20260811 18:52:42.686966 28618 catalog_manager.cc:4841] TS 4edcdecd527c4f358f6504a54a9b7031 (127.25.25.3:38705): tablet 1f44972961d242ed94101a61e87e0ce2 (table test-table [id=ab26339db2c24762a3c4a2d124605f2a]) successfully deleted
I20260811 18:52:42.691516 29531 ts_tablet_manager.cc:1918] T 1f44972961d242ed94101a61e87e0ce2 P 23210357d54e4466bb16f65b39595536: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:52:42.691720 29531 log.cc:1196] T 1f44972961d242ed94101a61e87e0ce2 P 23210357d54e4466bb16f65b39595536: Deleting WAL directory at /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474012733352-25700-0/minicluster-data/ts-1/wal/wals/1f44972961d242ed94101a61e87e0ce2
I20260811 18:52:42.692350 29531 ts_tablet_manager.cc:1939] T 1f44972961d242ed94101a61e87e0ce2 P 23210357d54e4466bb16f65b39595536: Deleting consensus metadata
I20260811 18:52:42.694545 28619 catalog_manager.cc:4841] TS 23210357d54e4466bb16f65b39595536 (127.25.25.2:35335): tablet 1f44972961d242ed94101a61e87e0ce2 (table test-table [id=ab26339db2c24762a3c4a2d124605f2a]) successfully deleted
I20260811 18:52:42.673900 29532 raft_consensus.cc:2229] T 1f44972961d242ed94101a61e87e0ce2 P 2bb41236bd0647c1ba03aee59a683d5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:52:42.774755 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 28748
I20260811 18:52:42.774899 29532 raft_consensus.cc:2258] T 1f44972961d242ed94101a61e87e0ce2 P 2bb41236bd0647c1ba03aee59a683d5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:42.800885 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 28969
W20260811 18:52:42.800897 28617 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.25.1:37799 (error 108)
I20260811 18:52:42.802945 29498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:42.802396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:37799 (local address 127.0.0.1:45694)
0811 18:52:42.802606 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:42.802745 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:37799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260811 18:52:42.803249 28617 catalog_manager.cc:4584] TS 2bb41236bd0647c1ba03aee59a683d5d (127.25.25.1:37799): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1f44972961d242ed94101a61e87e0ce2: Network error: Client connection negotiation failed: client connection to 127.25.25.1:37799: connect: Connection refused (error 111)
I20260811 18:52:42.809612 29499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:42.802147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44560 (local address 127.25.25.2:35335)
0811 18:52:42.802357 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:42.802364 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:42.802383 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:52:42.802466 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:42.802471 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:42.802593 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:42.802689 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:42.803179 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.804053 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.806076 (+ 2023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.806516 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.806619 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:42.808022 (+ 1403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:42.808033 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:42.808050 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:42.808794 (+ 744us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:42.808849 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:42.808874 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:42.808998 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:42.809143 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 18:52:42.809274 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 18:52:42.810406 29222 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:42.857095 29498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:42.856623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:37799 (local address 127.0.0.1:45704)
0811 18:52:42.856834 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:42.856932 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:37799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260811 18:52:42.858184 29498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:42.857824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:37799 (local address 127.0.0.1:45710)
0811 18:52:42.857978 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:42.858057 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:37799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 18:52:42.919111 29498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:42.918585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:37799 (local address 127.0.0.1:45722)
0811 18:52:42.918814 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:42.918906 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:37799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260811 18:52:42.920310 29498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:42.919903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:37799 (local address 127.0.0.1:45728)
0811 18:52:42.920069 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:42.920184 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:37799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 18:52:42.959113 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 28969
I20260811 18:52:42.986603 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 29243
I20260811 18:52:42.995129 29500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:42.987533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37700 (local address 127.25.25.3:38705)
0811 18:52:42.987742 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:42.987749 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:42.987816 (+ 67us) server_negotiation.cc:407] Connection header received
0811 18:52:42.988032 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:42.988037 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:42.988224 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:42.988337 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:42.988891 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.989890 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.991376 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:42.991887 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:42.992041 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:42.993422 (+ 1381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:42.993435 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:42.993456 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:42.994176 (+ 720us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:42.994243 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:42.994269 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:42.994425 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:42.994574 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 18:52:42.994703 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 18:52:42.995981 29462 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:43.001154 29498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:43.000491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:37799 (local address 127.0.0.1:45732)
0811 18:52:43.000750 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:43.000871 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:37799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 18:52:43.002481 29498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:43.001987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:37799 (local address 127.0.0.1:45736)
0811 18:52:43.002226 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:43.002325 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:37799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260811 18:52:43.121944 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 29243
I20260811 18:52:43.155088 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 28584
I20260811 18:52:43.156303 28699 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:43.267979 29498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:43.267323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.1:37799 (local address 127.0.0.1:45750)
0811 18:52:43.267580 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:43.267696 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.1:37799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260811 18:52:43.268262 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 28584
2026-08-11T18:52:43Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3207 ms)
[----------] 6 tests from EncryptionPolicyTest (24964 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:52:43 dist-test-slave-lgr5 krb5kdc[29546](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:52:43 dist-test-slave-lgr5 krb5kdc[29546](info): set up 2 sockets
Aug 11 18:52:43 dist-test-slave-lgr5 krb5kdc[29546](info): commencing operation
krb5kdc: starting...
W20260811 18:52:44.582293 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.259s user 0.003s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:52:44 dist-test-slave-lgr5 krb5kdc[29546](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474364, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:52:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:52:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:52:44.919975 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34873
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34873
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:45.282076 29574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:45.282426 29574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:45.282557 29574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:45.290223 29574 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:52:45.290377 29574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:45.290443 29574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:45.290534 29574 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:52:45.290586 29574 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:52:45.301841 29574 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34873
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:45.303398 29574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:45.304963 29574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:45.320519 29582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:45.320482 29583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:45.320554 29586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:45.321072 29574 server_base.cc:1034] running on GCE node
I20260811 18:52:45.322043 29574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:45.323647 29574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:45.324864 29574 hybrid_clock.cc:648] HybridClock initialized: now 1786474365324801 us; error 61 us; skew 500 ppm
I20260811 18:52:45.325237 29574 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:52:45 dist-test-slave-lgr5 krb5kdc[29546](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474365, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:45.328591 29574 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:52:45.330231 29574 webserver.cc:460] Webserver started at http://127.0.0.1:45453/ using document root <none> and password file <none>
I20260811 18:52:45.331003 29574 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:45.331143 29574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:45.331477 29574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:45.335064 29574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "d3e8dc5d76a9490f9515fbbbb0790cba"
format_stamp: "Formatted at 2026-08-11 18:52:45 on dist-test-slave-lgr5"
server_key: "ffc1026dd0fd835a5d83bb5bf3ec3351"
server_key_iv: "c049edcd81f07e692b4263d7b7418808"
server_key_version: "encryptionkey@0"
I20260811 18:52:45.336001 29574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "d3e8dc5d76a9490f9515fbbbb0790cba"
format_stamp: "Formatted at 2026-08-11 18:52:45 on dist-test-slave-lgr5"
server_key: "ffc1026dd0fd835a5d83bb5bf3ec3351"
server_key_iv: "c049edcd81f07e692b4263d7b7418808"
server_key_version: "encryptionkey@0"
I20260811 18:52:45.341939 29574 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260811 18:52:45.345994 29605 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:45.347683 29574 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260811 18:52:45.347925 29574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "d3e8dc5d76a9490f9515fbbbb0790cba"
format_stamp: "Formatted at 2026-08-11 18:52:45 on dist-test-slave-lgr5"
server_key: "ffc1026dd0fd835a5d83bb5bf3ec3351"
server_key_iv: "c049edcd81f07e692b4263d7b7418808"
server_key_version: "encryptionkey@0"
I20260811 18:52:45.348213 29574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:45.373225 29574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:45.378355 29574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:45.378664 29574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:45.397862 29574 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34873
I20260811 18:52:45.397886 29711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34873 every 8 connection(s)
I20260811 18:52:45.399497 29574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:52:45.403594 29715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:45.406332 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 29574
I20260811 18:52:45.406551 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:52:45.407176 25700 external_mini_cluster.cc:1428] Setting key d5eb2847fad7a97077a99171d9c6197b
I20260811 18:52:45.417171 29715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3e8dc5d76a9490f9515fbbbb0790cba: Bootstrap starting.
I20260811 18:52:45.420976 29715 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d3e8dc5d76a9490f9515fbbbb0790cba: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:45.422135 29715 log.cc:824] T 00000000000000000000000000000000 P d3e8dc5d76a9490f9515fbbbb0790cba: Log is configured to *not* fsync() on all Append() calls
Aug 11 18:52:45 dist-test-slave-lgr5 krb5kdc[29546](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474364, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 18:52:45.426010 29715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3e8dc5d76a9490f9515fbbbb0790cba: No bootstrap required, opened a new log
I20260811 18:52:45.434473 29718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:45.409495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60195 (local address 127.0.0.1:34873)
0811 18:52:45.410382 (+ 887us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:45.410399 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:45.410451 (+ 52us) server_negotiation.cc:407] Connection header received
0811 18:52:45.412759 (+ 2308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:45.412797 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:45.413447 (+ 650us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:45.413965 (+ 518us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:45.415514 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:45.417518 (+ 2004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:45.418911 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:45.419956 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:45.420177 (+ 221us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:45.425368 (+ 5191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:45.425379 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:45.425397 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:45.425446 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:45.429063 (+ 3617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:45.430322 (+ 1259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:45.430332 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:45.430340 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:45.430567 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:45.431217 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:45.431221 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:45.431224 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:45.431904 (+ 680us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:45.432246 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:45.432785 (+ 539us) server_negotiation.cc:299] Negotiation successful
0811 18:52:45.433197 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":636,"thread_start_us":397,"threads_started":1}
I20260811 18:52:45.435659 29715 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3e8dc5d76a9490f9515fbbbb0790cba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3e8dc5d76a9490f9515fbbbb0790cba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34873 } }
I20260811 18:52:45.436111 29715 raft_consensus.cc:374] T 00000000000000000000000000000000 P d3e8dc5d76a9490f9515fbbbb0790cba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:45.436260 29715 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3e8dc5d76a9490f9515fbbbb0790cba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3e8dc5d76a9490f9515fbbbb0790cba, State: Initialized, Role: FOLLOWER
I20260811 18:52:45.436883 29715 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3e8dc5d76a9490f9515fbbbb0790cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3e8dc5d76a9490f9515fbbbb0790cba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34873 } }
I20260811 18:52:45.437150 29715 raft_consensus.cc:388] T 00000000000000000000000000000000 P d3e8dc5d76a9490f9515fbbbb0790cba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:52:45.437322 29715 raft_consensus.cc:482] T 00000000000000000000000000000000 P d3e8dc5d76a9490f9515fbbbb0790cba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:52:45.437536 29715 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3e8dc5d76a9490f9515fbbbb0790cba [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:45.439334 25700 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:52:45.440320 29715 raft_consensus.cc:504] T 00000000000000000000000000000000 P d3e8dc5d76a9490f9515fbbbb0790cba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3e8dc5d76a9490f9515fbbbb0790cba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34873 } }
I20260811 18:52:45.440871 29715 leader_election.cc:302] T 00000000000000000000000000000000 P d3e8dc5d76a9490f9515fbbbb0790cba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d3e8dc5d76a9490f9515fbbbb0790cba; no voters:
I20260811 18:52:45.441510 29715 leader_election.cc:288] T 00000000000000000000000000000000 P d3e8dc5d76a9490f9515fbbbb0790cba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:52:45.441704 29722 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d3e8dc5d76a9490f9515fbbbb0790cba [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:45.443739 29715 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3e8dc5d76a9490f9515fbbbb0790cba [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:52:45.444717 29722 raft_consensus.cc:686] T 00000000000000000000000000000000 P d3e8dc5d76a9490f9515fbbbb0790cba [term 1 LEADER]: Becoming Leader. State: Replica: d3e8dc5d76a9490f9515fbbbb0790cba, State: Running, Role: LEADER
I20260811 18:52:45.445632 29722 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3e8dc5d76a9490f9515fbbbb0790cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3e8dc5d76a9490f9515fbbbb0790cba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34873 } }
I20260811 18:52:45.449091 29724 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3e8dc5d76a9490f9515fbbbb0790cba [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3e8dc5d76a9490f9515fbbbb0790cba. Latest consensus state: current_term: 1 leader_uuid: "d3e8dc5d76a9490f9515fbbbb0790cba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3e8dc5d76a9490f9515fbbbb0790cba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34873 } } }
I20260811 18:52:45.449594 29724 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3e8dc5d76a9490f9515fbbbb0790cba [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:45.450341 29723 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3e8dc5d76a9490f9515fbbbb0790cba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d3e8dc5d76a9490f9515fbbbb0790cba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3e8dc5d76a9490f9515fbbbb0790cba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34873 } } }
I20260811 18:52:45.450730 29723 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3e8dc5d76a9490f9515fbbbb0790cba [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:45.459121 29739 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:52:45.468127 29739 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:52:45.478647 29718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:45.460544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55413 (local address 127.0.0.1:34873)
0811 18:52:45.460775 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:45.460783 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:45.461817 (+ 1034us) server_negotiation.cc:407] Connection header received
0811 18:52:45.462163 (+ 346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:45.462170 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:45.462270 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:45.462364 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:45.464534 (+ 2170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:45.465408 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:45.467393 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:45.467912 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:45.468043 (+ 131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:45.471006 (+ 2963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:45.471014 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:45.471018 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:45.471067 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:45.474469 (+ 3402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:45.475908 (+ 1439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:45.475914 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:45.475918 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:45.476153 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:45.476815 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:45.476820 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:45.476823 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:45.477331 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:45.477591 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:45.478070 (+ 479us) server_negotiation.cc:299] Negotiation successful
0811 18:52:45.478270 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 18:52:45.481281 29739 catalog_manager.cc:1347] Generated new cluster ID: ece01d2d15124862ae222c08690160fa
I20260811 18:52:45.481426 29739 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:52:45.501338 29739 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:52:45.503427 29739 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:52:45.519550 29739 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d3e8dc5d76a9490f9515fbbbb0790cba: Generated new TSK 0
I20260811 18:52:45.520862 29739 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:52:45.531049 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 29574
I20260811 18:52:45.533545 29705 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:45.628556 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 29574
W20260811 18:52:45.654702 29542 connection.cc:535] client connection to 127.0.0.1:34873 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34873): Connection reset by peer (error 104)
2026-08-11T18:52:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2351 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:52:45 dist-test-slave-lgr5 krb5kdc[29768](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:52:45 dist-test-slave-lgr5 krb5kdc[29768](info): set up 2 sockets
Aug 11 18:52:45 dist-test-slave-lgr5 krb5kdc[29768](info): commencing operation
krb5kdc: starting...
W20260811 18:52:46.954908 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.000s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:52:47 dist-test-slave-lgr5 krb5kdc[29768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474367, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:52:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:52:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:52:47.296320 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32913
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32913
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:47.671268 29794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:47.671622 29794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:47.671783 29794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:47.679607 29794 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:52:47.679757 29794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:47.679840 29794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:47.679934 29794 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:52:47.679998 29794 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:52:47.691098 29794 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32913
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:47.692663 29794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:47.694202 29794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:47.707291 29801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:47.707195 29807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:47.707229 29802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:47.708033 29794 server_base.cc:1034] running on GCE node
I20260811 18:52:47.708932 29794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:47.710448 29794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:47.711664 29794 hybrid_clock.cc:648] HybridClock initialized: now 1786474367711607 us; error 51 us; skew 500 ppm
I20260811 18:52:47.712025 29794 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:52:47 dist-test-slave-lgr5 krb5kdc[29768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474367, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:47.718465 29794 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:52:47.720219 29794 webserver.cc:460] Webserver started at http://127.0.0.1:34827/ using document root <none> and password file <none>
I20260811 18:52:47.720988 29794 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:47.721124 29794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:47.721447 29794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:47.724807 29794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "9a165c5b7381454ba38cd6cbf11032f6"
format_stamp: "Formatted at 2026-08-11 18:52:47 on dist-test-slave-lgr5"
server_key: "3129b88dcbae39e1230e22e89dd8267e"
server_key_iv: "b9a47d232fcd342079608a711cf6a977"
server_key_version: "encryptionkey@0"
I20260811 18:52:47.725664 29794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "9a165c5b7381454ba38cd6cbf11032f6"
format_stamp: "Formatted at 2026-08-11 18:52:47 on dist-test-slave-lgr5"
server_key: "3129b88dcbae39e1230e22e89dd8267e"
server_key_iv: "b9a47d232fcd342079608a711cf6a977"
server_key_version: "encryptionkey@0"
I20260811 18:52:47.731437 29794 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 18:52:47.735424 29825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:47.736954 29794 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:52:47.737138 29794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "9a165c5b7381454ba38cd6cbf11032f6"
format_stamp: "Formatted at 2026-08-11 18:52:47 on dist-test-slave-lgr5"
server_key: "3129b88dcbae39e1230e22e89dd8267e"
server_key_iv: "b9a47d232fcd342079608a711cf6a977"
server_key_version: "encryptionkey@0"
I20260811 18:52:47.737339 29794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:47.761950 29794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:47.766458 29794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:47.766737 29794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:47.786087 29794 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32913
I20260811 18:52:47.786118 29910 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32913 every 8 connection(s)
I20260811 18:52:47.788010 29794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:52:47.791570 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 29794
I20260811 18:52:47.791731 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:52:47.792254 25700 external_mini_cluster.cc:1428] Setting key 1b0392a7e18413cb092408c2b7f20c54
I20260811 18:52:47.792689 29911 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:47.809918 29911 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a165c5b7381454ba38cd6cbf11032f6: Bootstrap starting.
I20260811 18:52:47.810240 29917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:47.794329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46861 (local address 127.0.0.1:32913)
0811 18:52:47.795395 (+ 1066us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:47.795414 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:47.795476 (+ 62us) server_negotiation.cc:407] Connection header received
0811 18:52:47.798419 (+ 2943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:47.798466 (+ 47us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:47.799270 (+ 804us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:47.799895 (+ 625us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:47.800652 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:47.802743 (+ 2091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:47.804398 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:47.805528 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:47.805743 (+ 215us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:47.807032 (+ 1289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:47.807044 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:47.807065 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:47.807885 (+ 820us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:47.807996 (+ 111us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:47.808032 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:47.808236 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:47.808517 (+ 281us) server_negotiation.cc:299] Negotiation successful
0811 18:52:47.808711 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":764,"thread_start_us":440,"threads_started":1}
I20260811 18:52:47.813604 29911 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9a165c5b7381454ba38cd6cbf11032f6: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:47.814864 29911 log.cc:824] T 00000000000000000000000000000000 P 9a165c5b7381454ba38cd6cbf11032f6: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:47.815213 25700 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:52:47.818331 29911 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a165c5b7381454ba38cd6cbf11032f6: No bootstrap required, opened a new log
I20260811 18:52:47.827762 29917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:47.820218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57423 (local address 127.0.0.1:32913)
0811 18:52:47.820472 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:47.820478 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:47.820876 (+ 398us) server_negotiation.cc:407] Connection header received
0811 18:52:47.821093 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:47.821097 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:47.821174 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:47.821270 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:47.821947 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:47.822784 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:47.824864 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:47.825400 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:47.825528 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:47.826901 (+ 1373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:47.826910 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:47.826913 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:47.826937 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:47.826985 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:47.827002 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:47.827097 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:47.827362 (+ 265us) server_negotiation.cc:299] Negotiation successful
0811 18:52:47.827433 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 18:52:47.828601 29911 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9a165c5b7381454ba38cd6cbf11032f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a165c5b7381454ba38cd6cbf11032f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32913 } }
I20260811 18:52:47.829046 29911 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9a165c5b7381454ba38cd6cbf11032f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:47.829149 29911 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9a165c5b7381454ba38cd6cbf11032f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a165c5b7381454ba38cd6cbf11032f6, State: Initialized, Role: FOLLOWER
I20260811 18:52:47.829757 29911 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a165c5b7381454ba38cd6cbf11032f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a165c5b7381454ba38cd6cbf11032f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32913 } }
I20260811 18:52:47.829999 29911 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9a165c5b7381454ba38cd6cbf11032f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:52:47.830142 29911 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9a165c5b7381454ba38cd6cbf11032f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:52:47.830303 29911 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9a165c5b7381454ba38cd6cbf11032f6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:47.832751 29911 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9a165c5b7381454ba38cd6cbf11032f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a165c5b7381454ba38cd6cbf11032f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32913 } }
I20260811 18:52:47.833343 29911 leader_election.cc:302] T 00000000000000000000000000000000 P 9a165c5b7381454ba38cd6cbf11032f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9a165c5b7381454ba38cd6cbf11032f6; no voters:
I20260811 18:52:47.833972 29911 leader_election.cc:288] T 00000000000000000000000000000000 P 9a165c5b7381454ba38cd6cbf11032f6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:52:47.834124 29928 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9a165c5b7381454ba38cd6cbf11032f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:47.834803 29928 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9a165c5b7381454ba38cd6cbf11032f6 [term 1 LEADER]: Becoming Leader. State: Replica: 9a165c5b7381454ba38cd6cbf11032f6, State: Running, Role: LEADER
I20260811 18:52:47.835413 29928 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9a165c5b7381454ba38cd6cbf11032f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a165c5b7381454ba38cd6cbf11032f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32913 } }
I20260811 18:52:47.836380 29911 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9a165c5b7381454ba38cd6cbf11032f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:52:47.838666 29930 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a165c5b7381454ba38cd6cbf11032f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a165c5b7381454ba38cd6cbf11032f6. Latest consensus state: current_term: 1 leader_uuid: "9a165c5b7381454ba38cd6cbf11032f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a165c5b7381454ba38cd6cbf11032f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32913 } } }
I20260811 18:52:47.839167 29930 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a165c5b7381454ba38cd6cbf11032f6 [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:47.838757 29929 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a165c5b7381454ba38cd6cbf11032f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9a165c5b7381454ba38cd6cbf11032f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a165c5b7381454ba38cd6cbf11032f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32913 } } }
I20260811 18:52:47.839525 29929 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a165c5b7381454ba38cd6cbf11032f6 [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:47.841449 29942 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:52:47.846866 29942 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:52:47.859699 29942 catalog_manager.cc:1347] Generated new cluster ID: 4a419906bb0e4c1aaec97c09921c224b
I20260811 18:52:47.859843 29942 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:52:47.894690 29942 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:52:47.896622 29942 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:52:47.906594 29942 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9a165c5b7381454ba38cd6cbf11032f6: Generated new TSK 0
I20260811 18:52:47.907522 29942 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:52:47.913980 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 29794
W20260811 18:52:47.915370 29904 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:46861
W20260811 18:52:47.916318 25700 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 29794: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:52:47.916574 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 29794
W20260811 18:52:47.946970 29765 connection.cc:535] client connection to 127.0.0.1:32913 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:32913): Connection reset by peer (error 104)
2026-08-11T18:52:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2292 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:52:48 dist-test-slave-lgr5 krb5kdc[29964](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:52:48 dist-test-slave-lgr5 krb5kdc[29964](info): set up 2 sockets
Aug 11 18:52:48 dist-test-slave-lgr5 krb5kdc[29964](info): commencing operation
krb5kdc: starting...
W20260811 18:52:49.248510 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.282s user 0.000s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:52:49 dist-test-slave-lgr5 krb5kdc[29964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474369, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:52:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:52:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:52:49.600705 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38307
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38307
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:49.966493 29992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:49.966831 29992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:49.966957 29992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:49.976099 29992 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:52:49.976269 29992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:49.976357 29992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:49.976454 29992 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:52:49.976521 29992 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:52:49.988174 29992 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38307
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38307
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:49.989622 29992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:49.991012 29992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:50.005028 30002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:50.005007 30006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:50.004966 30003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:50.005857 29992 server_base.cc:1034] running on GCE node
I20260811 18:52:50.006775 29992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:50.008529 29992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:50.009783 29992 hybrid_clock.cc:648] HybridClock initialized: now 1786474370009713 us; error 60 us; skew 500 ppm
I20260811 18:52:50.010196 29992 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:52:50 dist-test-slave-lgr5 krb5kdc[29964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474370, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:50.013895 29992 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:52:50.015718 29992 webserver.cc:460] Webserver started at http://127.0.0.1:34087/ using document root <none> and password file <none>
I20260811 18:52:50.016559 29992 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:50.016692 29992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:50.017037 29992 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:50.020473 29992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "c8d822e08ec749fab81cc74841a55b5c"
format_stamp: "Formatted at 2026-08-11 18:52:50 on dist-test-slave-lgr5"
server_key: "3a6719592530292d9a1c19e4a154673c"
server_key_iv: "871cab6a87f5651b75d2eb00fc77c333"
server_key_version: "encryptionkey@0"
I20260811 18:52:50.021323 29992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "c8d822e08ec749fab81cc74841a55b5c"
format_stamp: "Formatted at 2026-08-11 18:52:50 on dist-test-slave-lgr5"
server_key: "3a6719592530292d9a1c19e4a154673c"
server_key_iv: "871cab6a87f5651b75d2eb00fc77c333"
server_key_version: "encryptionkey@0"
I20260811 18:52:50.027674 29992 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.003s
I20260811 18:52:50.032071 30023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:50.033685 29992 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:52:50.033913 29992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "c8d822e08ec749fab81cc74841a55b5c"
format_stamp: "Formatted at 2026-08-11 18:52:50 on dist-test-slave-lgr5"
server_key: "3a6719592530292d9a1c19e4a154673c"
server_key_iv: "871cab6a87f5651b75d2eb00fc77c333"
server_key_version: "encryptionkey@0"
I20260811 18:52:50.034139 29992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:50.040534 29992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:50.045121 29992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:50.045426 29992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:50.064227 29992 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38307
I20260811 18:52:50.064281 30121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38307 every 8 connection(s)
I20260811 18:52:50.065800 29992 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:52:50.069957 30123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:50.075559 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 29992
I20260811 18:52:50.075798 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:52:50.076558 25700 external_mini_cluster.cc:1428] Setting key 104d33730f1a0307b03633ce8b7e4d16
I20260811 18:52:50.083995 30123 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8d822e08ec749fab81cc74841a55b5c: Bootstrap starting.
I20260811 18:52:50.086766 30127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:50.078828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58131 (local address 127.0.0.1:38307)
0811 18:52:50.080368 (+ 1540us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:50.080386 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:50.080450 (+ 64us) server_negotiation.cc:407] Connection header received
0811 18:52:50.082533 (+ 2083us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:50.082566 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:50.082998 (+ 432us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:50.083400 (+ 402us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:50.084783 (+ 1383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:50.084791 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:50.084807 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:50.084827 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:50.084897 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:50.084929 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:50.085138 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:50.085254 (+ 116us) server_negotiation.cc:299] Negotiation successful
0811 18:52:50.085519 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1191,"thread_start_us":627,"threads_started":1}
I20260811 18:52:50.088258 30123 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8d822e08ec749fab81cc74841a55b5c: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:50.089608 30123 log.cc:824] T 00000000000000000000000000000000 P c8d822e08ec749fab81cc74841a55b5c: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:50.091814 25700 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:52:50.093418 30123 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8d822e08ec749fab81cc74841a55b5c: No bootstrap required, opened a new log
I20260811 18:52:50.099653 30127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:50.096666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41861 (local address 127.0.0.1:38307)
0811 18:52:50.096915 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:50.096922 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:50.097253 (+ 331us) server_negotiation.cc:407] Connection header received
0811 18:52:50.097466 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:50.097471 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:50.097531 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:50.097630 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:50.098903 (+ 1273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:50.098908 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:50.098911 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:50.098932 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:50.099001 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:50.099020 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:50.099150 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:50.099274 (+ 124us) server_negotiation.cc:299] Negotiation successful
0811 18:52:50.099359 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 18:52:50.103468 30123 raft_consensus.cc:348] T 00000000000000000000000000000000 P c8d822e08ec749fab81cc74841a55b5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8d822e08ec749fab81cc74841a55b5c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38307 } }
I20260811 18:52:50.103996 30123 raft_consensus.cc:374] T 00000000000000000000000000000000 P c8d822e08ec749fab81cc74841a55b5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:50.104151 30123 raft_consensus.cc:729] T 00000000000000000000000000000000 P c8d822e08ec749fab81cc74841a55b5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8d822e08ec749fab81cc74841a55b5c, State: Initialized, Role: FOLLOWER
I20260811 18:52:50.104849 30123 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8d822e08ec749fab81cc74841a55b5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8d822e08ec749fab81cc74841a55b5c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38307 } }
I20260811 18:52:50.105150 30123 raft_consensus.cc:388] T 00000000000000000000000000000000 P c8d822e08ec749fab81cc74841a55b5c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:52:50.105324 30123 raft_consensus.cc:482] T 00000000000000000000000000000000 P c8d822e08ec749fab81cc74841a55b5c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:52:50.105525 30123 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c8d822e08ec749fab81cc74841a55b5c [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:50.108336 30123 raft_consensus.cc:504] T 00000000000000000000000000000000 P c8d822e08ec749fab81cc74841a55b5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8d822e08ec749fab81cc74841a55b5c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38307 } }
I20260811 18:52:50.108963 30123 leader_election.cc:302] T 00000000000000000000000000000000 P c8d822e08ec749fab81cc74841a55b5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c8d822e08ec749fab81cc74841a55b5c; no voters:
I20260811 18:52:50.109659 30123 leader_election.cc:288] T 00000000000000000000000000000000 P c8d822e08ec749fab81cc74841a55b5c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:52:50.109817 30143 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c8d822e08ec749fab81cc74841a55b5c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:50.110642 30143 raft_consensus.cc:686] T 00000000000000000000000000000000 P c8d822e08ec749fab81cc74841a55b5c [term 1 LEADER]: Becoming Leader. State: Replica: c8d822e08ec749fab81cc74841a55b5c, State: Running, Role: LEADER
I20260811 18:52:50.111267 30143 consensus_queue.cc:237] T 00000000000000000000000000000000 P c8d822e08ec749fab81cc74841a55b5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8d822e08ec749fab81cc74841a55b5c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38307 } }
I20260811 18:52:50.112219 30123 sys_catalog.cc:564] T 00000000000000000000000000000000 P c8d822e08ec749fab81cc74841a55b5c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:52:50.114728 30146 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8d822e08ec749fab81cc74841a55b5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c8d822e08ec749fab81cc74841a55b5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8d822e08ec749fab81cc74841a55b5c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38307 } } }
I20260811 18:52:50.115142 30146 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8d822e08ec749fab81cc74841a55b5c [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:50.114640 30148 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8d822e08ec749fab81cc74841a55b5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8d822e08ec749fab81cc74841a55b5c. Latest consensus state: current_term: 1 leader_uuid: "c8d822e08ec749fab81cc74841a55b5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8d822e08ec749fab81cc74841a55b5c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38307 } } }
I20260811 18:52:50.115857 30148 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8d822e08ec749fab81cc74841a55b5c [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:50.117125 30152 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:52:50.122613 30152 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:52:50.133462 30152 catalog_manager.cc:1347] Generated new cluster ID: 48b598ed9db44b9b8e607d9aa0c9e299
I20260811 18:52:50.133627 30152 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:52:50.154539 30152 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:52:50.155066 30152 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:52:50.169570 30152 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c8d822e08ec749fab81cc74841a55b5c: Generated new TSK 0
I20260811 18:52:50.170535 30152 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:52:50.180765 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 29992
W20260811 18:52:50.181982 30117 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:58131
W20260811 18:52:50.182751 25700 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 29992: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:52:50.182886 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 29992
2026-08-11T18:52:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2264 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:52:50 dist-test-slave-lgr5 krb5kdc[30179](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:52:50 dist-test-slave-lgr5 krb5kdc[30179](info): set up 2 sockets
Aug 11 18:52:50 dist-test-slave-lgr5 krb5kdc[30179](info): commencing operation
krb5kdc: starting...
W20260811 18:52:51.496667 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.266s user 0.002s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:52:51 dist-test-slave-lgr5 krb5kdc[30179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474371, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:52:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:52:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:52:51.870548 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33261
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33261
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:52.268868 30200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:52.269243 30200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:52.269397 30200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:52.277247 30200 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:52:52.277426 30200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:52.277518 30200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:52.277604 30200 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:52:52.277666 30200 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:52:52.289077 30200 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33261
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33261
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:52.290582 30200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:52.292167 30200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:52.305999 30209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:52.306067 30211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:52.306035 30214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:52.307346 30200 server_base.cc:1034] running on GCE node
I20260811 18:52:52.308382 30200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:52.310060 30200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:52.311286 30200 hybrid_clock.cc:648] HybridClock initialized: now 1786474372311235 us; error 45 us; skew 500 ppm
I20260811 18:52:52.311695 30200 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:52:52 dist-test-slave-lgr5 krb5kdc[30179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474372, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:52.315304 30200 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:52:52.317625 30200 webserver.cc:460] Webserver started at http://127.0.0.1:46847/ using document root <none> and password file <none>
I20260811 18:52:52.318506 30200 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:52.318687 30200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:52.319052 30200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:52.322768 30200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "b7f5343d6c4c428d977e3921bfef3ccb"
format_stamp: "Formatted at 2026-08-11 18:52:52 on dist-test-slave-lgr5"
server_key: "5d74efc2bf60310a858dfad0c53e1cab"
server_key_iv: "cd65554bb2a37c8c7d234303160be2f8"
server_key_version: "encryptionkey@0"
I20260811 18:52:52.323760 30200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "b7f5343d6c4c428d977e3921bfef3ccb"
format_stamp: "Formatted at 2026-08-11 18:52:52 on dist-test-slave-lgr5"
server_key: "5d74efc2bf60310a858dfad0c53e1cab"
server_key_iv: "cd65554bb2a37c8c7d234303160be2f8"
server_key_version: "encryptionkey@0"
I20260811 18:52:52.329885 30200 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260811 18:52:52.334198 30226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:52.336046 30200 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260811 18:52:52.336351 30200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "b7f5343d6c4c428d977e3921bfef3ccb"
format_stamp: "Formatted at 2026-08-11 18:52:52 on dist-test-slave-lgr5"
server_key: "5d74efc2bf60310a858dfad0c53e1cab"
server_key_iv: "cd65554bb2a37c8c7d234303160be2f8"
server_key_version: "encryptionkey@0"
I20260811 18:52:52.336601 30200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:52.368554 30200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:52.373364 30200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:52.373693 30200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:52.393558 30200 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33261
I20260811 18:52:52.393595 30318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33261 every 8 connection(s)
I20260811 18:52:52.395069 30200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:52:52.399257 30320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:52.401360 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 30200
I20260811 18:52:52.401556 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:52:52.402140 25700 external_mini_cluster.cc:1428] Setting key 775ec5e8954a1b20afa7d0faef143681
I20260811 18:52:52.416919 30320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b7f5343d6c4c428d977e3921bfef3ccb: Bootstrap starting.
Aug 11 18:52:52 dist-test-slave-lgr5 krb5kdc[30179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474371, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 18:52:52.421531 30320 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b7f5343d6c4c428d977e3921bfef3ccb: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:52.423106 30320 log.cc:824] T 00000000000000000000000000000000 P b7f5343d6c4c428d977e3921bfef3ccb: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:52.427380 30320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b7f5343d6c4c428d977e3921bfef3ccb: No bootstrap required, opened a new log
I20260811 18:52:52.431962 30324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:52.404406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45605 (local address 127.0.0.1:33261)
0811 18:52:52.405383 (+ 977us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:52.405397 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:52.405455 (+ 58us) server_negotiation.cc:407] Connection header received
0811 18:52:52.407503 (+ 2048us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:52.407542 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:52.408375 (+ 833us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:52.408833 (+ 458us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:52.411242 (+ 2409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:52.412911 (+ 1669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:52.415107 (+ 2196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:52.416134 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:52.416356 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:52.421975 (+ 5619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:52.421989 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:52.422009 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:52.422070 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:52.425926 (+ 3856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:52.427212 (+ 1286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:52.427220 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:52.427228 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:52.427520 (+ 292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:52.428222 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:52.428239 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:52.428242 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:52.428953 (+ 711us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:52.429213 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:52.429980 (+ 767us) server_negotiation.cc:299] Negotiation successful
0811 18:52:52.430645 (+ 665us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":711,"thread_start_us":430,"threads_started":1}
I20260811 18:52:52.436967 25700 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:52:52.437765 30320 raft_consensus.cc:348] T 00000000000000000000000000000000 P b7f5343d6c4c428d977e3921bfef3ccb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7f5343d6c4c428d977e3921bfef3ccb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33261 } }
I20260811 18:52:52.438290 30320 raft_consensus.cc:374] T 00000000000000000000000000000000 P b7f5343d6c4c428d977e3921bfef3ccb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:52.438405 30320 raft_consensus.cc:729] T 00000000000000000000000000000000 P b7f5343d6c4c428d977e3921bfef3ccb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7f5343d6c4c428d977e3921bfef3ccb, State: Initialized, Role: FOLLOWER
I20260811 18:52:52.439142 30320 consensus_queue.cc:260] T 00000000000000000000000000000000 P b7f5343d6c4c428d977e3921bfef3ccb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7f5343d6c4c428d977e3921bfef3ccb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33261 } }
I20260811 18:52:52.439489 30320 raft_consensus.cc:388] T 00000000000000000000000000000000 P b7f5343d6c4c428d977e3921bfef3ccb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:52:52.439647 30320 raft_consensus.cc:482] T 00000000000000000000000000000000 P b7f5343d6c4c428d977e3921bfef3ccb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:52:52.439855 30320 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b7f5343d6c4c428d977e3921bfef3ccb [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:52.443429 30320 raft_consensus.cc:504] T 00000000000000000000000000000000 P b7f5343d6c4c428d977e3921bfef3ccb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7f5343d6c4c428d977e3921bfef3ccb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33261 } }
I20260811 18:52:52.444325 30320 leader_election.cc:302] T 00000000000000000000000000000000 P b7f5343d6c4c428d977e3921bfef3ccb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b7f5343d6c4c428d977e3921bfef3ccb; no voters:
I20260811 18:52:52.445096 30320 leader_election.cc:288] T 00000000000000000000000000000000 P b7f5343d6c4c428d977e3921bfef3ccb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:52:52.445238 30333 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b7f5343d6c4c428d977e3921bfef3ccb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:52.447988 30320 sys_catalog.cc:564] T 00000000000000000000000000000000 P b7f5343d6c4c428d977e3921bfef3ccb [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:52:52.448414 30333 raft_consensus.cc:686] T 00000000000000000000000000000000 P b7f5343d6c4c428d977e3921bfef3ccb [term 1 LEADER]: Becoming Leader. State: Replica: b7f5343d6c4c428d977e3921bfef3ccb, State: Running, Role: LEADER
I20260811 18:52:52.449167 30333 consensus_queue.cc:237] T 00000000000000000000000000000000 P b7f5343d6c4c428d977e3921bfef3ccb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7f5343d6c4c428d977e3921bfef3ccb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33261 } }
I20260811 18:52:52.453482 30335 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7f5343d6c4c428d977e3921bfef3ccb [sys.catalog]: SysCatalogTable state changed. Reason: New leader b7f5343d6c4c428d977e3921bfef3ccb. Latest consensus state: current_term: 1 leader_uuid: "b7f5343d6c4c428d977e3921bfef3ccb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7f5343d6c4c428d977e3921bfef3ccb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33261 } } }
I20260811 18:52:52.454742 30335 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7f5343d6c4c428d977e3921bfef3ccb [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:52.453107 30334 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7f5343d6c4c428d977e3921bfef3ccb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b7f5343d6c4c428d977e3921bfef3ccb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7f5343d6c4c428d977e3921bfef3ccb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33261 } } }
I20260811 18:52:52.455408 30334 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7f5343d6c4c428d977e3921bfef3ccb [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:52.457620 30350 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:52:52.460907 30324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:52.442596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32903 (local address 127.0.0.1:33261)
0811 18:52:52.442770 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:52.442775 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:52.443239 (+ 464us) server_negotiation.cc:407] Connection header received
0811 18:52:52.443424 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:52.443430 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:52.443603 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:52.443722 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:52.445363 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:52.446596 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:52.448014 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:52.448773 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:52.448911 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:52.451727 (+ 2816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:52.451735 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:52.451740 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:52.451790 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:52.456926 (+ 5136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:52.458013 (+ 1087us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:52.458022 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:52.458027 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:52.458243 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:52.458783 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:52.458790 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:52.458794 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:52.459354 (+ 560us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:52.459662 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:52.460106 (+ 444us) server_negotiation.cc:299] Negotiation successful
0811 18:52:52.460404 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 18:52:52.470564 30350 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:52:52.481159 30350 catalog_manager.cc:1347] Generated new cluster ID: 4d63c4bc94ed417482a01c21980c7f33
I20260811 18:52:52.481297 30350 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:52:52.520720 30350 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:52:52.522163 30350 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:52:52.530573 30350 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b7f5343d6c4c428d977e3921bfef3ccb: Generated new TSK 0
I20260811 18:52:52.531539 30350 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:52:52.546659 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 30200
I20260811 18:52:52.548184 30312 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:52.645113 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 30200
2026-08-11T18:52:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2463 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:52:52 dist-test-slave-lgr5 krb5kdc[30372](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:52:52 dist-test-slave-lgr5 krb5kdc[30372](info): set up 2 sockets
Aug 11 18:52:52 dist-test-slave-lgr5 krb5kdc[30372](info): commencing operation
krb5kdc: starting...
W20260811 18:52:53.958709 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.264s user 0.000s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:52:54 dist-test-slave-lgr5 krb5kdc[30372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474374, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:52:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:52:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:52:54.327919 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40911
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40911
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:54.699585 30392 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:54.699970 30392 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:54.700070 30392 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:54.707816 30392 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:52:54.707995 30392 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:54.708108 30392 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:54.708201 30392 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:52:54.708263 30392 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:52:54.719499 30392 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40911
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40911
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:54.721058 30392 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:54.722613 30392 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:54.735695 30400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:54.735778 30401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:54.735733 30403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:54.737030 30392 server_base.cc:1034] running on GCE node
I20260811 18:52:54.737888 30392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:54.739477 30392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:54.740721 30392 hybrid_clock.cc:648] HybridClock initialized: now 1786474374740666 us; error 51 us; skew 500 ppm
I20260811 18:52:54.741164 30392 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:52:54 dist-test-slave-lgr5 krb5kdc[30372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474374, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:54.744681 30392 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:52:54.746481 30392 webserver.cc:460] Webserver started at http://127.0.0.1:44067/ using document root <none> and password file <none>
I20260811 18:52:54.747246 30392 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:54.747392 30392 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:54.747720 30392 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:54.751204 30392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "04baee11502642e58592538aa0afbf6e"
format_stamp: "Formatted at 2026-08-11 18:52:54 on dist-test-slave-lgr5"
server_key: "b81ebd1ab2a4e8120933a39da6f04881"
server_key_iv: "e713681b2dd2ef1e59680d87427b0fe3"
server_key_version: "encryptionkey@0"
I20260811 18:52:54.752175 30392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "04baee11502642e58592538aa0afbf6e"
format_stamp: "Formatted at 2026-08-11 18:52:54 on dist-test-slave-lgr5"
server_key: "b81ebd1ab2a4e8120933a39da6f04881"
server_key_iv: "e713681b2dd2ef1e59680d87427b0fe3"
server_key_version: "encryptionkey@0"
I20260811 18:52:54.758154 30392 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260811 18:52:54.762351 30414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:54.764202 30392 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 18:52:54.764468 30392 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "04baee11502642e58592538aa0afbf6e"
format_stamp: "Formatted at 2026-08-11 18:52:54 on dist-test-slave-lgr5"
server_key: "b81ebd1ab2a4e8120933a39da6f04881"
server_key_iv: "e713681b2dd2ef1e59680d87427b0fe3"
server_key_version: "encryptionkey@0"
I20260811 18:52:54.764699 30392 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:54.783489 30392 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:54.788472 30392 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:54.788774 30392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:54.808446 30392 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40911
I20260811 18:52:54.808475 30506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40911 every 8 connection(s)
I20260811 18:52:54.809970 30392 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:52:54.814239 30508 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:54.814242 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 30392
I20260811 18:52:54.814435 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:52:54.815001 25700 external_mini_cluster.cc:1428] Setting key 92349730988ec238231989b78cda62ab
I20260811 18:52:54.828935 30508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04baee11502642e58592538aa0afbf6e: Bootstrap starting.
I20260811 18:52:54.830068 30511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.817131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54033 (local address 127.0.0.1:40911)
0811 18:52:54.818127 (+ 996us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:54.818142 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:54.818195 (+ 53us) server_negotiation.cc:407] Connection header received
0811 18:52:54.820046 (+ 1851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:54.820108 (+ 62us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:54.820655 (+ 547us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:54.821136 (+ 481us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:54.821808 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.823242 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.824808 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.825805 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.826044 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.827385 (+ 1341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:54.827396 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:54.827415 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:54.828053 (+ 638us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:54.828186 (+ 133us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:54.828220 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:54.828344 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:54.828609 (+ 265us) server_negotiation.cc:299] Negotiation successful
0811 18:52:54.828921 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":749,"thread_start_us":455,"threads_started":1}
I20260811 18:52:54.833051 30508 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 04baee11502642e58592538aa0afbf6e: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:54.834446 30508 log.cc:824] T 00000000000000000000000000000000 P 04baee11502642e58592538aa0afbf6e: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:54.834895 25700 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:52:54.837786 30508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04baee11502642e58592538aa0afbf6e: No bootstrap required, opened a new log
I20260811 18:52:54.847398 30511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.839524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55149 (local address 127.0.0.1:40911)
0811 18:52:54.839731 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:54.839738 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:54.840248 (+ 510us) server_negotiation.cc:407] Connection header received
0811 18:52:54.840492 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:54.840497 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:54.840592 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:54.840718 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:54.841364 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.842497 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.844164 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.844915 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.845109 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.846493 (+ 1384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:54.846501 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:54.846506 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:54.846535 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:54.846616 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:54.846642 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:54.846750 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:54.846924 (+ 174us) server_negotiation.cc:299] Negotiation successful
0811 18:52:54.847058 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 18:52:54.848207 30508 raft_consensus.cc:348] T 00000000000000000000000000000000 P 04baee11502642e58592538aa0afbf6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04baee11502642e58592538aa0afbf6e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40911 } }
I20260811 18:52:54.848805 30508 raft_consensus.cc:374] T 00000000000000000000000000000000 P 04baee11502642e58592538aa0afbf6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:54.848935 30508 raft_consensus.cc:729] T 00000000000000000000000000000000 P 04baee11502642e58592538aa0afbf6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04baee11502642e58592538aa0afbf6e, State: Initialized, Role: FOLLOWER
I20260811 18:52:54.849623 30508 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04baee11502642e58592538aa0afbf6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04baee11502642e58592538aa0afbf6e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40911 } }
I20260811 18:52:54.849892 30508 raft_consensus.cc:388] T 00000000000000000000000000000000 P 04baee11502642e58592538aa0afbf6e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:52:54.850035 30508 raft_consensus.cc:482] T 00000000000000000000000000000000 P 04baee11502642e58592538aa0afbf6e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:52:54.850201 30508 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 04baee11502642e58592538aa0afbf6e [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:54.853367 30508 raft_consensus.cc:504] T 00000000000000000000000000000000 P 04baee11502642e58592538aa0afbf6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04baee11502642e58592538aa0afbf6e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40911 } }
I20260811 18:52:54.854068 30508 leader_election.cc:302] T 00000000000000000000000000000000 P 04baee11502642e58592538aa0afbf6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 04baee11502642e58592538aa0afbf6e; no voters:
I20260811 18:52:54.854770 30508 leader_election.cc:288] T 00000000000000000000000000000000 P 04baee11502642e58592538aa0afbf6e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:52:54.854936 30525 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 04baee11502642e58592538aa0afbf6e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:54.855710 30525 raft_consensus.cc:686] T 00000000000000000000000000000000 P 04baee11502642e58592538aa0afbf6e [term 1 LEADER]: Becoming Leader. State: Replica: 04baee11502642e58592538aa0afbf6e, State: Running, Role: LEADER
I20260811 18:52:54.856370 30525 consensus_queue.cc:237] T 00000000000000000000000000000000 P 04baee11502642e58592538aa0afbf6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04baee11502642e58592538aa0afbf6e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40911 } }
I20260811 18:52:54.857144 30508 sys_catalog.cc:564] T 00000000000000000000000000000000 P 04baee11502642e58592538aa0afbf6e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:52:54.859479 30526 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04baee11502642e58592538aa0afbf6e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "04baee11502642e58592538aa0afbf6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04baee11502642e58592538aa0afbf6e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40911 } } }
I20260811 18:52:54.859503 30529 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04baee11502642e58592538aa0afbf6e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04baee11502642e58592538aa0afbf6e. Latest consensus state: current_term: 1 leader_uuid: "04baee11502642e58592538aa0afbf6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04baee11502642e58592538aa0afbf6e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40911 } } }
I20260811 18:52:54.859958 30526 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04baee11502642e58592538aa0afbf6e [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:54.859957 30529 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04baee11502642e58592538aa0afbf6e [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:54.860864 30533 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:52:54.866716 30533 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:52:54.877951 30533 catalog_manager.cc:1347] Generated new cluster ID: 422e2f2a383045799dcd486e3358631f
I20260811 18:52:54.878093 30533 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:52:54.899000 30533 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:52:54.901037 30533 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:52:54.908380 30533 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 04baee11502642e58592538aa0afbf6e: Generated new TSK 0
I20260811 18:52:54.909621 30533 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:52:54.921661 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 30392
W20260811 18:52:54.923007 30500 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:54033
W20260811 18:52:54.923913 25700 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 30392: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:52:54.924105 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 30392
2026-08-11T18:52:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2276 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:52:55 dist-test-slave-lgr5 krb5kdc[30562](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:52:55 dist-test-slave-lgr5 krb5kdc[30562](info): set up 2 sockets
Aug 11 18:52:55 dist-test-slave-lgr5 krb5kdc[30562](info): commencing operation
krb5kdc: starting...
W20260811 18:52:56.249598 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.279s user 0.003s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:52:56 dist-test-slave-lgr5 krb5kdc[30562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474376, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:52:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:52:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:52:56.619603 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33287
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33287
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:56.986155 30582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:56.986509 30582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:56.986640 30582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:56.994211 30582 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:52:56.994352 30582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:56.994402 30582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:56.994495 30582 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:52:56.994554 30582 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:52:57.005098 30582 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33287
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:57.006582 30582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:57.007983 30582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:57.020143 30593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:57.020169 30597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:57.020072 30594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:57.020852 30582 server_base.cc:1034] running on GCE node
I20260811 18:52:57.021735 30582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:57.023283 30582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:57.024510 30582 hybrid_clock.cc:648] HybridClock initialized: now 1786474377024452 us; error 59 us; skew 500 ppm
I20260811 18:52:57.024871 30582 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:52:57 dist-test-slave-lgr5 krb5kdc[30562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474377, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:57.028249 30582 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:52:57.029946 30582 webserver.cc:460] Webserver started at http://127.0.0.1:38417/ using document root <none> and password file <none>
I20260811 18:52:57.030691 30582 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:57.030823 30582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:57.031136 30582 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:57.034586 30582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "d2813ad20c6c43aabf76916af578ed6c"
format_stamp: "Formatted at 2026-08-11 18:52:57 on dist-test-slave-lgr5"
server_key: "bf81b62cd5c9a37724652c9def4b0b13"
server_key_iv: "458eec9e835a88274637680a1ca0e922"
server_key_version: "encryptionkey@0"
I20260811 18:52:57.035535 30582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "d2813ad20c6c43aabf76916af578ed6c"
format_stamp: "Formatted at 2026-08-11 18:52:57 on dist-test-slave-lgr5"
server_key: "bf81b62cd5c9a37724652c9def4b0b13"
server_key_iv: "458eec9e835a88274637680a1ca0e922"
server_key_version: "encryptionkey@0"
I20260811 18:52:57.041821 30582 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 18:52:57.045898 30609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:57.047433 30582 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 18:52:57.047642 30582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "d2813ad20c6c43aabf76916af578ed6c"
format_stamp: "Formatted at 2026-08-11 18:52:57 on dist-test-slave-lgr5"
server_key: "bf81b62cd5c9a37724652c9def4b0b13"
server_key_iv: "458eec9e835a88274637680a1ca0e922"
server_key_version: "encryptionkey@0"
I20260811 18:52:57.047860 30582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:57.054253 30582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:57.058786 30582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:57.059085 30582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:57.078693 30582 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33287
I20260811 18:52:57.078727 30713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33287 every 8 connection(s)
I20260811 18:52:57.080353 30582 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:52:57.083768 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 30582
I20260811 18:52:57.083974 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:52:57.084575 25700 external_mini_cluster.cc:1428] Setting key 95ab9c06ffe3895d0e4f06b7c5612139
I20260811 18:52:57.085043 30715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:57.094040 30723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:57.086566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54593 (local address 127.0.0.1:33287)
0811 18:52:57.087595 (+ 1029us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:57.087609 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:57.087663 (+ 54us) server_negotiation.cc:407] Connection header received
0811 18:52:57.090121 (+ 2458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:57.090154 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:57.090612 (+ 458us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:57.091027 (+ 415us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:57.092265 (+ 1238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:57.092273 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:57.092286 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:57.092325 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:57.092401 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:57.092429 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:57.092638 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:57.092757 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 18:52:57.093003 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":762,"thread_start_us":408,"threads_started":1}
I20260811 18:52:57.098290 25700 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:52:57.099452 30715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2813ad20c6c43aabf76916af578ed6c: Bootstrap starting.
I20260811 18:52:57.103647 30715 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d2813ad20c6c43aabf76916af578ed6c: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:57.105155 30715 log.cc:824] T 00000000000000000000000000000000 P d2813ad20c6c43aabf76916af578ed6c: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:57.106285 30723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:57.103672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42045 (local address 127.0.0.1:33287)
0811 18:52:57.103849 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:57.103854 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:57.104221 (+ 367us) server_negotiation.cc:407] Connection header received
0811 18:52:57.104429 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:57.104433 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:57.104489 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:57.104563 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:57.105570 (+ 1007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:57.105575 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:57.105578 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:52:57.105596 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:57.105638 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:52:57.105653 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:57.105802 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:57.105925 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 18:52:57.105997 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 18:52:57.108507 30715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2813ad20c6c43aabf76916af578ed6c: No bootstrap required, opened a new log
I20260811 18:52:57.116065 30715 raft_consensus.cc:348] T 00000000000000000000000000000000 P d2813ad20c6c43aabf76916af578ed6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2813ad20c6c43aabf76916af578ed6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33287 } }
I20260811 18:52:57.116585 30715 raft_consensus.cc:374] T 00000000000000000000000000000000 P d2813ad20c6c43aabf76916af578ed6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:57.116680 30715 raft_consensus.cc:729] T 00000000000000000000000000000000 P d2813ad20c6c43aabf76916af578ed6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2813ad20c6c43aabf76916af578ed6c, State: Initialized, Role: FOLLOWER
I20260811 18:52:57.117278 30715 consensus_queue.cc:260] T 00000000000000000000000000000000 P d2813ad20c6c43aabf76916af578ed6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2813ad20c6c43aabf76916af578ed6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33287 } }
I20260811 18:52:57.117509 30715 raft_consensus.cc:388] T 00000000000000000000000000000000 P d2813ad20c6c43aabf76916af578ed6c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:52:57.117640 30715 raft_consensus.cc:482] T 00000000000000000000000000000000 P d2813ad20c6c43aabf76916af578ed6c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:52:57.117801 30715 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d2813ad20c6c43aabf76916af578ed6c [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:57.120165 30715 raft_consensus.cc:504] T 00000000000000000000000000000000 P d2813ad20c6c43aabf76916af578ed6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2813ad20c6c43aabf76916af578ed6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33287 } }
I20260811 18:52:57.120752 30715 leader_election.cc:302] T 00000000000000000000000000000000 P d2813ad20c6c43aabf76916af578ed6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d2813ad20c6c43aabf76916af578ed6c; no voters:
I20260811 18:52:57.121429 30715 leader_election.cc:288] T 00000000000000000000000000000000 P d2813ad20c6c43aabf76916af578ed6c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:52:57.121584 30735 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d2813ad20c6c43aabf76916af578ed6c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:57.122207 30735 raft_consensus.cc:686] T 00000000000000000000000000000000 P d2813ad20c6c43aabf76916af578ed6c [term 1 LEADER]: Becoming Leader. State: Replica: d2813ad20c6c43aabf76916af578ed6c, State: Running, Role: LEADER
I20260811 18:52:57.122717 30735 consensus_queue.cc:237] T 00000000000000000000000000000000 P d2813ad20c6c43aabf76916af578ed6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2813ad20c6c43aabf76916af578ed6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33287 } }
I20260811 18:52:57.123507 30715 sys_catalog.cc:564] T 00000000000000000000000000000000 P d2813ad20c6c43aabf76916af578ed6c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:52:57.125612 30737 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2813ad20c6c43aabf76916af578ed6c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d2813ad20c6c43aabf76916af578ed6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2813ad20c6c43aabf76916af578ed6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33287 } } }
I20260811 18:52:57.126129 30737 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2813ad20c6c43aabf76916af578ed6c [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:57.125622 30738 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2813ad20c6c43aabf76916af578ed6c [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2813ad20c6c43aabf76916af578ed6c. Latest consensus state: current_term: 1 leader_uuid: "d2813ad20c6c43aabf76916af578ed6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2813ad20c6c43aabf76916af578ed6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33287 } } }
I20260811 18:52:57.127017 30738 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2813ad20c6c43aabf76916af578ed6c [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:57.136657 30748 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:52:57.143074 30748 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:52:57.153633 30748 catalog_manager.cc:1347] Generated new cluster ID: e7e05a3b47d4441996bd5880525a9fd0
I20260811 18:52:57.153788 30748 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:52:57.195391 30748 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:52:57.196038 30748 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:52:57.206053 30748 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d2813ad20c6c43aabf76916af578ed6c: Generated new TSK 0
I20260811 18:52:57.207013 30748 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:52:57.224488 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 30582
W20260811 18:52:57.225806 30703 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:54593
W20260811 18:52:57.226718 25700 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 30582: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:52:57.226914 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 30582
2026-08-11T18:52:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2301 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:52:57 dist-test-slave-lgr5 krb5kdc[30768](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:52:57 dist-test-slave-lgr5 krb5kdc[30768](info): set up 2 sockets
Aug 11 18:52:57 dist-test-slave-lgr5 krb5kdc[30768](info): commencing operation
krb5kdc: starting...
W20260811 18:52:58.538724 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.266s user 0.000s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:52:58 dist-test-slave-lgr5 krb5kdc[30768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474378, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:52:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:52:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:52:58.892107 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40909
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40909
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:59.270802 30787 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:59.271142 30787 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:59.271250 30787 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:59.279067 30787 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:52:59.279225 30787 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:59.279281 30787 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:59.279388 30787 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:52:59.279456 30787 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:52:59.290108 30787 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40909
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40909
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:52:59.291601 30787 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:59.293115 30787 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:59.305994 30795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:59.306025 30797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:59.306057 30799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:59.307073 30787 server_base.cc:1034] running on GCE node
I20260811 18:52:59.307957 30787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:59.309602 30787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:59.310877 30787 hybrid_clock.cc:648] HybridClock initialized: now 1786474379310805 us; error 49 us; skew 500 ppm
I20260811 18:52:59.311398 30787 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:52:59 dist-test-slave-lgr5 krb5kdc[30768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474379, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:59.319700 30787 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:52:59.321472 30787 webserver.cc:460] Webserver started at http://127.0.0.1:41645/ using document root <none> and password file <none>
I20260811 18:52:59.322297 30787 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:59.322453 30787 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:59.322790 30787 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:59.326535 30787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "72aa3d8f4e934cd0ba865272ef84fa61"
format_stamp: "Formatted at 2026-08-11 18:52:59 on dist-test-slave-lgr5"
server_key: "3a55df9b8568ba21cee7b519a4067516"
server_key_iv: "43c8feb39ab6323b32b6c61df17bb763"
server_key_version: "encryptionkey@0"
I20260811 18:52:59.327463 30787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "72aa3d8f4e934cd0ba865272ef84fa61"
format_stamp: "Formatted at 2026-08-11 18:52:59 on dist-test-slave-lgr5"
server_key: "3a55df9b8568ba21cee7b519a4067516"
server_key_iv: "43c8feb39ab6323b32b6c61df17bb763"
server_key_version: "encryptionkey@0"
I20260811 18:52:59.333491 30787 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260811 18:52:59.337710 30809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:59.339437 30787 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 18:52:59.339649 30787 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "72aa3d8f4e934cd0ba865272ef84fa61"
format_stamp: "Formatted at 2026-08-11 18:52:59 on dist-test-slave-lgr5"
server_key: "3a55df9b8568ba21cee7b519a4067516"
server_key_iv: "43c8feb39ab6323b32b6c61df17bb763"
server_key_version: "encryptionkey@0"
I20260811 18:52:59.339866 30787 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:59.358008 30787 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:59.362684 30787 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:59.362982 30787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:59.381875 30787 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40909
I20260811 18:52:59.381930 30915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40909 every 8 connection(s)
I20260811 18:52:59.383531 30787 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:52:59.387923 30916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:59.388545 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 30787
I20260811 18:52:59.388705 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:52:59.389144 25700 external_mini_cluster.cc:1428] Setting key 107ff5b1af42900be4cd9f338e2c5f3c
I20260811 18:52:59.403394 30916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72aa3d8f4e934cd0ba865272ef84fa61: Bootstrap starting.
Aug 11 18:52:59 dist-test-slave-lgr5 krb5kdc[30768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474378, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 18:52:59.407958 30916 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72aa3d8f4e934cd0ba865272ef84fa61: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:59.409456 30916 log.cc:824] T 00000000000000000000000000000000 P 72aa3d8f4e934cd0ba865272ef84fa61: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:59.413525 30916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72aa3d8f4e934cd0ba865272ef84fa61: No bootstrap required, opened a new log
I20260811 18:52:59.416975 30920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:59.391139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:49773 (local address 127.0.0.1:40909)
0811 18:52:59.392024 (+ 885us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:59.392037 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:59.392117 (+ 80us) server_negotiation.cc:407] Connection header received
0811 18:52:59.394430 (+ 2313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:59.394463 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:59.394991 (+ 528us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:59.395425 (+ 434us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:59.397494 (+ 2069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:59.398944 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:59.401000 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:59.402046 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:59.402226 (+ 180us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:59.407850 (+ 5624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:59.407860 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:59.407879 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:59.407936 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:59.411898 (+ 3962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:59.413157 (+ 1259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:59.413165 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:59.413172 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:59.413360 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:59.413899 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:59.413903 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:59.413905 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:59.414529 (+ 624us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:59.414809 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:59.415366 (+ 557us) server_negotiation.cc:299] Negotiation successful
0811 18:52:59.415702 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":644,"thread_start_us":387,"threads_started":1}
I20260811 18:52:59.421347 25700 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:52:59.422969 30916 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72aa3d8f4e934cd0ba865272ef84fa61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72aa3d8f4e934cd0ba865272ef84fa61" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40909 } }
I20260811 18:52:59.423491 30916 raft_consensus.cc:374] T 00000000000000000000000000000000 P 72aa3d8f4e934cd0ba865272ef84fa61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:59.423600 30916 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72aa3d8f4e934cd0ba865272ef84fa61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72aa3d8f4e934cd0ba865272ef84fa61, State: Initialized, Role: FOLLOWER
I20260811 18:52:59.424430 30916 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72aa3d8f4e934cd0ba865272ef84fa61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72aa3d8f4e934cd0ba865272ef84fa61" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40909 } }
I20260811 18:52:59.424763 30916 raft_consensus.cc:388] T 00000000000000000000000000000000 P 72aa3d8f4e934cd0ba865272ef84fa61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:52:59.424926 30916 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72aa3d8f4e934cd0ba865272ef84fa61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:52:59.425118 30916 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72aa3d8f4e934cd0ba865272ef84fa61 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:59.428862 30916 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72aa3d8f4e934cd0ba865272ef84fa61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72aa3d8f4e934cd0ba865272ef84fa61" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40909 } }
I20260811 18:52:59.429574 30916 leader_election.cc:302] T 00000000000000000000000000000000 P 72aa3d8f4e934cd0ba865272ef84fa61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 72aa3d8f4e934cd0ba865272ef84fa61; no voters:
I20260811 18:52:59.430296 30916 leader_election.cc:288] T 00000000000000000000000000000000 P 72aa3d8f4e934cd0ba865272ef84fa61 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:52:59.430506 30932 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 72aa3d8f4e934cd0ba865272ef84fa61 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:59.432001 30932 raft_consensus.cc:686] T 00000000000000000000000000000000 P 72aa3d8f4e934cd0ba865272ef84fa61 [term 1 LEADER]: Becoming Leader. State: Replica: 72aa3d8f4e934cd0ba865272ef84fa61, State: Running, Role: LEADER
I20260811 18:52:59.432641 30932 consensus_queue.cc:237] T 00000000000000000000000000000000 P 72aa3d8f4e934cd0ba865272ef84fa61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72aa3d8f4e934cd0ba865272ef84fa61" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40909 } }
I20260811 18:52:59.433177 30916 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72aa3d8f4e934cd0ba865272ef84fa61 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:52:59.435573 30936 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72aa3d8f4e934cd0ba865272ef84fa61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "72aa3d8f4e934cd0ba865272ef84fa61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72aa3d8f4e934cd0ba865272ef84fa61" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40909 } } }
I20260811 18:52:59.436030 30936 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72aa3d8f4e934cd0ba865272ef84fa61 [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:59.438562 30938 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72aa3d8f4e934cd0ba865272ef84fa61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72aa3d8f4e934cd0ba865272ef84fa61. Latest consensus state: current_term: 1 leader_uuid: "72aa3d8f4e934cd0ba865272ef84fa61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72aa3d8f4e934cd0ba865272ef84fa61" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40909 } } }
I20260811 18:52:59.439036 30938 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72aa3d8f4e934cd0ba865272ef84fa61 [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:59.442595 30942 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:52:59.449406 30942 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:52:59.451643 30920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:59.430366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:47633 (local address 127.0.0.1:40909)
0811 18:52:59.430568 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:59.430574 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:59.431178 (+ 604us) server_negotiation.cc:407] Connection header received
0811 18:52:59.431486 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:59.431493 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:59.431597 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:59.431675 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:59.433928 (+ 2253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:59.435200 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:59.437477 (+ 2277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:59.438303 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:59.438481 (+ 178us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:59.442339 (+ 3858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:59.442348 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:59.442354 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:59.442408 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:59.447284 (+ 4876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:59.448375 (+ 1091us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:59.448380 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:59.448383 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:59.448531 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:59.449150 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:59.449154 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:59.449157 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:59.449557 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:59.449854 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:59.450948 (+ 1094us) server_negotiation.cc:299] Negotiation successful
0811 18:52:59.451197 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 18:52:59.460516 30942 catalog_manager.cc:1347] Generated new cluster ID: 34240e2e8e534687b1e29bdfd556ae4b
I20260811 18:52:59.460708 30942 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:52:59.468582 30942 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:52:59.470392 30942 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:52:59.480640 30942 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 72aa3d8f4e934cd0ba865272ef84fa61: Generated new TSK 0
I20260811 18:52:59.481549 30942 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:52:59.491084 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 30787
I20260811 18:52:59.492416 30908 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:52:59.586274 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 30787
W20260811 18:52:59.614940 30763 connection.cc:535] client connection to 127.0.0.1:40909 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40909): Connection reset by peer (error 104)
2026-08-11T18:52:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2362 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:52:59 dist-test-slave-lgr5 krb5kdc[30965](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:52:59 dist-test-slave-lgr5 krb5kdc[30965](info): set up 2 sockets
Aug 11 18:52:59 dist-test-slave-lgr5 krb5kdc[30965](info): commencing operation
krb5kdc: starting...
W20260811 18:53:00.915781 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.001s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:53:01 dist-test-slave-lgr5 krb5kdc[30965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474381, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:53:01.281301 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38525
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38525
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:01.671083 30982 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:01.671443 30982 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:01.671589 30982 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:01.679850 30982 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:01.680001 30982 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:01.680110 30982 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:01.680202 30982 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:01.680264 30982 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:01.691505 30982 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38525
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38525
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:01.693118 30982 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:01.694660 30982 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:01.773572 30990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:01.773572 30991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:01.773584 30993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:01.778378 30982 server_base.cc:1034] running on GCE node
I20260811 18:53:01.784328 30982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:01.792949 30982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:01.796802 30982 hybrid_clock.cc:648] HybridClock initialized: now 1786474381796669 us; error 74 us; skew 500 ppm
I20260811 18:53:01.798291 30982 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:01 dist-test-slave-lgr5 krb5kdc[30965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474381, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:01.810086 30982 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:53:01.815321 30982 webserver.cc:460] Webserver started at http://127.0.0.1:36565/ using document root <none> and password file <none>
I20260811 18:53:01.818513 30982 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:01.818751 30982 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:01.819947 30982 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:01.831475 30982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "7b8112fa378b41b59ac141b3e15e9ffa"
format_stamp: "Formatted at 2026-08-11 18:53:01 on dist-test-slave-lgr5"
server_key: "99eaa1614b0b077de0802bbd3f01042b"
server_key_iv: "71e017a7f76f4dc3ebd1bf7605affcf4"
server_key_version: "encryptionkey@0"
I20260811 18:53:01.833220 30982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "7b8112fa378b41b59ac141b3e15e9ffa"
format_stamp: "Formatted at 2026-08-11 18:53:01 on dist-test-slave-lgr5"
server_key: "99eaa1614b0b077de0802bbd3f01042b"
server_key_iv: "71e017a7f76f4dc3ebd1bf7605affcf4"
server_key_version: "encryptionkey@0"
I20260811 18:53:01.848423 30982 fs_manager.cc:691] Time spent creating directory manager: real 0.014s user 0.014s sys 0.000s
I20260811 18:53:01.861459 31005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:01.864306 30982 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.002s sys 0.003s
I20260811 18:53:01.864814 30982 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "7b8112fa378b41b59ac141b3e15e9ffa"
format_stamp: "Formatted at 2026-08-11 18:53:01 on dist-test-slave-lgr5"
server_key: "99eaa1614b0b077de0802bbd3f01042b"
server_key_iv: "71e017a7f76f4dc3ebd1bf7605affcf4"
server_key_version: "encryptionkey@0"
I20260811 18:53:01.865273 30982 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:01.903878 30982 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:01.912492 30982 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:01.913193 30982 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:01.967660 30982 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38525
I20260811 18:53:01.967717 31109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38525 every 8 connection(s)
I20260811 18:53:01.970795 30982 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:01.978657 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 30982
I20260811 18:53:01.979522 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:53:01.981701 25700 external_mini_cluster.cc:1428] Setting key b3c08b4b61212d57caaa0197152b2e01
I20260811 18:53:01.985550 31110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:02.014362 31113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:01.989956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:50349 (local address 127.0.0.1:38525)
0811 18:53:01.991895 (+ 1939us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:01.991921 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:01.991998 (+ 77us) server_negotiation.cc:407] Connection header received
0811 18:53:01.995921 (+ 3923us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:01.995976 (+ 55us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:01.996951 (+ 975us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:01.997677 (+ 726us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:01.999794 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:02.002876 (+ 3082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:02.005984 (+ 3108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:02.006988 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:02.007228 (+ 240us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:02.009900 (+ 2672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:02.009929 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:02.009954 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:02.010959 (+ 1005us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:02.011093 (+ 134us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:02.011129 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:02.011357 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:02.011858 (+ 501us) server_negotiation.cc:299] Negotiation successful
0811 18:53:02.012201 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1508,"thread_start_us":1248,"threads_started":1}
I20260811 18:53:02.018450 31110 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b8112fa378b41b59ac141b3e15e9ffa: Bootstrap starting.
I20260811 18:53:02.023531 25700 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:53:02.026602 31110 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b8112fa378b41b59ac141b3e15e9ffa: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:02.029434 31110 log.cc:824] T 00000000000000000000000000000000 P 7b8112fa378b41b59ac141b3e15e9ffa: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:02.122155 31110 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b8112fa378b41b59ac141b3e15e9ffa: No bootstrap required, opened a new log
I20260811 18:53:02.136330 31113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:02.125055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:42491 (local address 127.0.0.1:38525)
0811 18:53:02.125271 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:02.125278 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:02.128238 (+ 2960us) server_negotiation.cc:407] Connection header received
0811 18:53:02.128656 (+ 418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:02.128660 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:02.128743 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:02.128849 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:02.129842 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:02.130897 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:02.133305 (+ 2408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:02.133905 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:02.134065 (+ 160us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:02.135452 (+ 1387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:02.135459 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:02.135463 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:02.135488 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:02.135555 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:02.135573 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:02.135642 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:02.135897 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 18:53:02.135960 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 18:53:02.137645 31110 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b8112fa378b41b59ac141b3e15e9ffa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b8112fa378b41b59ac141b3e15e9ffa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38525 } }
I20260811 18:53:02.138626 31110 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7b8112fa378b41b59ac141b3e15e9ffa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:02.138801 31110 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b8112fa378b41b59ac141b3e15e9ffa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b8112fa378b41b59ac141b3e15e9ffa, State: Initialized, Role: FOLLOWER
I20260811 18:53:02.140472 31110 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b8112fa378b41b59ac141b3e15e9ffa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b8112fa378b41b59ac141b3e15e9ffa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38525 } }
I20260811 18:53:02.140966 31110 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7b8112fa378b41b59ac141b3e15e9ffa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:02.141209 31110 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b8112fa378b41b59ac141b3e15e9ffa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:02.141531 31110 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b8112fa378b41b59ac141b3e15e9ffa [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:02.145457 31110 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b8112fa378b41b59ac141b3e15e9ffa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b8112fa378b41b59ac141b3e15e9ffa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38525 } }
I20260811 18:53:02.146452 31110 leader_election.cc:302] T 00000000000000000000000000000000 P 7b8112fa378b41b59ac141b3e15e9ffa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7b8112fa378b41b59ac141b3e15e9ffa; no voters:
I20260811 18:53:02.147338 31110 leader_election.cc:288] T 00000000000000000000000000000000 P 7b8112fa378b41b59ac141b3e15e9ffa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:02.147497 31124 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b8112fa378b41b59ac141b3e15e9ffa [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:02.148598 31124 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b8112fa378b41b59ac141b3e15e9ffa [term 1 LEADER]: Becoming Leader. State: Replica: 7b8112fa378b41b59ac141b3e15e9ffa, State: Running, Role: LEADER
I20260811 18:53:02.149313 31124 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b8112fa378b41b59ac141b3e15e9ffa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b8112fa378b41b59ac141b3e15e9ffa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38525 } }
I20260811 18:53:02.150508 31110 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b8112fa378b41b59ac141b3e15e9ffa [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:02.155298 31129 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b8112fa378b41b59ac141b3e15e9ffa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b8112fa378b41b59ac141b3e15e9ffa. Latest consensus state: current_term: 1 leader_uuid: "7b8112fa378b41b59ac141b3e15e9ffa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b8112fa378b41b59ac141b3e15e9ffa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38525 } } }
I20260811 18:53:02.156664 31129 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b8112fa378b41b59ac141b3e15e9ffa [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:02.160544 31141 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:02.155172 31125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b8112fa378b41b59ac141b3e15e9ffa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7b8112fa378b41b59ac141b3e15e9ffa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b8112fa378b41b59ac141b3e15e9ffa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38525 } } }
I20260811 18:53:02.160812 31125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b8112fa378b41b59ac141b3e15e9ffa [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:02.169788 31141 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:02.187955 31141 catalog_manager.cc:1347] Generated new cluster ID: 3e6ef7befb1c414ea6d9493f3717dad5
I20260811 18:53:02.188158 31141 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:02.218201 31141 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:02.219746 31141 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:02.230043 31141 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7b8112fa378b41b59ac141b3e15e9ffa: Generated new TSK 0
I20260811 18:53:02.231364 31141 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:53:02.249302 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 30982
W20260811 18:53:02.251399 31100 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.158:50349
W20260811 18:53:02.252614 25700 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 30982: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:53:02.252892 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 30982
W20260811 18:53:02.348124 30961 connection.cc:535] client connection to 127.0.0.1:38525 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38525): Connection reset by peer (error 104)
2026-08-11T18:53:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2736 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:53:02 dist-test-slave-lgr5 krb5kdc[31161](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:53:02 dist-test-slave-lgr5 krb5kdc[31161](info): set up 2 sockets
Aug 11 18:53:02 dist-test-slave-lgr5 krb5kdc[31161](info): commencing operation
krb5kdc: starting...
W20260811 18:53:03.789422 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.415s user 0.004s sys 0.075s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:53:04 dist-test-slave-lgr5 krb5kdc[31161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:53:04.169029 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35333
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35333
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:04.808350 31185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:04.808715 31185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:04.808882 31185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:04.817364 31185 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:04.817546 31185 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:04.817642 31185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:04.817762 31185 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:04.817842 31185 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:04.829910 31185 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35333
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35333
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:04.831565 31185 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:04.833240 31185 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:04.848224 31193 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:04.848263 31194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:04.848827 31201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:04.849658 31185 server_base.cc:1034] running on GCE node
I20260811 18:53:04.850507 31185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:04.852128 31185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:04.853420 31185 hybrid_clock.cc:648] HybridClock initialized: now 1786474384853357 us; error 40 us; skew 500 ppm
I20260811 18:53:04.853922 31185 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:04 dist-test-slave-lgr5 krb5kdc[31161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474384, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:04.865193 31185 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:53:04.867172 31185 webserver.cc:460] Webserver started at http://127.0.0.1:46565/ using document root <none> and password file <none>
I20260811 18:53:04.867964 31185 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:04.868132 31185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:04.868525 31185 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:04.871953 31185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "b385f991cf2f489cba258a18f9f8270f"
format_stamp: "Formatted at 2026-08-11 18:53:04 on dist-test-slave-lgr5"
server_key: "1cf284c22414247063894fd184de7f14"
server_key_iv: "7df10c7d7daf928b8920f172ad68f137"
server_key_version: "encryptionkey@0"
I20260811 18:53:04.872931 31185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "b385f991cf2f489cba258a18f9f8270f"
format_stamp: "Formatted at 2026-08-11 18:53:04 on dist-test-slave-lgr5"
server_key: "1cf284c22414247063894fd184de7f14"
server_key_iv: "7df10c7d7daf928b8920f172ad68f137"
server_key_version: "encryptionkey@0"
I20260811 18:53:04.879165 31185 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 18:53:04.883576 31211 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:04.885324 31185 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260811 18:53:04.885545 31185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "b385f991cf2f489cba258a18f9f8270f"
format_stamp: "Formatted at 2026-08-11 18:53:04 on dist-test-slave-lgr5"
server_key: "1cf284c22414247063894fd184de7f14"
server_key_iv: "7df10c7d7daf928b8920f172ad68f137"
server_key_version: "encryptionkey@0"
I20260811 18:53:04.885787 31185 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:04.893095 31185 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:04.898133 31185 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:04.898463 31185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:04.919631 31185 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35333
I20260811 18:53:04.919723 31306 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35333 every 8 connection(s)
I20260811 18:53:04.921350 31185 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:04.922025 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 31185
I20260811 18:53:04.922227 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:53:04.922834 25700 external_mini_cluster.cc:1428] Setting key 36d8aee80e3e0e5a49a365fbaef4553e
I20260811 18:53:04.926430 31307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:04.932461 31314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:04.924994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:49109 (local address 127.0.0.1:35333)
0811 18:53:04.925930 (+ 936us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:04.925943 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:04.925989 (+ 46us) server_negotiation.cc:407] Connection header received
0811 18:53:04.927762 (+ 1773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:04.927787 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:04.928203 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:04.928617 (+ 414us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:04.929794 (+ 1177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:04.929803 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:04.929821 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:04.929843 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:04.929961 (+ 118us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:04.929996 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:04.930243 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:04.930522 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 18:53:04.931096 (+ 574us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":689,"thread_start_us":458,"threads_started":1}
I20260811 18:53:04.937386 25700 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:53:04.940189 31307 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b385f991cf2f489cba258a18f9f8270f: Bootstrap starting.
I20260811 18:53:04.944469 31307 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b385f991cf2f489cba258a18f9f8270f: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:04.945421 31314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:04.942430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:53137 (local address 127.0.0.1:35333)
0811 18:53:04.942740 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:04.942747 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:04.943134 (+ 387us) server_negotiation.cc:407] Connection header received
0811 18:53:04.943298 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:04.943305 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:04.943387 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:04.943512 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:04.944652 (+ 1140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:04.944658 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:04.944662 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:04.944684 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:04.944744 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:04.944768 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:04.944900 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:04.945022 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 18:53:04.945098 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176}
I20260811 18:53:04.946306 31307 log.cc:824] T 00000000000000000000000000000000 P b385f991cf2f489cba258a18f9f8270f: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:04.949568 31307 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b385f991cf2f489cba258a18f9f8270f: No bootstrap required, opened a new log
I20260811 18:53:04.957792 31307 raft_consensus.cc:348] T 00000000000000000000000000000000 P b385f991cf2f489cba258a18f9f8270f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b385f991cf2f489cba258a18f9f8270f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35333 } }
I20260811 18:53:04.958235 31307 raft_consensus.cc:374] T 00000000000000000000000000000000 P b385f991cf2f489cba258a18f9f8270f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:04.958338 31307 raft_consensus.cc:729] T 00000000000000000000000000000000 P b385f991cf2f489cba258a18f9f8270f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b385f991cf2f489cba258a18f9f8270f, State: Initialized, Role: FOLLOWER
I20260811 18:53:04.958969 31307 consensus_queue.cc:260] T 00000000000000000000000000000000 P b385f991cf2f489cba258a18f9f8270f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b385f991cf2f489cba258a18f9f8270f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35333 } }
I20260811 18:53:04.959195 31307 raft_consensus.cc:388] T 00000000000000000000000000000000 P b385f991cf2f489cba258a18f9f8270f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:04.959339 31307 raft_consensus.cc:482] T 00000000000000000000000000000000 P b385f991cf2f489cba258a18f9f8270f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:04.959507 31307 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b385f991cf2f489cba258a18f9f8270f [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:04.962141 31307 raft_consensus.cc:504] T 00000000000000000000000000000000 P b385f991cf2f489cba258a18f9f8270f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b385f991cf2f489cba258a18f9f8270f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35333 } }
I20260811 18:53:04.962841 31307 leader_election.cc:302] T 00000000000000000000000000000000 P b385f991cf2f489cba258a18f9f8270f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b385f991cf2f489cba258a18f9f8270f; no voters:
I20260811 18:53:04.963701 31307 leader_election.cc:288] T 00000000000000000000000000000000 P b385f991cf2f489cba258a18f9f8270f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:04.963917 31332 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b385f991cf2f489cba258a18f9f8270f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:04.964783 31332 raft_consensus.cc:686] T 00000000000000000000000000000000 P b385f991cf2f489cba258a18f9f8270f [term 1 LEADER]: Becoming Leader. State: Replica: b385f991cf2f489cba258a18f9f8270f, State: Running, Role: LEADER
I20260811 18:53:04.965368 31332 consensus_queue.cc:237] T 00000000000000000000000000000000 P b385f991cf2f489cba258a18f9f8270f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b385f991cf2f489cba258a18f9f8270f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35333 } }
I20260811 18:53:04.966022 31307 sys_catalog.cc:564] T 00000000000000000000000000000000 P b385f991cf2f489cba258a18f9f8270f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:04.969924 31335 sys_catalog.cc:455] T 00000000000000000000000000000000 P b385f991cf2f489cba258a18f9f8270f [sys.catalog]: SysCatalogTable state changed. Reason: New leader b385f991cf2f489cba258a18f9f8270f. Latest consensus state: current_term: 1 leader_uuid: "b385f991cf2f489cba258a18f9f8270f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b385f991cf2f489cba258a18f9f8270f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35333 } } }
I20260811 18:53:04.969820 31334 sys_catalog.cc:455] T 00000000000000000000000000000000 P b385f991cf2f489cba258a18f9f8270f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b385f991cf2f489cba258a18f9f8270f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b385f991cf2f489cba258a18f9f8270f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35333 } } }
I20260811 18:53:04.970464 31334 sys_catalog.cc:458] T 00000000000000000000000000000000 P b385f991cf2f489cba258a18f9f8270f [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:04.970355 31335 sys_catalog.cc:458] T 00000000000000000000000000000000 P b385f991cf2f489cba258a18f9f8270f [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:04.971865 31343 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:04.977463 31343 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:04.987452 31343 catalog_manager.cc:1347] Generated new cluster ID: 487f4ba5d90b4ff9a43e78fb9ec9a1d7
I20260811 18:53:04.987573 31343 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:05.004411 31343 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:05.004945 31343 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:05.018671 31343 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b385f991cf2f489cba258a18f9f8270f: Generated new TSK 0
I20260811 18:53:05.019644 31343 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:53:05.032867 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 31185
W20260811 18:53:05.034322 31297 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.158:49109
W20260811 18:53:05.035290 25700 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 31185: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:53:05.035480 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 31185
2026-08-11T18:53:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2711 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:53:05 dist-test-slave-lgr5 krb5kdc[31366](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:53:05 dist-test-slave-lgr5 krb5kdc[31366](info): set up 2 sockets
Aug 11 18:53:05 dist-test-slave-lgr5 krb5kdc[31366](info): commencing operation
krb5kdc: starting...
W20260811 18:53:06.345222 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.262s user 0.003s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:53:06 dist-test-slave-lgr5 krb5kdc[31366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474386, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:53:06.724066 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36423
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36423
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:07.093130 31390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:07.093490 31390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:07.093629 31390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:07.101375 31390 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:07.101532 31390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:07.101593 31390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:07.101686 31390 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:07.101742 31390 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:07.112260 31390 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36423
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36423
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:07.113735 31390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:07.115172 31390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:07.127840 31402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:07.127871 31406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:07.127931 31403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:07.129208 31390 server_base.cc:1034] running on GCE node
I20260811 18:53:07.130115 31390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:07.131752 31390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:07.132982 31390 hybrid_clock.cc:648] HybridClock initialized: now 1786474387132933 us; error 55 us; skew 500 ppm
I20260811 18:53:07.133369 31390 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:07 dist-test-slave-lgr5 krb5kdc[31366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474387, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:07.136917 31390 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:53:07.138752 31390 webserver.cc:460] Webserver started at http://127.0.0.1:40547/ using document root <none> and password file <none>
I20260811 18:53:07.139674 31390 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:07.139796 31390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:07.140125 31390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:07.143479 31390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "10aecafa63704231b3801b79d282f0be"
format_stamp: "Formatted at 2026-08-11 18:53:07 on dist-test-slave-lgr5"
server_key: "ead58d7cfc0e47526fb01c50211d9636"
server_key_iv: "0b2c83bfe61fb8dea02e9d090c98327c"
server_key_version: "encryptionkey@0"
I20260811 18:53:07.144456 31390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "10aecafa63704231b3801b79d282f0be"
format_stamp: "Formatted at 2026-08-11 18:53:07 on dist-test-slave-lgr5"
server_key: "ead58d7cfc0e47526fb01c50211d9636"
server_key_iv: "0b2c83bfe61fb8dea02e9d090c98327c"
server_key_version: "encryptionkey@0"
I20260811 18:53:07.150424 31390 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 18:53:07.154902 31422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:07.156762 31390 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260811 18:53:07.157015 31390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "10aecafa63704231b3801b79d282f0be"
format_stamp: "Formatted at 2026-08-11 18:53:07 on dist-test-slave-lgr5"
server_key: "ead58d7cfc0e47526fb01c50211d9636"
server_key_iv: "0b2c83bfe61fb8dea02e9d090c98327c"
server_key_version: "encryptionkey@0"
I20260811 18:53:07.157253 31390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:07.171212 31390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:07.176245 31390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:07.176563 31390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:07.197237 31390 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36423
I20260811 18:53:07.197183 31518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36423 every 8 connection(s)
I20260811 18:53:07.198809 31390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:07.200634 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 31390
I20260811 18:53:07.200794 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:53:07.201256 25700 external_mini_cluster.cc:1428] Setting key c0ffa756d6246d78459a367a0b37bc1c
I20260811 18:53:07.203661 31519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:07.218040 31519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10aecafa63704231b3801b79d282f0be: Bootstrap starting.
Aug 11 18:53:07 dist-test-slave-lgr5 krb5kdc[31366](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474386, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 18:53:07.221812 31519 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10aecafa63704231b3801b79d282f0be: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:07.223033 31519 log.cc:824] T 00000000000000000000000000000000 P 10aecafa63704231b3801b79d282f0be: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:07.226271 31519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10aecafa63704231b3801b79d282f0be: No bootstrap required, opened a new log
I20260811 18:53:07.230098 31528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:07.203376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:57227 (local address 127.0.0.1:36423)
0811 18:53:07.204288 (+ 912us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:07.204306 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:07.204364 (+ 58us) server_negotiation.cc:407] Connection header received
0811 18:53:07.206707 (+ 2343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:07.206742 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:07.207361 (+ 619us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:07.207891 (+ 530us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:07.210057 (+ 2166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:07.212193 (+ 2136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:07.213761 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:07.214951 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:07.215218 (+ 267us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:07.220946 (+ 5728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:07.220959 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:07.220979 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:07.221050 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:07.224669 (+ 3619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:07.225787 (+ 1118us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:07.225794 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:07.225809 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:07.226014 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:07.226674 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:07.226680 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:07.226683 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:07.227412 (+ 729us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:07.227883 (+ 471us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:07.228507 (+ 624us) server_negotiation.cc:299] Negotiation successful
0811 18:53:07.228918 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":634,"thread_start_us":357,"threads_started":1}
I20260811 18:53:07.235438 25700 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:53:07.235724 31519 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10aecafa63704231b3801b79d282f0be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10aecafa63704231b3801b79d282f0be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36423 } }
I20260811 18:53:07.236186 31519 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10aecafa63704231b3801b79d282f0be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:07.236294 31519 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10aecafa63704231b3801b79d282f0be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10aecafa63704231b3801b79d282f0be, State: Initialized, Role: FOLLOWER
I20260811 18:53:07.236943 31519 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10aecafa63704231b3801b79d282f0be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10aecafa63704231b3801b79d282f0be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36423 } }
I20260811 18:53:07.237192 31519 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10aecafa63704231b3801b79d282f0be [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:07.237330 31519 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10aecafa63704231b3801b79d282f0be [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:07.237517 31519 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10aecafa63704231b3801b79d282f0be [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:07.240643 31519 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10aecafa63704231b3801b79d282f0be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10aecafa63704231b3801b79d282f0be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36423 } }
I20260811 18:53:07.241393 31519 leader_election.cc:302] T 00000000000000000000000000000000 P 10aecafa63704231b3801b79d282f0be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10aecafa63704231b3801b79d282f0be; no voters:
I20260811 18:53:07.242133 31519 leader_election.cc:288] T 00000000000000000000000000000000 P 10aecafa63704231b3801b79d282f0be [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:07.242359 31544 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10aecafa63704231b3801b79d282f0be [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:07.244321 31519 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10aecafa63704231b3801b79d282f0be [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:07.248420 31544 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10aecafa63704231b3801b79d282f0be [term 1 LEADER]: Becoming Leader. State: Replica: 10aecafa63704231b3801b79d282f0be, State: Running, Role: LEADER
I20260811 18:53:07.249462 31544 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10aecafa63704231b3801b79d282f0be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10aecafa63704231b3801b79d282f0be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36423 } }
I20260811 18:53:07.253991 31546 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10aecafa63704231b3801b79d282f0be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10aecafa63704231b3801b79d282f0be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10aecafa63704231b3801b79d282f0be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36423 } } }
I20260811 18:53:07.254042 31548 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10aecafa63704231b3801b79d282f0be [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10aecafa63704231b3801b79d282f0be. Latest consensus state: current_term: 1 leader_uuid: "10aecafa63704231b3801b79d282f0be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10aecafa63704231b3801b79d282f0be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36423 } } }
I20260811 18:53:07.255179 31548 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10aecafa63704231b3801b79d282f0be [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:07.255535 31569 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 18:53:07.256361 31546 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10aecafa63704231b3801b79d282f0be [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:07.257588 31572 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:07.262255 31528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:07.240724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:37603 (local address 127.0.0.1:36423)
0811 18:53:07.240922 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:07.240929 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:07.241295 (+ 366us) server_negotiation.cc:407] Connection header received
0811 18:53:07.241457 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:07.241463 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:07.241550 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:07.241668 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:07.244432 (+ 2764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:07.245663 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:07.247995 (+ 2332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:07.248828 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:07.248987 (+ 159us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:07.253282 (+ 4295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:07.253293 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:07.253298 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:07.253358 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:07.257513 (+ 4155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:07.258480 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:07.258486 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:07.258488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:07.258644 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:07.259144 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:07.259153 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:07.259156 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:07.259602 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:07.261403 (+ 1801us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:07.261595 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 18:53:07.261825 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 18:53:07.262336 31572 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:07.271708 31572 catalog_manager.cc:1347] Generated new cluster ID: c3cd8cdd4f3f4be1a0740dfd062dd0d7
I20260811 18:53:07.271860 31572 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:07.288358 31572 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:07.289837 31572 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:07.296730 31572 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10aecafa63704231b3801b79d282f0be: Generated new TSK 0
I20260811 18:53:07.297783 31572 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:53:07.305287 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 31390
I20260811 18:53:07.306775 31513 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:53:07.401386 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 31390
W20260811 18:53:07.428476 31363 connection.cc:535] client connection to 127.0.0.1:36423 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36423): Connection reset by peer (error 104)
2026-08-11T18:53:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2365 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:53:07 dist-test-slave-lgr5 krb5kdc[31588](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:53:07 dist-test-slave-lgr5 krb5kdc[31588](info): set up 2 sockets
Aug 11 18:53:07 dist-test-slave-lgr5 krb5kdc[31588](info): commencing operation
krb5kdc: starting...
W20260811 18:53:08.729025 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.279s user 0.003s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:53:08 dist-test-slave-lgr5 krb5kdc[31588](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474388, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:53:09.084743 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40511
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40511
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:09.462626 31610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:09.462978 31610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:09.463132 31610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:09.470875 31610 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:09.471035 31610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:09.471117 31610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:09.471200 31610 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:09.471266 31610 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:09.482061 31610 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40511
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40511
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:09.483776 31610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:09.485524 31610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:09.499588 31616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:09.499656 31617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:09.499627 31622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:09.500990 31610 server_base.cc:1034] running on GCE node
I20260811 18:53:09.501921 31610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:09.503571 31610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:09.504837 31610 hybrid_clock.cc:648] HybridClock initialized: now 1786474389504764 us; error 53 us; skew 500 ppm
I20260811 18:53:09.505246 31610 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:09 dist-test-slave-lgr5 krb5kdc[31588](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474389, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:09.508754 31610 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:53:09.510725 31610 webserver.cc:460] Webserver started at http://127.0.0.1:42047/ using document root <none> and password file <none>
I20260811 18:53:09.511507 31610 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:09.511647 31610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:09.511989 31610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:09.515607 31610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "446c8f4c52ea4d6ca9ccb544ff395cfc"
format_stamp: "Formatted at 2026-08-11 18:53:09 on dist-test-slave-lgr5"
server_key: "1d513df142e269322998376c2d91d78c"
server_key_iv: "ff786f33988bb90d960a013dd1127b11"
server_key_version: "encryptionkey@0"
I20260811 18:53:09.516667 31610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "446c8f4c52ea4d6ca9ccb544ff395cfc"
format_stamp: "Formatted at 2026-08-11 18:53:09 on dist-test-slave-lgr5"
server_key: "1d513df142e269322998376c2d91d78c"
server_key_iv: "ff786f33988bb90d960a013dd1127b11"
server_key_version: "encryptionkey@0"
I20260811 18:53:09.523497 31610 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s
I20260811 18:53:09.527885 31634 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:09.529712 31610 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 18:53:09.529935 31610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "446c8f4c52ea4d6ca9ccb544ff395cfc"
format_stamp: "Formatted at 2026-08-11 18:53:09 on dist-test-slave-lgr5"
server_key: "1d513df142e269322998376c2d91d78c"
server_key_iv: "ff786f33988bb90d960a013dd1127b11"
server_key_version: "encryptionkey@0"
I20260811 18:53:09.530169 31610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:09.549178 31610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:09.554462 31610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:09.554796 31610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:09.577081 31610 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40511
I20260811 18:53:09.577268 31729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40511 every 8 connection(s)
I20260811 18:53:09.578889 31610 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:09.582158 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 31610
I20260811 18:53:09.582374 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:53:09.583001 25700 external_mini_cluster.cc:1428] Setting key 377b17db68c8431803b21d4607bbfda6
I20260811 18:53:09.583877 31730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:09.600216 31730 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 446c8f4c52ea4d6ca9ccb544ff395cfc: Bootstrap starting.
I20260811 18:53:09.600595 31734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:09.585123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:47179 (local address 127.0.0.1:40511)
0811 18:53:09.585982 (+ 859us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:09.585994 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:09.586039 (+ 45us) server_negotiation.cc:407] Connection header received
0811 18:53:09.587925 (+ 1886us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:09.587958 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:09.588599 (+ 641us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:09.589028 (+ 429us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:09.589834 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:09.592216 (+ 2382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:09.594241 (+ 2025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:09.595747 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:09.595972 (+ 225us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:09.597683 (+ 1711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:09.597694 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:09.597713 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:09.598417 (+ 704us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:09.598516 (+ 99us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:09.598550 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:09.598709 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:09.599127 (+ 418us) server_negotiation.cc:299] Negotiation successful
0811 18:53:09.599393 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":370,"threads_started":1}
I20260811 18:53:09.604337 31730 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 446c8f4c52ea4d6ca9ccb544ff395cfc: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:09.605245 25700 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:53:09.605545 31730 log.cc:824] T 00000000000000000000000000000000 P 446c8f4c52ea4d6ca9ccb544ff395cfc: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:09.609386 31730 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 446c8f4c52ea4d6ca9ccb544ff395cfc: No bootstrap required, opened a new log
I20260811 18:53:09.618101 31734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:09.610581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:40685 (local address 127.0.0.1:40511)
0811 18:53:09.610773 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:09.610780 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:09.611262 (+ 482us) server_negotiation.cc:407] Connection header received
0811 18:53:09.611438 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:09.611444 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:09.611536 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:09.611650 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:09.612287 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:09.613479 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:09.614989 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:09.615721 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:09.615861 (+ 140us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:09.617193 (+ 1332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:09.617200 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:09.617208 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:09.617236 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:09.617328 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:09.617350 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:09.617483 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:09.617681 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 18:53:09.617748 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 18:53:09.618981 31730 raft_consensus.cc:348] T 00000000000000000000000000000000 P 446c8f4c52ea4d6ca9ccb544ff395cfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "446c8f4c52ea4d6ca9ccb544ff395cfc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40511 } }
I20260811 18:53:09.619400 31730 raft_consensus.cc:374] T 00000000000000000000000000000000 P 446c8f4c52ea4d6ca9ccb544ff395cfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:09.619534 31730 raft_consensus.cc:729] T 00000000000000000000000000000000 P 446c8f4c52ea4d6ca9ccb544ff395cfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 446c8f4c52ea4d6ca9ccb544ff395cfc, State: Initialized, Role: FOLLOWER
I20260811 18:53:09.620210 31730 consensus_queue.cc:260] T 00000000000000000000000000000000 P 446c8f4c52ea4d6ca9ccb544ff395cfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "446c8f4c52ea4d6ca9ccb544ff395cfc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40511 } }
I20260811 18:53:09.620445 31730 raft_consensus.cc:388] T 00000000000000000000000000000000 P 446c8f4c52ea4d6ca9ccb544ff395cfc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:09.620584 31730 raft_consensus.cc:482] T 00000000000000000000000000000000 P 446c8f4c52ea4d6ca9ccb544ff395cfc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:09.620738 31730 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 446c8f4c52ea4d6ca9ccb544ff395cfc [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:09.622974 31730 raft_consensus.cc:504] T 00000000000000000000000000000000 P 446c8f4c52ea4d6ca9ccb544ff395cfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "446c8f4c52ea4d6ca9ccb544ff395cfc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40511 } }
I20260811 18:53:09.623509 31730 leader_election.cc:302] T 00000000000000000000000000000000 P 446c8f4c52ea4d6ca9ccb544ff395cfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 446c8f4c52ea4d6ca9ccb544ff395cfc; no voters:
I20260811 18:53:09.624215 31730 leader_election.cc:288] T 00000000000000000000000000000000 P 446c8f4c52ea4d6ca9ccb544ff395cfc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:09.624436 31742 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 446c8f4c52ea4d6ca9ccb544ff395cfc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:09.625175 31742 raft_consensus.cc:686] T 00000000000000000000000000000000 P 446c8f4c52ea4d6ca9ccb544ff395cfc [term 1 LEADER]: Becoming Leader. State: Replica: 446c8f4c52ea4d6ca9ccb544ff395cfc, State: Running, Role: LEADER
I20260811 18:53:09.625767 31742 consensus_queue.cc:237] T 00000000000000000000000000000000 P 446c8f4c52ea4d6ca9ccb544ff395cfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "446c8f4c52ea4d6ca9ccb544ff395cfc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40511 } }
I20260811 18:53:09.626569 31730 sys_catalog.cc:564] T 00000000000000000000000000000000 P 446c8f4c52ea4d6ca9ccb544ff395cfc [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:09.629142 31747 sys_catalog.cc:455] T 00000000000000000000000000000000 P 446c8f4c52ea4d6ca9ccb544ff395cfc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 446c8f4c52ea4d6ca9ccb544ff395cfc. Latest consensus state: current_term: 1 leader_uuid: "446c8f4c52ea4d6ca9ccb544ff395cfc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "446c8f4c52ea4d6ca9ccb544ff395cfc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40511 } } }
I20260811 18:53:09.628993 31746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 446c8f4c52ea4d6ca9ccb544ff395cfc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "446c8f4c52ea4d6ca9ccb544ff395cfc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "446c8f4c52ea4d6ca9ccb544ff395cfc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40511 } } }
I20260811 18:53:09.629698 31747 sys_catalog.cc:458] T 00000000000000000000000000000000 P 446c8f4c52ea4d6ca9ccb544ff395cfc [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:09.629698 31746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 446c8f4c52ea4d6ca9ccb544ff395cfc [sys.catalog]: This master's current role is: LEADER
W20260811 18:53:09.639654 31765 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 446c8f4c52ea4d6ca9ccb544ff395cfc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:53:09.639804 31765 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:53:09.639915 31754 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:09.641515 31754 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:09.651295 31754 catalog_manager.cc:1347] Generated new cluster ID: ba20cf88aadf4fc78d75ee0de71913c2
I20260811 18:53:09.651448 31754 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:09.671756 31754 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:09.673275 31754 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:09.683293 31754 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 446c8f4c52ea4d6ca9ccb544ff395cfc: Generated new TSK 0
I20260811 18:53:09.684367 31754 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:53:09.699971 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 31610
W20260811 18:53:09.701531 31723 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.158:47179
W20260811 18:53:09.702481 25700 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 31610: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:53:09.702643 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 31610
W20260811 18:53:09.733268 31583 connection.cc:535] client connection to 127.0.0.1:40511 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40511): Connection reset by peer (error 104)
2026-08-11T18:53:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2304 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:53:09 dist-test-slave-lgr5 krb5kdc[31781](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:53:09 dist-test-slave-lgr5 krb5kdc[31781](info): set up 2 sockets
Aug 11 18:53:09 dist-test-slave-lgr5 krb5kdc[31781](info): commencing operation
krb5kdc: starting...
W20260811 18:53:11.033277 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.280s user 0.000s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:53:11 dist-test-slave-lgr5 krb5kdc[31781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474391, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:53:11.396471 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36483
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36483
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:11.758342 31804 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:11.758674 31804 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:11.758800 31804 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:11.766458 31804 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:11.766616 31804 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:11.766680 31804 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:11.766770 31804 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:11.766834 31804 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:11.778127 31804 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36483
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474012733352-25700-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:11.779592 31804 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:11.781064 31804 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:11.793910 31815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:11.793994 31816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:11.793942 31821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:11.794734 31804 server_base.cc:1034] running on GCE node
I20260811 18:53:11.795588 31804 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:11.797390 31804 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:11.798636 31804 hybrid_clock.cc:648] HybridClock initialized: now 1786474391798589 us; error 40 us; skew 500 ppm
I20260811 18:53:11.799029 31804 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:11 dist-test-slave-lgr5 krb5kdc[31781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474391, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:11.808188 31804 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:53:11.810058 31804 webserver.cc:460] Webserver started at http://127.0.0.1:37603/ using document root <none> and password file <none>
I20260811 18:53:11.810851 31804 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:11.810987 31804 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:11.811319 31804 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:11.814657 31804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "891bba4115f04443ab1604bbabe3ba78"
format_stamp: "Formatted at 2026-08-11 18:53:11 on dist-test-slave-lgr5"
server_key: "f876ce85938cb9963c8709d811377bfe"
server_key_iv: "7ead6bc9f93356e2cb7209621bb78155"
server_key_version: "encryptionkey@0"
I20260811 18:53:11.815542 31804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "891bba4115f04443ab1604bbabe3ba78"
format_stamp: "Formatted at 2026-08-11 18:53:11 on dist-test-slave-lgr5"
server_key: "f876ce85938cb9963c8709d811377bfe"
server_key_iv: "7ead6bc9f93356e2cb7209621bb78155"
server_key_version: "encryptionkey@0"
I20260811 18:53:11.822217 31804 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.004s
I20260811 18:53:11.827143 31833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:11.829028 31804 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 18:53:11.829239 31804 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "891bba4115f04443ab1604bbabe3ba78"
format_stamp: "Formatted at 2026-08-11 18:53:11 on dist-test-slave-lgr5"
server_key: "f876ce85938cb9963c8709d811377bfe"
server_key_iv: "7ead6bc9f93356e2cb7209621bb78155"
server_key_version: "encryptionkey@0"
I20260811 18:53:11.829478 31804 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:11.835830 31804 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:11.840736 31804 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:11.841068 31804 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:11.860742 31804 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36483
I20260811 18:53:11.860787 31922 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36483 every 8 connection(s)
I20260811 18:53:11.862304 31804 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:11.866550 31923 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:11.872175 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 31804
I20260811 18:53:11.872396 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:53:11.872939 25700 external_mini_cluster.cc:1428] Setting key d25ce4afb9a693bc16ad23f23b1d51d4
I20260811 18:53:11.879065 31923 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 891bba4115f04443ab1604bbabe3ba78: Bootstrap starting.
I20260811 18:53:11.881744 31927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:11.875053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:36183 (local address 127.0.0.1:36483)
0811 18:53:11.875955 (+ 902us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:11.875968 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:11.876017 (+ 49us) server_negotiation.cc:407] Connection header received
0811 18:53:11.877921 (+ 1904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:11.877951 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:11.878348 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:11.878767 (+ 419us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:11.879955 (+ 1188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:11.879963 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:11.879977 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:11.879995 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:11.880067 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:11.880121 (+ 54us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:11.880348 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:11.880511 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 18:53:11.880721 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":664,"thread_start_us":398,"threads_started":1}
I20260811 18:53:11.883044 31923 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 891bba4115f04443ab1604bbabe3ba78: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:11.884353 31923 log.cc:824] T 00000000000000000000000000000000 P 891bba4115f04443ab1604bbabe3ba78: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:11.886147 25700 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:53:11.887554 31923 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 891bba4115f04443ab1604bbabe3ba78: No bootstrap required, opened a new log
I20260811 18:53:11.893520 31927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:11.890846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:54329 (local address 127.0.0.1:36483)
0811 18:53:11.891040 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:11.891046 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:11.891505 (+ 459us) server_negotiation.cc:407] Connection header received
0811 18:53:11.891642 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:11.891648 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:11.891722 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:11.891866 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:11.892849 (+ 983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:11.892854 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:11.892860 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:11.892880 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:11.892934 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:11.892954 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:11.893085 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:11.893129 (+ 44us) server_negotiation.cc:299] Negotiation successful
0811 18:53:11.893194 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 18:53:11.896723 31923 raft_consensus.cc:348] T 00000000000000000000000000000000 P 891bba4115f04443ab1604bbabe3ba78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "891bba4115f04443ab1604bbabe3ba78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36483 } }
I20260811 18:53:11.897130 31923 raft_consensus.cc:374] T 00000000000000000000000000000000 P 891bba4115f04443ab1604bbabe3ba78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:11.897207 31923 raft_consensus.cc:729] T 00000000000000000000000000000000 P 891bba4115f04443ab1604bbabe3ba78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 891bba4115f04443ab1604bbabe3ba78, State: Initialized, Role: FOLLOWER
I20260811 18:53:11.897746 31923 consensus_queue.cc:260] T 00000000000000000000000000000000 P 891bba4115f04443ab1604bbabe3ba78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "891bba4115f04443ab1604bbabe3ba78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36483 } }
I20260811 18:53:11.897987 31923 raft_consensus.cc:388] T 00000000000000000000000000000000 P 891bba4115f04443ab1604bbabe3ba78 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:11.898092 31923 raft_consensus.cc:482] T 00000000000000000000000000000000 P 891bba4115f04443ab1604bbabe3ba78 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:11.898232 31923 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 891bba4115f04443ab1604bbabe3ba78 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:11.900853 31923 raft_consensus.cc:504] T 00000000000000000000000000000000 P 891bba4115f04443ab1604bbabe3ba78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "891bba4115f04443ab1604bbabe3ba78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36483 } }
I20260811 18:53:11.901388 31923 leader_election.cc:302] T 00000000000000000000000000000000 P 891bba4115f04443ab1604bbabe3ba78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 891bba4115f04443ab1604bbabe3ba78; no voters:
I20260811 18:53:11.901996 31923 leader_election.cc:288] T 00000000000000000000000000000000 P 891bba4115f04443ab1604bbabe3ba78 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:11.902155 31937 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 891bba4115f04443ab1604bbabe3ba78 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:11.902837 31937 raft_consensus.cc:686] T 00000000000000000000000000000000 P 891bba4115f04443ab1604bbabe3ba78 [term 1 LEADER]: Becoming Leader. State: Replica: 891bba4115f04443ab1604bbabe3ba78, State: Running, Role: LEADER
I20260811 18:53:11.903425 31937 consensus_queue.cc:237] T 00000000000000000000000000000000 P 891bba4115f04443ab1604bbabe3ba78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "891bba4115f04443ab1604bbabe3ba78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36483 } }
I20260811 18:53:11.904117 31923 sys_catalog.cc:564] T 00000000000000000000000000000000 P 891bba4115f04443ab1604bbabe3ba78 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:11.906191 31938 sys_catalog.cc:455] T 00000000000000000000000000000000 P 891bba4115f04443ab1604bbabe3ba78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "891bba4115f04443ab1604bbabe3ba78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "891bba4115f04443ab1604bbabe3ba78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36483 } } }
I20260811 18:53:11.906562 31938 sys_catalog.cc:458] T 00000000000000000000000000000000 P 891bba4115f04443ab1604bbabe3ba78 [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:11.906997 31939 sys_catalog.cc:455] T 00000000000000000000000000000000 P 891bba4115f04443ab1604bbabe3ba78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 891bba4115f04443ab1604bbabe3ba78. Latest consensus state: current_term: 1 leader_uuid: "891bba4115f04443ab1604bbabe3ba78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "891bba4115f04443ab1604bbabe3ba78" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36483 } } }
I20260811 18:53:11.907299 31939 sys_catalog.cc:458] T 00000000000000000000000000000000 P 891bba4115f04443ab1604bbabe3ba78 [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:11.907404 31944 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:11.914413 31944 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:11.924015 31944 catalog_manager.cc:1347] Generated new cluster ID: d99f1c35879a435e8d522e3d02652c72
I20260811 18:53:11.924168 31944 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:11.941679 31944 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:11.942157 31944 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:11.954109 31944 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 891bba4115f04443ab1604bbabe3ba78: Generated new TSK 0
I20260811 18:53:11.955153 31944 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:53:11.971815 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 31804
W20260811 18:53:11.973318 31914 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.158:36183
W20260811 18:53:11.974503 25700 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 31804: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:53:11.974869 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 31804
2026-08-11T18:53:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2273 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:53:12 dist-test-slave-lgr5 krb5kdc[31971](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:53:12 dist-test-slave-lgr5 krb5kdc[31971](info): set up 2 sockets
Aug 11 18:53:12 dist-test-slave-lgr5 krb5kdc[31971](info): commencing operation
krb5kdc: starting...
W20260811 18:53:13.289986 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.263s user 0.003s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:53:13 dist-test-slave-lgr5 krb5kdc[31971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:53:13.650128 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:41025
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:36287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:41025
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:14.025403 31993 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:14.025785 31993 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:14.025928 31993 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:14.033660 31993 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:14.033820 31993 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:14.033901 31993 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:14.033991 31993 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:14.034085 31993 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:14.045006 31993 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:36287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:41025
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:41025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:14.046418 31993 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:14.047899 31993 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:14.062117 32005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:14.062144 32002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:14.063036 31999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:14.062984 31993 server_base.cc:1034] running on GCE node
I20260811 18:53:14.064276 31993 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:14.066408 31993 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:14.067750 31993 hybrid_clock.cc:648] HybridClock initialized: now 1786474394067698 us; error 65 us; skew 500 ppm
I20260811 18:53:14.068408 31993 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:14 dist-test-slave-lgr5 krb5kdc[31971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474394, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:14.073503 31993 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:53:14.075966 31993 webserver.cc:460] Webserver started at http://127.25.25.62:41945/ using document root <none> and password file <none>
I20260811 18:53:14.077040 31993 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:14.077214 31993 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:14.077581 31993 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:14.081072 31993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "a2ea92f08a0e4018af4e72694271aa63"
format_stamp: "Formatted at 2026-08-11 18:53:14 on dist-test-slave-lgr5"
server_key: "595f1325682748d1b38d2b47eb71c5e3"
server_key_iv: "f732a25124e546e0807c3b4d86c6a8c2"
server_key_version: "encryptionkey@0"
I20260811 18:53:14.081987 31993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "a2ea92f08a0e4018af4e72694271aa63"
format_stamp: "Formatted at 2026-08-11 18:53:14 on dist-test-slave-lgr5"
server_key: "595f1325682748d1b38d2b47eb71c5e3"
server_key_iv: "f732a25124e546e0807c3b4d86c6a8c2"
server_key_version: "encryptionkey@0"
I20260811 18:53:14.088351 31993 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 18:53:14.092613 32015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:14.094509 31993 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 18:53:14.094715 31993 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "a2ea92f08a0e4018af4e72694271aa63"
format_stamp: "Formatted at 2026-08-11 18:53:14 on dist-test-slave-lgr5"
server_key: "595f1325682748d1b38d2b47eb71c5e3"
server_key_iv: "f732a25124e546e0807c3b4d86c6a8c2"
server_key_version: "encryptionkey@0"
I20260811 18:53:14.094936 31993 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:14.126950 31993 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:14.131613 31993 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:14.131907 31993 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:14.151888 31993 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:41025
I20260811 18:53:14.151908 32106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:41025 every 8 connection(s)
I20260811 18:53:14.153568 31993 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:14.158890 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 31993
I20260811 18:53:14.159113 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:53:14.159312 32107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:14.159700 25700 external_mini_cluster.cc:1428] Setting key 7375390f420d62fb99a7016dc15befc9
I20260811 18:53:14.176900 32107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2ea92f08a0e4018af4e72694271aa63: Bootstrap starting.
I20260811 18:53:14.181396 32107 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a2ea92f08a0e4018af4e72694271aa63: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:14.182854 32107 log.cc:824] T 00000000000000000000000000000000 P a2ea92f08a0e4018af4e72694271aa63: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:14.187702 32107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2ea92f08a0e4018af4e72694271aa63: No bootstrap required, opened a new log
Aug 11 18:53:14 dist-test-slave-lgr5 krb5kdc[31971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:53:14.197381 32107 raft_consensus.cc:348] T 00000000000000000000000000000000 P a2ea92f08a0e4018af4e72694271aa63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2ea92f08a0e4018af4e72694271aa63" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41025 } }
I20260811 18:53:14.197901 32107 raft_consensus.cc:374] T 00000000000000000000000000000000 P a2ea92f08a0e4018af4e72694271aa63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:14.198028 32107 raft_consensus.cc:729] T 00000000000000000000000000000000 P a2ea92f08a0e4018af4e72694271aa63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2ea92f08a0e4018af4e72694271aa63, State: Initialized, Role: FOLLOWER
I20260811 18:53:14.198771 32107 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2ea92f08a0e4018af4e72694271aa63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2ea92f08a0e4018af4e72694271aa63" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41025 } }
I20260811 18:53:14.199126 32107 raft_consensus.cc:388] T 00000000000000000000000000000000 P a2ea92f08a0e4018af4e72694271aa63 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:14.199331 32107 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2ea92f08a0e4018af4e72694271aa63 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:14.199537 32107 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2ea92f08a0e4018af4e72694271aa63 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:14.202387 32107 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2ea92f08a0e4018af4e72694271aa63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2ea92f08a0e4018af4e72694271aa63" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41025 } }
I20260811 18:53:14.203156 32107 leader_election.cc:302] T 00000000000000000000000000000000 P a2ea92f08a0e4018af4e72694271aa63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a2ea92f08a0e4018af4e72694271aa63; no voters:
I20260811 18:53:14.203809 32107 leader_election.cc:288] T 00000000000000000000000000000000 P a2ea92f08a0e4018af4e72694271aa63 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:14.203964 32116 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a2ea92f08a0e4018af4e72694271aa63 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:14.205112 32113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:14.161885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34941 (local address 127.25.25.62:41025)
0811 18:53:14.176641 (+ 14756us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:14.176660 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:14.176722 (+ 62us) server_negotiation.cc:407] Connection header received
0811 18:53:14.179552 (+ 2830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:14.179587 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:14.180184 (+ 597us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:14.182758 (+ 2574us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:14.183378 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:14.185582 (+ 2204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:14.187441 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:14.188625 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:14.188836 (+ 211us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:14.194729 (+ 5893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:14.194745 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:14.194773 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:14.194841 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:14.199063 (+ 4222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:14.200327 (+ 1264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:14.200338 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:14.200351 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:14.200617 (+ 266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:14.201176 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:14.201181 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:14.201185 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:14.202010 (+ 825us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:14.202334 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:14.202942 (+ 608us) server_negotiation.cc:299] Negotiation successful
0811 18:53:14.203338 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14505,"thread_start_us":14234,"threads_started":1}
I20260811 18:53:14.205996 32116 raft_consensus.cc:686] T 00000000000000000000000000000000 P a2ea92f08a0e4018af4e72694271aa63 [term 1 LEADER]: Becoming Leader. State: Replica: a2ea92f08a0e4018af4e72694271aa63, State: Running, Role: LEADER
I20260811 18:53:14.206354 32107 sys_catalog.cc:564] T 00000000000000000000000000000000 P a2ea92f08a0e4018af4e72694271aa63 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:14.206688 32116 consensus_queue.cc:237] T 00000000000000000000000000000000 P a2ea92f08a0e4018af4e72694271aa63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2ea92f08a0e4018af4e72694271aa63" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41025 } }
I20260811 18:53:14.209820 32118 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2ea92f08a0e4018af4e72694271aa63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a2ea92f08a0e4018af4e72694271aa63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2ea92f08a0e4018af4e72694271aa63" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41025 } } }
I20260811 18:53:14.210253 32118 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2ea92f08a0e4018af4e72694271aa63 [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:14.210606 25700 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:53:14.215736 32119 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2ea92f08a0e4018af4e72694271aa63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a2ea92f08a0e4018af4e72694271aa63. Latest consensus state: current_term: 1 leader_uuid: "a2ea92f08a0e4018af4e72694271aa63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2ea92f08a0e4018af4e72694271aa63" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41025 } } }
I20260811 18:53:14.216725 32119 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2ea92f08a0e4018af4e72694271aa63 [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:14.218412 32128 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:14.224509 32128 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:14.236835 32113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:14.216592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53869 (local address 127.25.25.62:41025)
0811 18:53:14.216776 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:14.216782 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:14.217006 (+ 224us) server_negotiation.cc:407] Connection header received
0811 18:53:14.217079 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:14.217085 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:14.217163 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:14.217262 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:14.219243 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:14.220486 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:14.222397 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:14.223129 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:14.223279 (+ 150us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:14.227386 (+ 4107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:14.227394 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:14.227399 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:14.227455 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:14.231624 (+ 4169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:14.232908 (+ 1284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:14.232921 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:14.232925 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:14.233104 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:14.233779 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:14.233784 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:14.233787 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:14.234280 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:14.234562 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:14.236155 (+ 1593us) server_negotiation.cc:299] Negotiation successful
0811 18:53:14.236389 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 18:53:14.240415 32128 catalog_manager.cc:1347] Generated new cluster ID: bfc02e653d8b47deb02d1dad3dca70ef
I20260811 18:53:14.240643 32128 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:14.258599 32128 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:14.260135 32128 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:14.275935 32128 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a2ea92f08a0e4018af4e72694271aa63: Generated new TSK 0
I20260811 18:53:14.277392 32128 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:53:14.289876 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 31993
I20260811 18:53:14.291175 32098 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:53:14.385674 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 31993
W20260811 18:53:14.410816 31969 connection.cc:535] client connection to 127.25.25.62:41025 recv error: Network error: failed to read from TLS socket (remote: 127.25.25.62:41025): Connection reset by peer (error 104)
2026-08-11T18:53:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2403 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:53:14 dist-test-slave-lgr5 krb5kdc[32156](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:53:14 dist-test-slave-lgr5 krb5kdc[32156](info): set up 2 sockets
Aug 11 18:53:14 dist-test-slave-lgr5 krb5kdc[32156](info): commencing operation
krb5kdc: starting...
W20260811 18:53:15.686115 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.255s user 0.000s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:53:15 dist-test-slave-lgr5 krb5kdc[32156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474395, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:53:16.043341 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:45065
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:36915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:45065
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:16.412250 32179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:16.412628 32179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:16.412783 32179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:16.420694 32179 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:16.420849 32179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:16.420928 32179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:16.421022 32179 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:16.421089 32179 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:16.431962 32179 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:36915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:45065
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:45065
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:16.433507 32179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:16.434967 32179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:16.447811 32187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:16.447677 32189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:16.448058 32185 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:16.449174 32179 server_base.cc:1034] running on GCE node
I20260811 18:53:16.450105 32179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:16.451696 32179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:16.452931 32179 hybrid_clock.cc:648] HybridClock initialized: now 1786474396452885 us; error 36 us; skew 500 ppm
I20260811 18:53:16.453397 32179 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:16 dist-test-slave-lgr5 krb5kdc[32156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474396, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:16.462252 32179 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:53:16.464402 32179 webserver.cc:460] Webserver started at http://127.25.25.62:46427/ using document root <none> and password file <none>
I20260811 18:53:16.465420 32179 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:16.465596 32179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:16.466004 32179 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:16.469856 32179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "69e88760fc55486fa90dd6543a0eb05e"
format_stamp: "Formatted at 2026-08-11 18:53:16 on dist-test-slave-lgr5"
server_key: "bd784c85cb29653c383f1a04f39cd9ed"
server_key_iv: "61e6e4cd8b5418eeac0eceeb60034209"
server_key_version: "encryptionkey@0"
I20260811 18:53:16.470815 32179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "69e88760fc55486fa90dd6543a0eb05e"
format_stamp: "Formatted at 2026-08-11 18:53:16 on dist-test-slave-lgr5"
server_key: "bd784c85cb29653c383f1a04f39cd9ed"
server_key_iv: "61e6e4cd8b5418eeac0eceeb60034209"
server_key_version: "encryptionkey@0"
I20260811 18:53:16.477154 32179 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260811 18:53:16.481307 32202 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:16.483165 32179 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260811 18:53:16.483417 32179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "69e88760fc55486fa90dd6543a0eb05e"
format_stamp: "Formatted at 2026-08-11 18:53:16 on dist-test-slave-lgr5"
server_key: "bd784c85cb29653c383f1a04f39cd9ed"
server_key_iv: "61e6e4cd8b5418eeac0eceeb60034209"
server_key_version: "encryptionkey@0"
I20260811 18:53:16.483647 32179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:16.503367 32179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:16.508265 32179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:16.508594 32179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:16.528182 32179 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:45065
I20260811 18:53:16.528229 32285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:45065 every 8 connection(s)
I20260811 18:53:16.529713 32179 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:16.533784 32286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:16.540028 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 32179
I20260811 18:53:16.540279 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:53:16.540870 25700 external_mini_cluster.cc:1428] Setting key 975266afe1034f161215302ed9b6f3c7
I20260811 18:53:16.546185 32286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69e88760fc55486fa90dd6543a0eb05e: Bootstrap starting.
I20260811 18:53:16.549973 32286 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 69e88760fc55486fa90dd6543a0eb05e: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:16.551242 32286 log.cc:824] T 00000000000000000000000000000000 P 69e88760fc55486fa90dd6543a0eb05e: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:16.554509 32286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69e88760fc55486fa90dd6543a0eb05e: No bootstrap required, opened a new log
I20260811 18:53:16.555320 32295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.542994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55687 (local address 127.25.25.62:45065)
0811 18:53:16.544125 (+ 1131us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:16.544139 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:16.544197 (+ 58us) server_negotiation.cc:407] Connection header received
0811 18:53:16.545921 (+ 1724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:16.545949 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:16.546386 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:16.546735 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:16.547403 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.548837 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.550713 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.551471 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.551605 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.552956 (+ 1351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:16.552964 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:16.552979 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:16.553532 (+ 553us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:16.553612 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:16.553638 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:16.553756 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:16.554023 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 18:53:16.554194 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":860,"thread_start_us":550,"threads_started":1}
I20260811 18:53:16.560424 25700 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:53:16.566236 32286 raft_consensus.cc:348] T 00000000000000000000000000000000 P 69e88760fc55486fa90dd6543a0eb05e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69e88760fc55486fa90dd6543a0eb05e" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45065 } }
I20260811 18:53:16.567072 32286 raft_consensus.cc:374] T 00000000000000000000000000000000 P 69e88760fc55486fa90dd6543a0eb05e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:16.567261 32286 raft_consensus.cc:729] T 00000000000000000000000000000000 P 69e88760fc55486fa90dd6543a0eb05e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69e88760fc55486fa90dd6543a0eb05e, State: Initialized, Role: FOLLOWER
I20260811 18:53:16.568560 32286 consensus_queue.cc:260] T 00000000000000000000000000000000 P 69e88760fc55486fa90dd6543a0eb05e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69e88760fc55486fa90dd6543a0eb05e" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45065 } }
I20260811 18:53:16.569085 32286 raft_consensus.cc:388] T 00000000000000000000000000000000 P 69e88760fc55486fa90dd6543a0eb05e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:16.569329 32286 raft_consensus.cc:482] T 00000000000000000000000000000000 P 69e88760fc55486fa90dd6543a0eb05e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:16.569597 32286 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 69e88760fc55486fa90dd6543a0eb05e [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:16.573547 32286 raft_consensus.cc:504] T 00000000000000000000000000000000 P 69e88760fc55486fa90dd6543a0eb05e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69e88760fc55486fa90dd6543a0eb05e" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45065 } }
I20260811 18:53:16.574429 32286 leader_election.cc:302] T 00000000000000000000000000000000 P 69e88760fc55486fa90dd6543a0eb05e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 69e88760fc55486fa90dd6543a0eb05e; no voters:
I20260811 18:53:16.575794 32286 leader_election.cc:288] T 00000000000000000000000000000000 P 69e88760fc55486fa90dd6543a0eb05e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:16.575920 32306 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 69e88760fc55486fa90dd6543a0eb05e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:16.576999 32295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.566696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56031 (local address 127.25.25.62:45065)
0811 18:53:16.566924 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:16.566930 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:16.568842 (+ 1912us) server_negotiation.cc:407] Connection header received
0811 18:53:16.569049 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:16.569055 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:16.569157 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:16.569262 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:16.570271 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.571492 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.573100 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.573604 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.573746 (+ 142us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.575694 (+ 1948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:16.575704 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:16.575708 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:16.575737 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:16.575833 (+ 96us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:16.575861 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:16.576012 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:16.576256 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 18:53:16.576321 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 18:53:16.578559 32286 sys_catalog.cc:564] T 00000000000000000000000000000000 P 69e88760fc55486fa90dd6543a0eb05e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:16.584408 32306 raft_consensus.cc:686] T 00000000000000000000000000000000 P 69e88760fc55486fa90dd6543a0eb05e [term 1 LEADER]: Becoming Leader. State: Replica: 69e88760fc55486fa90dd6543a0eb05e, State: Running, Role: LEADER
I20260811 18:53:16.585338 32306 consensus_queue.cc:237] T 00000000000000000000000000000000 P 69e88760fc55486fa90dd6543a0eb05e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69e88760fc55486fa90dd6543a0eb05e" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45065 } }
I20260811 18:53:16.589417 32310 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69e88760fc55486fa90dd6543a0eb05e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 69e88760fc55486fa90dd6543a0eb05e. Latest consensus state: current_term: 1 leader_uuid: "69e88760fc55486fa90dd6543a0eb05e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69e88760fc55486fa90dd6543a0eb05e" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45065 } } }
I20260811 18:53:16.589969 32310 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69e88760fc55486fa90dd6543a0eb05e [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:16.589600 32308 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69e88760fc55486fa90dd6543a0eb05e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "69e88760fc55486fa90dd6543a0eb05e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69e88760fc55486fa90dd6543a0eb05e" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45065 } } }
I20260811 18:53:16.590575 32308 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69e88760fc55486fa90dd6543a0eb05e [sys.catalog]: This master's current role is: LEADER
W20260811 18:53:16.606488 32328 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 69e88760fc55486fa90dd6543a0eb05e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:53:16.606645 32328 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:53:16.606798 32331 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:16.608960 32331 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:16.624442 32331 catalog_manager.cc:1347] Generated new cluster ID: 2ca338ec771d487cb4afa65d0234a9e4
I20260811 18:53:16.624593 32331 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:16.642835 32331 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:16.644268 32331 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:16.652742 32331 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 69e88760fc55486fa90dd6543a0eb05e: Generated new TSK 0
I20260811 18:53:16.654036 32331 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:53:16.670209 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 32179
W20260811 18:53:16.671741 32279 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:55687
W20260811 18:53:16.672675 25700 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 32179: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:53:16.672842 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 32179
W20260811 18:53:16.700424 32153 connection.cc:535] client connection to 127.25.25.62:45065 recv error: Network error: failed to read from TLS socket (remote: 127.25.25.62:45065): Connection reset by peer (error 104)
2026-08-11T18:53:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2289 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:53:16 dist-test-slave-lgr5 krb5kdc[32342](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:53:16 dist-test-slave-lgr5 krb5kdc[32342](info): set up 2 sockets
Aug 11 18:53:16 dist-test-slave-lgr5 krb5kdc[32342](info): commencing operation
krb5kdc: starting...
W20260811 18:53:17.973078 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.253s user 0.000s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:53:18 dist-test-slave-lgr5 krb5kdc[32342](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474398, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:53:18.336362 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:45041
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:37259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:45041
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:18.705772 32363 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:18.706104 32363 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:18.706254 32363 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:18.717643 32363 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:18.717921 32363 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:18.718050 32363 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:18.718173 32363 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:18.718264 32363 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:18.729902 32363 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:37259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:45041
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:45041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:18.731345 32363 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:18.732884 32363 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:18.744877 32371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:18.745404 32374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:18.745865 32379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:18.746255 32363 server_base.cc:1034] running on GCE node
I20260811 18:53:18.747107 32363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:18.748700 32363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:18.749912 32363 hybrid_clock.cc:648] HybridClock initialized: now 1786474398749856 us; error 47 us; skew 500 ppm
I20260811 18:53:18.750273 32363 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:18 dist-test-slave-lgr5 krb5kdc[32342](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474398, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:18.759300 32363 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:53:18.761003 32363 webserver.cc:460] Webserver started at http://127.25.25.62:37751/ using document root <none> and password file <none>
I20260811 18:53:18.761718 32363 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:18.761831 32363 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:18.762102 32363 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:18.765290 32363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "be0dfd78e3544d1faf5639a4af5830fa"
format_stamp: "Formatted at 2026-08-11 18:53:18 on dist-test-slave-lgr5"
server_key: "0a15e7ccd0f91dfca2c38bbfe85867df"
server_key_iv: "3a41ea3519ee65934ea1efc9819eaee9"
server_key_version: "encryptionkey@0"
I20260811 18:53:18.766055 32363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "be0dfd78e3544d1faf5639a4af5830fa"
format_stamp: "Formatted at 2026-08-11 18:53:18 on dist-test-slave-lgr5"
server_key: "0a15e7ccd0f91dfca2c38bbfe85867df"
server_key_iv: "3a41ea3519ee65934ea1efc9819eaee9"
server_key_version: "encryptionkey@0"
I20260811 18:53:18.771684 32363 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 18:53:18.776234 32398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:18.777984 32363 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 18:53:18.778165 32363 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "be0dfd78e3544d1faf5639a4af5830fa"
format_stamp: "Formatted at 2026-08-11 18:53:18 on dist-test-slave-lgr5"
server_key: "0a15e7ccd0f91dfca2c38bbfe85867df"
server_key_iv: "3a41ea3519ee65934ea1efc9819eaee9"
server_key_version: "encryptionkey@0"
I20260811 18:53:18.778370 32363 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:18.784971 32363 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:18.789968 32363 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:18.790284 32363 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:18.809792 32363 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:45041
I20260811 18:53:18.809831 32497 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:45041 every 8 connection(s)
I20260811 18:53:18.811451 32363 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:18.815728 32498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:18.821678 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 32363
I20260811 18:53:18.821889 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:53:18.822362 25700 external_mini_cluster.cc:1428] Setting key 203fcde6fad337d688e9a195c2724df5
I20260811 18:53:18.828694 32498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be0dfd78e3544d1faf5639a4af5830fa: Bootstrap starting.
I20260811 18:53:18.831136 32506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:18.824408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40467 (local address 127.25.25.62:45041)
0811 18:53:18.825394 (+ 986us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:18.825407 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:18.825452 (+ 45us) server_negotiation.cc:407] Connection header received
0811 18:53:18.827372 (+ 1920us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:18.827400 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:18.827796 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:18.828222 (+ 426us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:18.829406 (+ 1184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:18.829413 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:18.829428 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:18.829446 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:18.829515 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:18.829539 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:18.829752 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:18.829891 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 18:53:18.830108 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":724,"thread_start_us":462,"threads_started":1}
I20260811 18:53:18.832485 32498 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be0dfd78e3544d1faf5639a4af5830fa: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:18.833698 32498 log.cc:824] T 00000000000000000000000000000000 P be0dfd78e3544d1faf5639a4af5830fa: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:18.835172 25700 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:53:18.836938 32498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be0dfd78e3544d1faf5639a4af5830fa: No bootstrap required, opened a new log
I20260811 18:53:18.842545 32506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:18.839705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55419 (local address 127.25.25.62:45041)
0811 18:53:18.839868 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:18.839872 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:18.840379 (+ 507us) server_negotiation.cc:407] Connection header received
0811 18:53:18.840539 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:18.840545 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:18.840618 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:18.840729 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:18.841816 (+ 1087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:18.841823 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:18.841835 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:18.841857 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:18.841912 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:18.841934 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:18.842065 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:18.842172 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 18:53:18.842243 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 18:53:18.846374 32498 raft_consensus.cc:348] T 00000000000000000000000000000000 P be0dfd78e3544d1faf5639a4af5830fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be0dfd78e3544d1faf5639a4af5830fa" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45041 } }
I20260811 18:53:18.846791 32498 raft_consensus.cc:374] T 00000000000000000000000000000000 P be0dfd78e3544d1faf5639a4af5830fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:18.846899 32498 raft_consensus.cc:729] T 00000000000000000000000000000000 P be0dfd78e3544d1faf5639a4af5830fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be0dfd78e3544d1faf5639a4af5830fa, State: Initialized, Role: FOLLOWER
I20260811 18:53:18.847517 32498 consensus_queue.cc:260] T 00000000000000000000000000000000 P be0dfd78e3544d1faf5639a4af5830fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be0dfd78e3544d1faf5639a4af5830fa" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45041 } }
I20260811 18:53:18.847767 32498 raft_consensus.cc:388] T 00000000000000000000000000000000 P be0dfd78e3544d1faf5639a4af5830fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:18.847905 32498 raft_consensus.cc:482] T 00000000000000000000000000000000 P be0dfd78e3544d1faf5639a4af5830fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:18.848067 32498 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be0dfd78e3544d1faf5639a4af5830fa [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:18.850798 32498 raft_consensus.cc:504] T 00000000000000000000000000000000 P be0dfd78e3544d1faf5639a4af5830fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be0dfd78e3544d1faf5639a4af5830fa" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45041 } }
I20260811 18:53:18.851421 32498 leader_election.cc:302] T 00000000000000000000000000000000 P be0dfd78e3544d1faf5639a4af5830fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be0dfd78e3544d1faf5639a4af5830fa; no voters:
I20260811 18:53:18.852026 32498 leader_election.cc:288] T 00000000000000000000000000000000 P be0dfd78e3544d1faf5639a4af5830fa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:18.852197 32523 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be0dfd78e3544d1faf5639a4af5830fa [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:18.852936 32523 raft_consensus.cc:686] T 00000000000000000000000000000000 P be0dfd78e3544d1faf5639a4af5830fa [term 1 LEADER]: Becoming Leader. State: Replica: be0dfd78e3544d1faf5639a4af5830fa, State: Running, Role: LEADER
I20260811 18:53:18.853718 32523 consensus_queue.cc:237] T 00000000000000000000000000000000 P be0dfd78e3544d1faf5639a4af5830fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be0dfd78e3544d1faf5639a4af5830fa" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45041 } }
I20260811 18:53:18.854439 32498 sys_catalog.cc:564] T 00000000000000000000000000000000 P be0dfd78e3544d1faf5639a4af5830fa [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:18.857097 32526 sys_catalog.cc:455] T 00000000000000000000000000000000 P be0dfd78e3544d1faf5639a4af5830fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader be0dfd78e3544d1faf5639a4af5830fa. Latest consensus state: current_term: 1 leader_uuid: "be0dfd78e3544d1faf5639a4af5830fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be0dfd78e3544d1faf5639a4af5830fa" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45041 } } }
I20260811 18:53:18.857092 32525 sys_catalog.cc:455] T 00000000000000000000000000000000 P be0dfd78e3544d1faf5639a4af5830fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be0dfd78e3544d1faf5639a4af5830fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be0dfd78e3544d1faf5639a4af5830fa" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45041 } } }
I20260811 18:53:18.857623 32526 sys_catalog.cc:458] T 00000000000000000000000000000000 P be0dfd78e3544d1faf5639a4af5830fa [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:18.857689 32525 sys_catalog.cc:458] T 00000000000000000000000000000000 P be0dfd78e3544d1faf5639a4af5830fa [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:18.864421 32537 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:18.869742 32537 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:18.880436 32537 catalog_manager.cc:1347] Generated new cluster ID: 016a3770501d4759a8630fc6b5c2494c
I20260811 18:53:18.880625 32537 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:18.905761 32537 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:18.906247 32537 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:18.918862 32537 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be0dfd78e3544d1faf5639a4af5830fa: Generated new TSK 0
I20260811 18:53:18.919860 32537 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:53:18.924314 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 32363
W20260811 18:53:18.926383 32479 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:40467
W20260811 18:53:18.927210 25700 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 32363: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:53:18.927361 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 32363
2026-08-11T18:53:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2258 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:53:19 dist-test-slave-lgr5 krb5kdc[32564](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:53:19 dist-test-slave-lgr5 krb5kdc[32564](info): set up 2 sockets
Aug 11 18:53:19 dist-test-slave-lgr5 krb5kdc[32564](info): commencing operation
krb5kdc: starting...
W20260811 18:53:20.260764 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.282s user 0.000s sys 0.056s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:53:20 dist-test-slave-lgr5 krb5kdc[32564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474400, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:53:20.616724 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:36969
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:37459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:36969
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:20.987900 32591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:20.988304 32591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:20.988428 32591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:20.997380 32591 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:20.997551 32591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:20.997620 32591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:20.997690 32591 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:20.997736 32591 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:21.008396 32591 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:37459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:36969
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:36969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:21.009791 32591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:21.011222 32591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:21.023869 32600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:21.023906 32603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:21.024034 32605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:21.024662 32591 server_base.cc:1034] running on GCE node
I20260811 18:53:21.025507 32591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:21.026993 32591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:21.028199 32591 hybrid_clock.cc:648] HybridClock initialized: now 1786474401028136 us; error 48 us; skew 500 ppm
I20260811 18:53:21.028563 32591 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:21 dist-test-slave-lgr5 krb5kdc[32564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474401, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:21.031908 32591 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:53:21.033653 32591 webserver.cc:460] Webserver started at http://127.25.25.62:38639/ using document root <none> and password file <none>
I20260811 18:53:21.034423 32591 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:21.034551 32591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:21.034880 32591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:21.038278 32591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "5494a66c02c74bf19f42f7f4af8aa946"
format_stamp: "Formatted at 2026-08-11 18:53:21 on dist-test-slave-lgr5"
server_key: "7b33c2ac1483b1c5bc2f63df951ac0a8"
server_key_iv: "1d600c9bf3351089fddc0b0defcfe4ce"
server_key_version: "encryptionkey@0"
I20260811 18:53:21.039158 32591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "5494a66c02c74bf19f42f7f4af8aa946"
format_stamp: "Formatted at 2026-08-11 18:53:21 on dist-test-slave-lgr5"
server_key: "7b33c2ac1483b1c5bc2f63df951ac0a8"
server_key_iv: "1d600c9bf3351089fddc0b0defcfe4ce"
server_key_version: "encryptionkey@0"
I20260811 18:53:21.045192 32591 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 18:53:21.048964 32617 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:21.050386 32591 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:53:21.050583 32591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "5494a66c02c74bf19f42f7f4af8aa946"
format_stamp: "Formatted at 2026-08-11 18:53:21 on dist-test-slave-lgr5"
server_key: "7b33c2ac1483b1c5bc2f63df951ac0a8"
server_key_iv: "1d600c9bf3351089fddc0b0defcfe4ce"
server_key_version: "encryptionkey@0"
I20260811 18:53:21.050788 32591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:21.079384 32591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:21.084388 32591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:21.084681 32591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:21.103565 32591 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:36969
I20260811 18:53:21.103605 32732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:36969 every 8 connection(s)
I20260811 18:53:21.105167 32591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:21.109364 32733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:21.112653 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 32591
I20260811 18:53:21.112866 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:53:21.113431 25700 external_mini_cluster.cc:1428] Setting key 5119e8863ea99bef960549f5bf30ea82
I20260811 18:53:21.122697 32733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5494a66c02c74bf19f42f7f4af8aa946: Bootstrap starting.
I20260811 18:53:21.126152 32733 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5494a66c02c74bf19f42f7f4af8aa946: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:21.127278 32733 log.cc:824] T 00000000000000000000000000000000 P 5494a66c02c74bf19f42f7f4af8aa946: Log is configured to *not* fsync() on all Append() calls
Aug 11 18:53:21 dist-test-slave-lgr5 krb5kdc[32564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474400, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:53:21.130460 32733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5494a66c02c74bf19f42f7f4af8aa946: No bootstrap required, opened a new log
I20260811 18:53:21.137629 32737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:21.115588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54195 (local address 127.25.25.62:36969)
0811 18:53:21.116514 (+ 926us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:21.116527 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:21.116575 (+ 48us) server_negotiation.cc:407] Connection header received
0811 18:53:21.118377 (+ 1802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:21.118405 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:21.118900 (+ 495us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:21.119269 (+ 369us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:21.121377 (+ 2108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:21.122756 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:21.124185 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:21.124933 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:21.125117 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:21.129735 (+ 4618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:21.129744 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:21.129760 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:21.129803 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:21.133013 (+ 3210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:21.133840 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:21.133849 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:21.133856 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:21.134042 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:21.134478 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:21.134482 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:21.134484 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:21.135119 (+ 635us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:21.135446 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:21.135970 (+ 524us) server_negotiation.cc:299] Negotiation successful
0811 18:53:21.136489 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":692,"thread_start_us":433,"threads_started":1}
I20260811 18:53:21.138968 32733 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5494a66c02c74bf19f42f7f4af8aa946 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5494a66c02c74bf19f42f7f4af8aa946" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 36969 } }
I20260811 18:53:21.139433 32733 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5494a66c02c74bf19f42f7f4af8aa946 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:21.139546 32733 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5494a66c02c74bf19f42f7f4af8aa946 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5494a66c02c74bf19f42f7f4af8aa946, State: Initialized, Role: FOLLOWER
I20260811 18:53:21.140173 32733 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5494a66c02c74bf19f42f7f4af8aa946 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5494a66c02c74bf19f42f7f4af8aa946" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 36969 } }
I20260811 18:53:21.140466 32733 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5494a66c02c74bf19f42f7f4af8aa946 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:21.140622 32733 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5494a66c02c74bf19f42f7f4af8aa946 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:21.140851 32733 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5494a66c02c74bf19f42f7f4af8aa946 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:21.142107 25700 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:53:21.143431 32733 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5494a66c02c74bf19f42f7f4af8aa946 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5494a66c02c74bf19f42f7f4af8aa946" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 36969 } }
I20260811 18:53:21.144004 32733 leader_election.cc:302] T 00000000000000000000000000000000 P 5494a66c02c74bf19f42f7f4af8aa946 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5494a66c02c74bf19f42f7f4af8aa946; no voters:
I20260811 18:53:21.144735 32733 leader_election.cc:288] T 00000000000000000000000000000000 P 5494a66c02c74bf19f42f7f4af8aa946 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:21.144847 32739 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5494a66c02c74bf19f42f7f4af8aa946 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:21.148972 32739 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5494a66c02c74bf19f42f7f4af8aa946 [term 1 LEADER]: Becoming Leader. State: Replica: 5494a66c02c74bf19f42f7f4af8aa946, State: Running, Role: LEADER
I20260811 18:53:21.149850 32739 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5494a66c02c74bf19f42f7f4af8aa946 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5494a66c02c74bf19f42f7f4af8aa946" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 36969 } }
I20260811 18:53:21.154345 32733 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5494a66c02c74bf19f42f7f4af8aa946 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:21.159087 32748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5494a66c02c74bf19f42f7f4af8aa946 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5494a66c02c74bf19f42f7f4af8aa946" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5494a66c02c74bf19f42f7f4af8aa946" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 36969 } } }
I20260811 18:53:21.159598 32748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5494a66c02c74bf19f42f7f4af8aa946 [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:21.164362 32746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5494a66c02c74bf19f42f7f4af8aa946 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5494a66c02c74bf19f42f7f4af8aa946. Latest consensus state: current_term: 1 leader_uuid: "5494a66c02c74bf19f42f7f4af8aa946" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5494a66c02c74bf19f42f7f4af8aa946" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 36969 } } }
I20260811 18:53:21.165446 32746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5494a66c02c74bf19f42f7f4af8aa946 [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:21.166241 32737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:21.146811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34123 (local address 127.25.25.62:36969)
0811 18:53:21.147018 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:21.147024 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:21.148725 (+ 1701us) server_negotiation.cc:407] Connection header received
0811 18:53:21.148911 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:21.148917 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:21.149007 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:21.149122 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:21.150895 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:21.151666 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:21.153058 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:21.153551 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:21.153679 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:21.157034 (+ 3355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:21.157041 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:21.157047 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:21.157099 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:21.161346 (+ 4247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:21.162489 (+ 1143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:21.162495 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:21.162500 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:21.162712 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:21.163285 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:21.163291 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:21.163294 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:21.163779 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:21.165468 (+ 1689us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:21.165657 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 18:53:21.165948 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 18:53:21.168999 32766 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:21.175976 32766 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:21.186393 32766 catalog_manager.cc:1347] Generated new cluster ID: 69b8177273be4158b1caaeca28b844d2
I20260811 18:53:21.186614 32766 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:21.211833 32766 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:21.214071 32766 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:21.229871 32766 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5494a66c02c74bf19f42f7f4af8aa946: Generated new TSK 0
I20260811 18:53:21.230892 32766 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:53:21.249979 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 32591
I20260811 18:53:21.251240 32723 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:53:21.348196 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 32591
2026-08-11T18:53:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2415 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:53:21 dist-test-slave-lgr5 krb5kdc[326](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:53:21 dist-test-slave-lgr5 krb5kdc[326](info): set up 2 sockets
Aug 11 18:53:21 dist-test-slave-lgr5 krb5kdc[326](info): commencing operation
krb5kdc: starting...
W20260811 18:53:22.657718 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.263s user 0.003s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:53:22 dist-test-slave-lgr5 krb5kdc[326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474402, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:53:23.020905 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:35745
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:42941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:35745
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:23.391073 348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:23.391429 348 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:23.391577 348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:23.399545 348 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:23.399706 348 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:23.399796 348 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:23.399884 348 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:23.399946 348 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:23.410548 348 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:42941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:35745
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:35745
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:23.412024 348 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:23.413559 348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:23.426465 358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:23.426519 353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:23.426661 360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:23.427284 348 server_base.cc:1034] running on GCE node
I20260811 18:53:23.428262 348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:23.429945 348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:23.431183 348 hybrid_clock.cc:648] HybridClock initialized: now 1786474403431134 us; error 38 us; skew 500 ppm
I20260811 18:53:23.431605 348 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:23 dist-test-slave-lgr5 krb5kdc[326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474403, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:23.435164 348 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:53:23.437062 348 webserver.cc:460] Webserver started at http://127.25.25.62:34971/ using document root <none> and password file <none>
I20260811 18:53:23.437840 348 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:23.437978 348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:23.438308 348 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:23.441730 348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "ff21198f7b6f4c3296d02fba1d79045f"
format_stamp: "Formatted at 2026-08-11 18:53:23 on dist-test-slave-lgr5"
server_key: "51f8c2d41c2220155f5cd89212509083"
server_key_iv: "0f876ce6a4b9090af812e97b4912a823"
server_key_version: "encryptionkey@0"
I20260811 18:53:23.442615 348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "ff21198f7b6f4c3296d02fba1d79045f"
format_stamp: "Formatted at 2026-08-11 18:53:23 on dist-test-slave-lgr5"
server_key: "51f8c2d41c2220155f5cd89212509083"
server_key_iv: "0f876ce6a4b9090af812e97b4912a823"
server_key_version: "encryptionkey@0"
I20260811 18:53:23.448776 348 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 18:53:23.453104 378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:23.454779 348 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 18:53:23.455045 348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "ff21198f7b6f4c3296d02fba1d79045f"
format_stamp: "Formatted at 2026-08-11 18:53:23 on dist-test-slave-lgr5"
server_key: "51f8c2d41c2220155f5cd89212509083"
server_key_iv: "0f876ce6a4b9090af812e97b4912a823"
server_key_version: "encryptionkey@0"
I20260811 18:53:23.455273 348 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:23.474514 348 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:23.479568 348 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:23.479895 348 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:23.500730 348 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:35745
I20260811 18:53:23.500787 473 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:35745 every 8 connection(s)
I20260811 18:53:23.502331 348 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:23.506626 474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:23.507385 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 348
I20260811 18:53:23.507593 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:53:23.508271 25700 external_mini_cluster.cc:1428] Setting key 7bd2e8fe36080a3f7576f2b8387abaa9
I20260811 18:53:23.521987 474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff21198f7b6f4c3296d02fba1d79045f: Bootstrap starting.
I20260811 18:53:23.524204 477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.510453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39049 (local address 127.25.25.62:35745)
0811 18:53:23.511480 (+ 1027us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:23.511493 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:23.511545 (+ 52us) server_negotiation.cc:407] Connection header received
0811 18:53:23.513728 (+ 2183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:23.513765 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:23.514264 (+ 499us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:23.514675 (+ 411us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:23.515520 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.516937 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.519046 (+ 2109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.519902 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.520064 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.521585 (+ 1521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:23.521594 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:23.521612 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:23.522251 (+ 639us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:23.522355 (+ 104us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:23.522385 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:23.522496 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:23.522720 (+ 224us) server_negotiation.cc:299] Negotiation successful
0811 18:53:23.523045 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":778,"thread_start_us":541,"threads_started":1}
I20260811 18:53:23.525601 474 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff21198f7b6f4c3296d02fba1d79045f: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:23.526721 474 log.cc:824] T 00000000000000000000000000000000 P ff21198f7b6f4c3296d02fba1d79045f: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:23.528146 25700 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:53:23.530210 474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff21198f7b6f4c3296d02fba1d79045f: No bootstrap required, opened a new log
I20260811 18:53:23.538734 474 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff21198f7b6f4c3296d02fba1d79045f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff21198f7b6f4c3296d02fba1d79045f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 35745 } }
I20260811 18:53:23.539170 474 raft_consensus.cc:374] T 00000000000000000000000000000000 P ff21198f7b6f4c3296d02fba1d79045f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:23.539350 474 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff21198f7b6f4c3296d02fba1d79045f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff21198f7b6f4c3296d02fba1d79045f, State: Initialized, Role: FOLLOWER
I20260811 18:53:23.540098 474 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff21198f7b6f4c3296d02fba1d79045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff21198f7b6f4c3296d02fba1d79045f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 35745 } }
I20260811 18:53:23.540446 474 raft_consensus.cc:388] T 00000000000000000000000000000000 P ff21198f7b6f4c3296d02fba1d79045f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:23.540593 474 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff21198f7b6f4c3296d02fba1d79045f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:23.540771 474 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff21198f7b6f4c3296d02fba1d79045f [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:23.543602 474 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff21198f7b6f4c3296d02fba1d79045f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff21198f7b6f4c3296d02fba1d79045f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 35745 } }
I20260811 18:53:23.544340 474 leader_election.cc:302] T 00000000000000000000000000000000 P ff21198f7b6f4c3296d02fba1d79045f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff21198f7b6f4c3296d02fba1d79045f; no voters:
I20260811 18:53:23.545034 474 leader_election.cc:288] T 00000000000000000000000000000000 P ff21198f7b6f4c3296d02fba1d79045f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:23.545212 492 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff21198f7b6f4c3296d02fba1d79045f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:23.546725 492 raft_consensus.cc:686] T 00000000000000000000000000000000 P ff21198f7b6f4c3296d02fba1d79045f [term 1 LEADER]: Becoming Leader. State: Replica: ff21198f7b6f4c3296d02fba1d79045f, State: Running, Role: LEADER
I20260811 18:53:23.547073 477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.533638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51769 (local address 127.25.25.62:35745)
0811 18:53:23.533860 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:23.533867 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:23.539887 (+ 6020us) server_negotiation.cc:407] Connection header received
0811 18:53:23.540050 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:23.540056 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:23.540174 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:23.540298 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:23.541104 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.542184 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.543624 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.544310 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.544445 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.545845 (+ 1400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:23.545865 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:23.545871 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:23.545899 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:23.545959 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:23.545984 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:23.546557 (+ 573us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:23.546613 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 18:53:23.546721 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 18:53:23.547441 492 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff21198f7b6f4c3296d02fba1d79045f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff21198f7b6f4c3296d02fba1d79045f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 35745 } }
I20260811 18:53:23.547926 474 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff21198f7b6f4c3296d02fba1d79045f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:23.550756 495 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff21198f7b6f4c3296d02fba1d79045f [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff21198f7b6f4c3296d02fba1d79045f. Latest consensus state: current_term: 1 leader_uuid: "ff21198f7b6f4c3296d02fba1d79045f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff21198f7b6f4c3296d02fba1d79045f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 35745 } } }
I20260811 18:53:23.551213 495 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff21198f7b6f4c3296d02fba1d79045f [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:23.551743 493 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff21198f7b6f4c3296d02fba1d79045f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff21198f7b6f4c3296d02fba1d79045f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff21198f7b6f4c3296d02fba1d79045f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 35745 } } }
I20260811 18:53:23.552048 493 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff21198f7b6f4c3296d02fba1d79045f [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:23.553725 504 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:23.559077 504 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:23.564369 518 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 18:53:23.569121 504 catalog_manager.cc:1347] Generated new cluster ID: cf7a8caf2204400085f2b45f96415e0e
I20260811 18:53:23.569305 504 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:23.586292 504 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:23.588047 504 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:23.606137 504 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ff21198f7b6f4c3296d02fba1d79045f: Generated new TSK 0
I20260811 18:53:23.607124 504 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:53:23.619045 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 348
W20260811 18:53:23.620615 466 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:39049
W20260811 18:53:23.621495 25700 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 348: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:53:23.621649 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 348
2026-08-11T18:53:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2274 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:53:23 dist-test-slave-lgr5 krb5kdc[528](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:53:23 dist-test-slave-lgr5 krb5kdc[528](info): set up 2 sockets
Aug 11 18:53:23 dist-test-slave-lgr5 krb5kdc[528](info): commencing operation
krb5kdc: starting...
W20260811 18:53:24.934214 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.265s user 0.004s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:53:25 dist-test-slave-lgr5 krb5kdc[528](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474405, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:53:25.297271 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:41035
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:39749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:41035
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:25.661890 549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:25.662228 549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:25.662387 549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:25.670420 549 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:25.670557 549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:25.670619 549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:25.670703 549 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:25.670758 549 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:25.681283 549 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:39749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:41035
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:41035
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:25.682762 549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:25.684304 549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:25.697988 554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:25.698016 560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:25.698238 556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:25.698848 549 server_base.cc:1034] running on GCE node
I20260811 18:53:25.699724 549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:25.701529 549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:25.702785 549 hybrid_clock.cc:648] HybridClock initialized: now 1786474405702716 us; error 60 us; skew 500 ppm
I20260811 18:53:25.703208 549 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:25 dist-test-slave-lgr5 krb5kdc[528](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474405, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:25.722733 549 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:53:25.724769 549 webserver.cc:460] Webserver started at http://127.25.25.62:36705/ using document root <none> and password file <none>
I20260811 18:53:25.725589 549 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:25.725737 549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:25.726238 549 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:25.729969 549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "9b66243de36b47289af4b9f3f23b483c"
format_stamp: "Formatted at 2026-08-11 18:53:25 on dist-test-slave-lgr5"
server_key: "dd52b0cfc3317a73f11fd7ce31b7283b"
server_key_iv: "7acc9cbe43a7d319fdbea333b2789e6f"
server_key_version: "encryptionkey@0"
I20260811 18:53:25.730870 549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "9b66243de36b47289af4b9f3f23b483c"
format_stamp: "Formatted at 2026-08-11 18:53:25 on dist-test-slave-lgr5"
server_key: "dd52b0cfc3317a73f11fd7ce31b7283b"
server_key_iv: "7acc9cbe43a7d319fdbea333b2789e6f"
server_key_version: "encryptionkey@0"
I20260811 18:53:25.737108 549 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 18:53:25.740922 569 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:25.742552 549 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:53:25.742748 549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "9b66243de36b47289af4b9f3f23b483c"
format_stamp: "Formatted at 2026-08-11 18:53:25 on dist-test-slave-lgr5"
server_key: "dd52b0cfc3317a73f11fd7ce31b7283b"
server_key_iv: "7acc9cbe43a7d319fdbea333b2789e6f"
server_key_version: "encryptionkey@0"
I20260811 18:53:25.742982 549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:25.749393 549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:25.754467 549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:25.754786 549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:25.775089 549 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:41035
I20260811 18:53:25.775123 653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:41035 every 8 connection(s)
I20260811 18:53:25.776657 549 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:25.780997 654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:25.783411 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 549
I20260811 18:53:25.783632 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:53:25.784221 25700 external_mini_cluster.cc:1428] Setting key f7789ae5e91b5059db35fde41b9d0211
I20260811 18:53:25.795176 658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:25.786691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51069 (local address 127.25.25.62:41035)
0811 18:53:25.787812 (+ 1121us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:25.787843 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:25.788329 (+ 486us) server_negotiation.cc:407] Connection header received
0811 18:53:25.790792 (+ 2463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:25.790838 (+ 46us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:25.791384 (+ 546us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:25.791918 (+ 534us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:25.793023 (+ 1105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:25.793033 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:25.793052 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:25.793072 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:25.793151 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:25.793189 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:25.793433 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:25.793563 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 18:53:25.793776 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":797,"thread_start_us":475,"threads_started":1}
I20260811 18:53:25.795750 654 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b66243de36b47289af4b9f3f23b483c: Bootstrap starting.
I20260811 18:53:25.799621 25700 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:53:25.799729 654 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b66243de36b47289af4b9f3f23b483c: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:25.800889 654 log.cc:824] T 00000000000000000000000000000000 P 9b66243de36b47289af4b9f3f23b483c: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:25.804692 654 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b66243de36b47289af4b9f3f23b483c: No bootstrap required, opened a new log
I20260811 18:53:25.807102 658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:25.804392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57027 (local address 127.25.25.62:41035)
0811 18:53:25.804586 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:25.804592 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:25.805064 (+ 472us) server_negotiation.cc:407] Connection header received
0811 18:53:25.805258 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:25.805262 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:25.805326 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:25.805453 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:25.806430 (+ 977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:25.806435 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:25.806438 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:25.806458 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:25.806507 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:25.806524 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:25.806648 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:25.806759 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 18:53:25.806830 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 18:53:25.812919 654 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9b66243de36b47289af4b9f3f23b483c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b66243de36b47289af4b9f3f23b483c" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41035 } }
I20260811 18:53:25.813360 654 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9b66243de36b47289af4b9f3f23b483c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:25.813445 654 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9b66243de36b47289af4b9f3f23b483c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b66243de36b47289af4b9f3f23b483c, State: Initialized, Role: FOLLOWER
I20260811 18:53:25.814013 654 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b66243de36b47289af4b9f3f23b483c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b66243de36b47289af4b9f3f23b483c" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41035 } }
I20260811 18:53:25.814265 654 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9b66243de36b47289af4b9f3f23b483c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:25.814414 654 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9b66243de36b47289af4b9f3f23b483c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:25.814600 654 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9b66243de36b47289af4b9f3f23b483c [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:25.817206 654 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9b66243de36b47289af4b9f3f23b483c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b66243de36b47289af4b9f3f23b483c" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41035 } }
I20260811 18:53:25.817773 654 leader_election.cc:302] T 00000000000000000000000000000000 P 9b66243de36b47289af4b9f3f23b483c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9b66243de36b47289af4b9f3f23b483c; no voters:
I20260811 18:53:25.818488 654 leader_election.cc:288] T 00000000000000000000000000000000 P 9b66243de36b47289af4b9f3f23b483c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:25.818645 668 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9b66243de36b47289af4b9f3f23b483c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:25.819703 668 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9b66243de36b47289af4b9f3f23b483c [term 1 LEADER]: Becoming Leader. State: Replica: 9b66243de36b47289af4b9f3f23b483c, State: Running, Role: LEADER
I20260811 18:53:25.820429 668 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9b66243de36b47289af4b9f3f23b483c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b66243de36b47289af4b9f3f23b483c" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41035 } }
I20260811 18:53:25.821002 654 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9b66243de36b47289af4b9f3f23b483c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:25.823410 670 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b66243de36b47289af4b9f3f23b483c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b66243de36b47289af4b9f3f23b483c. Latest consensus state: current_term: 1 leader_uuid: "9b66243de36b47289af4b9f3f23b483c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b66243de36b47289af4b9f3f23b483c" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41035 } } }
I20260811 18:53:25.823858 670 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b66243de36b47289af4b9f3f23b483c [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:25.824476 669 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b66243de36b47289af4b9f3f23b483c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9b66243de36b47289af4b9f3f23b483c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b66243de36b47289af4b9f3f23b483c" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 41035 } } }
I20260811 18:53:25.824774 669 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b66243de36b47289af4b9f3f23b483c [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:25.826771 676 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:25.832422 676 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:25.842609 676 catalog_manager.cc:1347] Generated new cluster ID: 6fcaaf72119041819d1ca38b19c41148
I20260811 18:53:25.842748 676 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:25.879483 676 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:25.879935 676 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:25.891580 676 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9b66243de36b47289af4b9f3f23b483c: Generated new TSK 0
I20260811 18:53:25.892807 676 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:53:25.903148 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 549
W20260811 18:53:25.904577 646 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:51069
W20260811 18:53:25.905567 25700 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 549: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:53:25.905786 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 549
2026-08-11T18:53:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2284 ms)
[----------] 18 tests from AuthTokenIssuingTest (42632 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:53:26 dist-test-slave-lgr5 krb5kdc[704](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:53:26 dist-test-slave-lgr5 krb5kdc[704](info): set up 2 sockets
Aug 11 18:53:26 dist-test-slave-lgr5 krb5kdc[704](info): commencing operation
krb5kdc: starting...
W20260811 18:53:27.228379 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.273s user 0.004s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:53:27 dist-test-slave-lgr5 krb5kdc[704](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474407, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:53:27.592428 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:45069
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:39627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:45069,127.25.25.61:37193,127.25.25.60:33239
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:27.967420 732 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 18:53:27.967792 732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:27.967911 732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:27.968040 732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:27.978315 732 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:27.978451 732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:27.978547 732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:27.978626 732 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:27.978718 732 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:27.990087 732 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:39627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:45069,127.25.25.61:37193,127.25.25.60:33239
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:45069
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:27.991475 732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:27.993299 732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:28.006315 746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:28.006371 740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:28.006373 741 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:28.007195 732 server_base.cc:1034] running on GCE node
I20260811 18:53:28.008155 732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:28.009807 732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:28.011096 732 hybrid_clock.cc:648] HybridClock initialized: now 1786474408011014 us; error 44 us; skew 500 ppm
I20260811 18:53:28.011535 732 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:28 dist-test-slave-lgr5 krb5kdc[704](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474408, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:28.016042 732 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:53:28.018487 732 webserver.cc:460] Webserver started at http://127.25.25.62:41899/ using document root <none> and password file <none>
I20260811 18:53:28.019306 732 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:28.019418 732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:28.019733 732 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:28.023604 732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "7f77bbdfb8884913b27928dac8e5237f"
format_stamp: "Formatted at 2026-08-11 18:53:28 on dist-test-slave-lgr5"
server_key: "b03ba1c742ed41c051a6fa9bf5d5f020"
server_key_iv: "bb40c2b027fcfa89a045a250c0fdbf07"
server_key_version: "encryptionkey@0"
I20260811 18:53:28.024747 732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "7f77bbdfb8884913b27928dac8e5237f"
format_stamp: "Formatted at 2026-08-11 18:53:28 on dist-test-slave-lgr5"
server_key: "b03ba1c742ed41c051a6fa9bf5d5f020"
server_key_iv: "bb40c2b027fcfa89a045a250c0fdbf07"
server_key_version: "encryptionkey@0"
I20260811 18:53:28.031061 732 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.005s
I20260811 18:53:28.035357 757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:28.037151 732 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.002s
I20260811 18:53:28.037389 732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "7f77bbdfb8884913b27928dac8e5237f"
format_stamp: "Formatted at 2026-08-11 18:53:28 on dist-test-slave-lgr5"
server_key: "b03ba1c742ed41c051a6fa9bf5d5f020"
server_key_iv: "bb40c2b027fcfa89a045a250c0fdbf07"
server_key_version: "encryptionkey@0"
I20260811 18:53:28.037652 732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:28.058888 732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:28.063984 732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:28.064319 732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:28.084733 732 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:45069
I20260811 18:53:28.084766 844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:45069 every 8 connection(s)
I20260811 18:53:28.086323 732 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:28.089870 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 732
I20260811 18:53:28.090142 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:53:28.090983 847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:28.091171 25700 external_mini_cluster.cc:1428] Setting key 9a118bed68c76bea7b8cd0b1dfffda0a
I20260811 18:53:28.100932 847 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45069 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:53:28 dist-test-slave-lgr5 krb5kdc[704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474408, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:53:28.129940 851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.105622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:45069 (local address 127.0.0.1:51294)
0811 18:53:28.106747 (+ 1125us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.106806 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:28.109459 (+ 2653us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:28.110779 (+ 1320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:28.110785 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:28.111513 (+ 728us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:28.111901 (+ 388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.111924 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.114252 (+ 2328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.114256 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.115514 (+ 1258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.115531 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.116847 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.116853 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.117008 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.117722 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:28.117748 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:28.120410 (+ 2662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:28.124968 (+ 4558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:28.124981 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:28.124992 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:28.125468 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:28.126178 (+ 710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:28.126183 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:28.126185 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:28.126383 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:28.127700 (+ 1317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:28.127707 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:28.127939 (+ 232us) client_negotiation.cc:769] Sending connection context
0811 18:53:28.128203 (+ 264us) client_negotiation.cc:240] Negotiation successful
0811 18:53:28.128678 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":781,"thread_start_us":475,"threads_started":1}
I20260811 18:53:28.129997 852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.105622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51294 (local address 127.25.25.62:45069)
0811 18:53:28.107733 (+ 2111us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:28.107740 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:28.107791 (+ 51us) server_negotiation.cc:407] Connection header received
0811 18:53:28.110010 (+ 2219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:28.110020 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:28.110394 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:28.110684 (+ 290us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:28.112200 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.114019 (+ 1819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.115698 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.116603 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.116796 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.120701 (+ 3905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:28.120713 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:28.120731 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:28.120780 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:28.124718 (+ 3938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:28.125641 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:28.125653 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:28.125656 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:28.125940 (+ 284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:28.126611 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:28.126617 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:28.126620 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:28.127474 (+ 854us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:28.127722 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:28.128420 (+ 698us) server_negotiation.cc:299] Negotiation successful
0811 18:53:28.128891 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":113,"server-negotiator.queue_time_us":1894,"spinlock_wait_cycles":18304,"thread_start_us":1603,"threads_started":1}
WARNING: no policy specified for kudu/127.25.25.61@KRBTEST.COM; defaulting to no policy
I20260811 18:53:28.133615 847 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.61" port: 37193 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:53:28.135057 851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.134459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:37193 (local address 127.0.0.1:34550)
0811 18:53:28.134708 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.134871 (+ 163us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:37193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.61@KRBTEST.COM" created.
W20260811 18:53:28.135428 759 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.25.61:37193: connect: Connection refused (error 111)
I20260811 18:53:28.137395 851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.136973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:37193 (local address 127.0.0.1:34564)
0811 18:53:28.137120 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.137201 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:37193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 18:53:28.137629 847 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.61:37193: Network error: Client connection negotiation failed: client connection to 127.25.25.61:37193: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.61.keytab.
Entry for principal kudu/127.25.25.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.61.keytab.
I20260811 18:53:28.176218 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.61:37193
--webserver_interface=127.25.25.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.61.keytab
--principal=kudu/127.25.25.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:39627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:45069,127.25.25.61:37193,127.25.25.60:33239
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:53:28.187074 847 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.61" port: 37193 } attempt: 1
I20260811 18:53:28.188457 851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.187870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:37193 (local address 127.0.0.1:34574)
0811 18:53:28.188154 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.188263 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:37193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260811 18:53:28.189695 851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.189254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:37193 (local address 127.0.0.1:34576)
0811 18:53:28.189445 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.189533 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:37193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260811 18:53:28.189937 847 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.61:37193: Network error: Client connection negotiation failed: client connection to 127.25.25.61:37193: connect: Connection refused (error 111)
I20260811 18:53:28.258229 847 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.61" port: 37193 } attempt: 2
I20260811 18:53:28.259552 851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.259030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:37193 (local address 127.0.0.1:34582)
0811 18:53:28.259290 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.259394 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:37193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260811 18:53:28.260708 851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.260314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:37193 (local address 127.0.0.1:34596)
0811 18:53:28.260480 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.260554 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:37193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260811 18:53:28.260954 847 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.61:37193: Network error: Client connection negotiation failed: client connection to 127.25.25.61:37193: connect: Connection refused (error 111)
I20260811 18:53:28.352288 847 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.61" port: 37193 } attempt: 3
I20260811 18:53:28.353631 851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.353114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:37193 (local address 127.0.0.1:34608)
0811 18:53:28.353335 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.353462 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:37193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 18:53:28.354836 851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.354457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:37193 (local address 127.0.0.1:34622)
0811 18:53:28.354601 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.354680 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:37193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 18:53:28.355054 847 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.61:37193: Network error: Client connection negotiation failed: client connection to 127.25.25.61:37193: connect: Connection refused (error 111)
I20260811 18:53:28.498346 847 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.61" port: 37193 } attempt: 4
I20260811 18:53:28.499619 851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.499050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:37193 (local address 127.0.0.1:34638)
0811 18:53:28.499363 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.499475 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:37193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171}
I20260811 18:53:28.500943 851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.500510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:37193 (local address 127.0.0.1:34648)
0811 18:53:28.500700 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.500796 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:37193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20260811 18:53:28.501196 847 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.61:37193: Network error: Client connection negotiation failed: client connection to 127.25.25.61:37193: connect: Connection refused (error 111)
W20260811 18:53:28.637144 858 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 18:53:28.637571 858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:28.637710 858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:28.637842 858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:28.647011 858 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:28.647145 858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:28.647235 858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:28.647362 858 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:28.647495 858 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:28.660128 858 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:39627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:45069,127.25.25.61:37193,127.25.25.60:33239
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.61.keytab
--principal=kudu/127.25.25.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.61:37193
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.25.25.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:28.661684 858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:28.663264 858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:28.678889 874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:28.678848 878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:28.678963 875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:28.680114 858 server_base.cc:1034] running on GCE node
I20260811 18:53:28.681048 858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:28.682636 858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:28.683888 858 hybrid_clock.cc:648] HybridClock initialized: now 1786474408683817 us; error 35 us; skew 500 ppm
I20260811 18:53:28.684296 858 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:28 dist-test-slave-lgr5 krb5kdc[704](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474408, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:28.688233 858 init.cc:377] Logged in from keytab as kudu/127.25.25.61@KRBTEST.COM (short username kudu)
I20260811 18:53:28.690137 858 webserver.cc:460] Webserver started at http://127.25.25.61:34385/ using document root <none> and password file <none>
I20260811 18:53:28.690919 858 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:28.691054 858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:28.691432 858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:28.695019 858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-1/data/instance:
uuid: "3d79436eddea44efadd93d4e8ee80b3c"
format_stamp: "Formatted at 2026-08-11 18:53:28 on dist-test-slave-lgr5"
server_key: "dc02708f8d28217aa0980daf991a7e28"
server_key_iv: "c3ab5372c75485348a74422631ed6a0e"
server_key_version: "encryptionkey@0"
I20260811 18:53:28.695999 858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-1/wal/instance:
uuid: "3d79436eddea44efadd93d4e8ee80b3c"
format_stamp: "Formatted at 2026-08-11 18:53:28 on dist-test-slave-lgr5"
server_key: "dc02708f8d28217aa0980daf991a7e28"
server_key_iv: "c3ab5372c75485348a74422631ed6a0e"
server_key_version: "encryptionkey@0"
I20260811 18:53:28.702584 858 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 18:53:28.707307 889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:28.709048 858 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 18:53:28.709285 858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-1/wal
uuid: "3d79436eddea44efadd93d4e8ee80b3c"
format_stamp: "Formatted at 2026-08-11 18:53:28 on dist-test-slave-lgr5"
server_key: "dc02708f8d28217aa0980daf991a7e28"
server_key_iv: "c3ab5372c75485348a74422631ed6a0e"
server_key_version: "encryptionkey@0"
I20260811 18:53:28.709613 858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:28.731931 858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:28.738466 858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:28.738937 858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:28.768229 858 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.61:37193
I20260811 18:53:28.768261 973 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.61:37193 every 8 connection(s)
I20260811 18:53:28.769831 858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-1/data/info.pb
I20260811 18:53:28.774413 974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:28.776684 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 858
I20260811 18:53:28.776885 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-1/wal/instance
I20260811 18:53:28.777338 25700 external_mini_cluster.cc:1428] Setting key f6285aa5a7020b508ab22785b3305402
I20260811 18:53:28.782445 974 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45069 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:53:28.800472 847 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.61" port: 37193 } attempt: 5
Aug 11 18:53:28 dist-test-slave-lgr5 krb5kdc[704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474408, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.61@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:53:28.811266 984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.785562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51304 (local address 127.25.25.62:45069)
0811 18:53:28.786256 (+ 694us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:28.786264 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:28.787573 (+ 1309us) server_negotiation.cc:407] Connection header received
0811 18:53:28.790643 (+ 3070us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:28.790649 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:28.790730 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:28.790834 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:28.793346 (+ 2512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.794694 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.796914 (+ 2220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.797587 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.797745 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.802717 (+ 4972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:28.802724 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:28.802728 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:28.802774 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:28.807163 (+ 4389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:28.808200 (+ 1037us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:28.808205 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:28.808208 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:28.808362 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:28.808871 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:28.808877 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:28.808880 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:28.809326 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:28.809515 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:28.810549 (+ 1034us) server_negotiation.cc:299] Negotiation successful
0811 18:53:28.810806 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":408,"threads_started":1}
Aug 11 18:53:28 dist-test-slave-lgr5 krb5kdc[704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474408, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for kudu/127.25.25.61@KRBTEST.COM
I20260811 18:53:28.812672 985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.786241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:45069 (local address 127.0.0.1:51304)
0811 18:53:28.787344 (+ 1103us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.787409 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:28.790260 (+ 2851us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:28.791157 (+ 897us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:28.791169 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:28.792032 (+ 863us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:28.793035 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.793068 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.794973 (+ 1905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.794979 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.796696 (+ 1717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.796716 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.797900 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.797906 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.798218 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.799030 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:28.799059 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:28.802354 (+ 3295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:28.807331 (+ 4977us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:28.807342 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:28.807371 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:28.808047 (+ 676us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:28.808482 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:28.808486 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:28.808488 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:28.808738 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:28.809489 (+ 751us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:28.809497 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:28.810042 (+ 545us) client_negotiation.cc:769] Sending connection context
0811 18:53:28.810359 (+ 317us) client_negotiation.cc:240] Negotiation successful
0811 18:53:28.810968 (+ 609us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":770,"thread_start_us":484,"threads_started":1}
I20260811 18:53:28.815377 974 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.61" port: 37193 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.25.25.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.60@KRBTEST.COM" created.
I20260811 18:53:28.820883 851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.801163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:37193 (local address 127.0.0.1:34660)
0811 18:53:28.801523 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.801545 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:28.801677 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:28.803474 (+ 1797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:28.803479 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:28.804151 (+ 672us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:28.804415 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.804427 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.806233 (+ 1806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.806237 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.807429 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.807449 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.808871 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.808878 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.809207 (+ 329us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.809907 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:28.809925 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:28.812674 (+ 2749us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:28.817584 (+ 4910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:28.817591 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:28.817595 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:28.818137 (+ 542us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:28.818641 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:28.818646 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:28.818651 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:28.818818 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:28.819611 (+ 793us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:28.819616 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:28.819822 (+ 206us) client_negotiation.cc:769] Sending connection context
0811 18:53:28.820058 (+ 236us) client_negotiation.cc:240] Negotiation successful
0811 18:53:28.820443 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210}
I20260811 18:53:28.822429 993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.801496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34660 (local address 127.25.25.61:37193)
0811 18:53:28.802933 (+ 1437us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:28.802942 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:28.802975 (+ 33us) server_negotiation.cc:407] Connection header received
0811 18:53:28.803045 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:28.803051 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:28.803273 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:28.803469 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:28.804633 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.806037 (+ 1404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.807598 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.808699 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.808818 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.813147 (+ 4329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:28.813159 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:28.813172 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:28.813204 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:28.817419 (+ 4215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:28.818281 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:28.818289 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:28.818292 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:28.818514 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:28.818963 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:28.818969 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:28.818971 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:28.819447 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:28.819700 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:28.821533 (+ 1833us) server_negotiation.cc:299] Negotiation successful
0811 18:53:28.821864 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":1247,"thread_start_us":1051,"threads_started":1}
I20260811 18:53:28.825336 847 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:53:28 dist-test-slave-lgr5 krb5kdc[704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474408, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.61@KRBTEST.COM for kudu/127.25.25.61@KRBTEST.COM
I20260811 18:53:28.826647 851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.826151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:33239 (local address 127.0.0.1:50630)
0811 18:53:28.826337 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.826417 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260811 18:53:28.827602 851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.827218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:33239 (local address 127.0.0.1:50632)
0811 18:53:28.827361 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.827458 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 18:53:28.827895 847 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:33239: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
I20260811 18:53:28.833465 985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.816482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:37193 (local address 127.0.0.1:34664)
0811 18:53:28.816694 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.816713 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:28.816838 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:28.818156 (+ 1318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:28.818161 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:28.818767 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:28.819037 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.819050 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.821070 (+ 2020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.821075 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.822656 (+ 1581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.822676 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.823568 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.823579 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.823744 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.824458 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:28.824478 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:28.827204 (+ 2726us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:28.830816 (+ 3612us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:28.830821 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:28.830824 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:28.831276 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:28.831742 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:28.831746 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:28.831749 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:28.831948 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:28.832633 (+ 685us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:28.832637 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:28.832785 (+ 148us) client_negotiation.cc:769] Sending connection context
0811 18:53:28.832899 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 18:53:28.833148 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 18:53:28.833976 995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.816793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34664 (local address 127.25.25.61:37193)
0811 18:53:28.817864 (+ 1071us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:28.817869 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:28.817895 (+ 26us) server_negotiation.cc:407] Connection header received
0811 18:53:28.817946 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:28.817950 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:28.818016 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:28.818113 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:28.819216 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.820909 (+ 1693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.822809 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.823356 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.823473 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.827444 (+ 3971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:28.827450 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:28.827454 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:28.827489 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:28.830657 (+ 3168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:28.831396 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:28.831402 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:28.831405 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:28.831608 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:28.832059 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:28.832064 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:28.832066 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:28.832510 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:28.832655 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:28.833019 (+ 364us) server_negotiation.cc:299] Negotiation successful
0811 18:53:28.833301 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":75,"server-negotiator.queue_time_us":954,"thread_start_us":744,"threads_started":1}
I20260811 18:53:28.835050 974 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:53:28.836333 985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.835757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:33239 (local address 127.0.0.1:50638)
0811 18:53:28.835957 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.836143 (+ 186us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260811 18:53:28.836622 893 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
I20260811 18:53:28.838593 985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.838211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:33239 (local address 127.0.0.1:50648)
0811 18:53:28.838358 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.838470 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 18:53:28.838832 974 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:33239: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.60.keytab.
Entry for principal kudu/127.25.25.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.60.keytab.
I20260811 18:53:28.863986 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.60:33239
--webserver_interface=127.25.25.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.60.keytab
--principal=kudu/127.25.25.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:39627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:45069,127.25.25.61:37193,127.25.25.60:33239
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:53:28.879165 847 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } attempt: 1
I20260811 18:53:28.880403 851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.879827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:33239 (local address 127.0.0.1:50660)
0811 18:53:28.880044 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.880174 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260811 18:53:28.881433 851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.881072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:33239 (local address 127.0.0.1:50670)
0811 18:53:28.881230 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.881302 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 18:53:28.881676 847 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:33239: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
I20260811 18:53:28.888279 974 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } attempt: 1
I20260811 18:53:28.889518 985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.889000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:33239 (local address 127.0.0.1:50678)
0811 18:53:28.889203 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.889299 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260811 18:53:28.890661 985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.890229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:33239 (local address 127.0.0.1:50690)
0811 18:53:28.890402 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.890513 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260811 18:53:28.890893 974 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:33239: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
I20260811 18:53:28.949941 847 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } attempt: 2
I20260811 18:53:28.951550 851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.950837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:33239 (local address 127.0.0.1:50698)
0811 18:53:28.951146 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.951275 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260811 18:53:28.952744 851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.952309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:33239 (local address 127.0.0.1:50708)
0811 18:53:28.952513 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.952593 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 18:53:28.953014 847 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:33239: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
I20260811 18:53:28.959137 974 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } attempt: 2
I20260811 18:53:28.960340 985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.959801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:33239 (local address 127.0.0.1:50712)
0811 18:53:28.960016 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.960153 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260811 18:53:28.961341 985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.960977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:33239 (local address 127.0.0.1:50716)
0811 18:53:28.961123 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.961199 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 18:53:28.961597 974 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:33239: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
I20260811 18:53:29.052831 974 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } attempt: 3
I20260811 18:53:29.054193 985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:29.053643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:33239 (local address 127.0.0.1:50730)
0811 18:53:29.053872 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:29.053994 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 18:53:29.055502 985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:29.054933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:33239 (local address 127.0.0.1:50746)
0811 18:53:29.055243 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:29.055341 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203}
W20260811 18:53:29.055747 974 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:33239: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
I20260811 18:53:29.059257 847 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } attempt: 3
I20260811 18:53:29.060432 851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:29.059881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:33239 (local address 127.0.0.1:50750)
0811 18:53:29.060117 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:29.060216 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260811 18:53:29.061566 851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:29.061103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:33239 (local address 127.0.0.1:50752)
0811 18:53:29.061325 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:29.061433 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
W20260811 18:53:29.061790 847 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:33239: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
I20260811 18:53:29.199021 974 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } attempt: 4
I20260811 18:53:29.200394 985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:29.199828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:33239 (local address 127.0.0.1:50760)
0811 18:53:29.200072 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:29.200204 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260811 18:53:29.201481 985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:29.201075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:33239 (local address 127.0.0.1:50772)
0811 18:53:29.201250 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:29.201322 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 18:53:29.201712 974 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:33239: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
I20260811 18:53:29.239028 847 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } attempt: 4
I20260811 18:53:29.240347 851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:29.239800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:33239 (local address 127.0.0.1:50788)
0811 18:53:29.240016 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:29.240168 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260811 18:53:29.241437 851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:29.241034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:33239 (local address 127.0.0.1:50802)
0811 18:53:29.241188 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:29.241267 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 18:53:29.241703 847 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:33239: Network error: Client connection negotiation failed: client connection to 127.25.25.60:33239: connect: Connection refused (error 111)
W20260811 18:53:29.348712 1002 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 18:53:29.349189 1002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:29.349319 1002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:29.349454 1002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:29.358628 1002 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:29.358805 1002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:29.358942 1002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:29.359042 1002 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:29.359169 1002 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:29.371109 1002 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:39627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:45069,127.25.25.61:37193,127.25.25.60:33239
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.60.keytab
--principal=kudu/127.25.25.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.60:33239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.25.25.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:29.372653 1002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:29.374254 1002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:29.388913 1011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:29.388989 1012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:29.389106 1017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:29.390759 1002 server_base.cc:1034] running on GCE node
I20260811 18:53:29.391739 1002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:29.393486 1002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:29.394781 1002 hybrid_clock.cc:648] HybridClock initialized: now 1786474409394659 us; error 55 us; skew 500 ppm
I20260811 18:53:29.395260 1002 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:29 dist-test-slave-lgr5 krb5kdc[704](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474409, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:29.399668 1002 init.cc:377] Logged in from keytab as kudu/127.25.25.60@KRBTEST.COM (short username kudu)
I20260811 18:53:29.401708 1002 webserver.cc:460] Webserver started at http://127.25.25.60:41971/ using document root <none> and password file <none>
I20260811 18:53:29.402558 1002 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:29.402680 1002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:29.403081 1002 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:29.407284 1002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-2/data/instance:
uuid: "75d4d3b52b7743bcbc37b128f82a5bf4"
format_stamp: "Formatted at 2026-08-11 18:53:29 on dist-test-slave-lgr5"
server_key: "6fb55045cdcf867c58aac1e589c41b6a"
server_key_iv: "95943c8891cfb1e7bb8a39722e70c5a7"
server_key_version: "encryptionkey@0"
I20260811 18:53:29.408512 1002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-2/wal/instance:
uuid: "75d4d3b52b7743bcbc37b128f82a5bf4"
format_stamp: "Formatted at 2026-08-11 18:53:29 on dist-test-slave-lgr5"
server_key: "6fb55045cdcf867c58aac1e589c41b6a"
server_key_iv: "95943c8891cfb1e7bb8a39722e70c5a7"
server_key_version: "encryptionkey@0"
I20260811 18:53:29.415629 1002 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260811 18:53:29.420887 1030 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:29.422807 1002 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 18:53:29.423079 1002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-2/wal
uuid: "75d4d3b52b7743bcbc37b128f82a5bf4"
format_stamp: "Formatted at 2026-08-11 18:53:29 on dist-test-slave-lgr5"
server_key: "6fb55045cdcf867c58aac1e589c41b6a"
server_key_iv: "95943c8891cfb1e7bb8a39722e70c5a7"
server_key_version: "encryptionkey@0"
I20260811 18:53:29.423391 1002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:29.446347 1002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:29.452042 1002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:29.452431 1002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:29.481597 1002 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.60:33239
I20260811 18:53:29.481675 1131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.60:33239 every 8 connection(s)
I20260811 18:53:29.483403 1002 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-2/data/info.pb
I20260811 18:53:29.488440 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:29.493435 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 1002
I20260811 18:53:29.493659 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474012733352-25700-0/minicluster-data/master-2/wal/instance
I20260811 18:53:29.494155 25700 external_mini_cluster.cc:1428] Setting key 459f7a6fe7e5ac567280ebcfa3ee3140
I20260811 18:53:29.497520 1132 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45069 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:53:29.500970 974 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } attempt: 5
Aug 11 18:53:29 dist-test-slave-lgr5 krb5kdc[704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474407, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.60@KRBTEST.COM
I20260811 18:53:29.518959 847 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } attempt: 5
Aug 11 18:53:29 dist-test-slave-lgr5 krb5kdc[704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474408, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.61@KRBTEST.COM for kudu/127.25.25.60@KRBTEST.COM
I20260811 18:53:29.532768 1142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:29.496508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50808 (local address 127.25.25.60:33239)
0811 18:53:29.497577 (+ 1069us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:29.497592 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:29.497646 (+ 54us) server_negotiation.cc:407] Connection header received
0811 18:53:29.500176 (+ 2530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:29.500212 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:29.500763 (+ 551us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:29.501208 (+ 445us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:29.503782 (+ 2574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.506477 (+ 2695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.509097 (+ 2620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.510538 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.510746 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:29.518849 (+ 8103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:29.518866 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:29.518890 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:29.518975 (+ 85us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:29.525119 (+ 6144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:29.526315 (+ 1196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:29.526325 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:29.526336 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:29.526647 (+ 311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:29.527179 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:29.527184 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:29.527188 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:29.528168 (+ 980us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:29.528571 (+ 403us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:29.530260 (+ 1689us) server_negotiation.cc:299] Negotiation successful
0811 18:53:29.530815 (+ 555us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":820,"thread_start_us":558,"threads_started":1}
Aug 11 18:53:29 dist-test-slave-lgr5 krb5kdc[704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474408, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for kudu/127.25.25.60@KRBTEST.COM
Aug 11 18:53:29 dist-test-slave-lgr5 krb5kdc[704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474409, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.60@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:53:29.542547 851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:29.519697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:33239 (local address 127.0.0.1:50832)
0811 18:53:29.520309 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:29.520326 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:29.520430 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:29.521942 (+ 1512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:29.521948 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:29.522587 (+ 639us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:29.522971 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:29.522987 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.526555 (+ 3568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.526561 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:29.528238 (+ 1677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:29.528257 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.529607 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.529614 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:29.529896 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:29.530761 (+ 865us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:29.530791 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:29.534330 (+ 3539us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:29.539127 (+ 4797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:29.539131 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:29.539134 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:29.539694 (+ 560us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:29.540268 (+ 574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:29.540274 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:29.540282 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:29.540586 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:29.541374 (+ 788us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:29.541380 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:29.541554 (+ 174us) client_negotiation.cc:769] Sending connection context
0811 18:53:29.541688 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 18:53:29.542040 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"mutex_wait_us":22,"spinlock_wait_cycles":232704}
I20260811 18:53:29.542778 985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:29.501753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:33239 (local address 127.0.0.1:50816)
0811 18:53:29.502040 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:29.502061 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:29.502185 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:29.520232 (+ 18047us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:29.520239 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:29.520830 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:29.521113 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:29.521129 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.523852 (+ 2723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.523857 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:29.525268 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:29.525292 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.526573 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.526580 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:29.526797 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:29.527593 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:29.527618 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:29.531283 (+ 3665us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:29.537040 (+ 5757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:29.537046 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:29.537050 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:29.537703 (+ 653us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:29.540592 (+ 2889us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:29.540598 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:29.540601 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:29.540855 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:29.541620 (+ 765us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:29.541625 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:29.541812 (+ 187us) client_negotiation.cc:769] Sending connection context
0811 18:53:29.541981 (+ 169us) client_negotiation.cc:240] Negotiation successful
0811 18:53:29.542357 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112}
I20260811 18:53:29.544307 1143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:29.502372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50816 (local address 127.25.25.60:33239)
0811 18:53:29.519739 (+ 17367us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:29.519745 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:29.519782 (+ 37us) server_negotiation.cc:407] Connection header received
0811 18:53:29.519858 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:29.519863 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:29.519945 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:29.521298 (+ 1353us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:29.521927 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.523650 (+ 1723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.525490 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.526341 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.531484 (+ 5143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:29.531867 (+ 383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:29.531877 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:29.531882 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:29.531919 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:29.536809 (+ 4890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:29.540247 (+ 3438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:29.540253 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:29.540256 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:29.540458 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:29.541008 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:29.541013 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:29.541015 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:29.541373 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:29.541530 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:29.543312 (+ 1782us) server_negotiation.cc:299] Negotiation successful
0811 18:53:29.543592 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17202,"thread_start_us":16824,"threads_started":1}
I20260811 18:53:29.544395 1150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:29.520364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50832 (local address 127.25.25.60:33239)
0811 18:53:29.521387 (+ 1023us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:29.521391 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:29.521610 (+ 219us) server_negotiation.cc:407] Connection header received
0811 18:53:29.521672 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:29.521676 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:29.521762 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:29.522633 (+ 871us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:29.524553 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.526330 (+ 1777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.528489 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.529381 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.529983 (+ 602us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:29.534616 (+ 4633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:29.534625 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:29.534630 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:29.534679 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:29.538977 (+ 4298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:29.539865 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:29.539872 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:29.539876 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:29.540115 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:29.540754 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:29.540758 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:29.540761 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:29.541196 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:29.543240 (+ 2044us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:29.543390 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 18:53:29.543812 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":231,"server-negotiator.queue_time_us":853,"thread_start_us":984,"threads_started":1}
I20260811 18:53:29.547941 1148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:29.502915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:45069 (local address 127.0.0.1:51318)
0811 18:53:29.518716 (+ 15801us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:29.518797 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:29.519009 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:29.521823 (+ 2814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:29.521832 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:29.524974 (+ 3142us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:29.525654 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:29.525667 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.527458 (+ 1791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.527521 (+ 63us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:29.529682 (+ 2161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:29.529699 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.531790 (+ 2091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.531799 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:29.532056 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:29.532871 (+ 815us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:29.532894 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:29.538215 (+ 5321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:29.543573 (+ 5358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:29.543595 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:29.543604 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:29.544364 (+ 760us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:29.544891 (+ 527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:29.544896 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:29.544899 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:29.545105 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:29.546639 (+ 1534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:29.546648 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:29.546885 (+ 237us) client_negotiation.cc:769] Sending connection context
0811 18:53:29.547079 (+ 194us) client_negotiation.cc:240] Negotiation successful
0811 18:53:29.547452 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15394,"mutex_wait_us":1,"thread_start_us":15233,"threads_started":1}
I20260811 18:53:29.549695 1144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:29.502664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51318 (local address 127.25.25.62:45069)
0811 18:53:29.518106 (+ 15442us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:29.518115 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:29.520011 (+ 1896us) server_negotiation.cc:407] Connection header received
0811 18:53:29.521496 (+ 1485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:29.521502 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:29.521585 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:29.522592 (+ 1007us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:29.525861 (+ 3269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.527181 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.529906 (+ 2725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.531351 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.531474 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:29.538536 (+ 7062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:29.538545 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:29.538551 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:29.538602 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:29.543394 (+ 4792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:29.544557 (+ 1163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:29.544563 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:29.544566 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:29.544754 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:29.545930 (+ 1176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:29.545935 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:29.545938 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:29.546463 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:29.548755 (+ 2292us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:29.548921 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 18:53:29.549184 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":15234,"spinlock_wait_cycles":4864,"thread_start_us":15004,"threads_started":1}
I20260811 18:53:29.552017 847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f: Bootstrap starting.
I20260811 18:53:29.552014 974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d79436eddea44efadd93d4e8ee80b3c: Bootstrap starting.
Aug 11 18:53:29 dist-test-slave-lgr5 krb5kdc[704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474407, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:53:29.554145 1132 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.61" port: 37193 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:53:29.557363 847 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:29.558184 974 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d79436eddea44efadd93d4e8ee80b3c: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:29.559463 847 log.cc:824] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:29.560006 974 log.cc:824] T 00000000000000000000000000000000 P 3d79436eddea44efadd93d4e8ee80b3c: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:29.565184 1153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:29.537980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51320 (local address 127.25.25.62:45069)
0811 18:53:29.541237 (+ 3257us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:29.541243 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:29.541282 (+ 39us) server_negotiation.cc:407] Connection header received
0811 18:53:29.541337 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:29.541342 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:29.541445 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:29.543795 (+ 2350us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:29.544251 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.545674 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.547712 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.548591 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.552338 (+ 3747us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:29.555129 (+ 2791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:29.555136 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:29.555141 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:29.555185 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:29.559719 (+ 4534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:29.560977 (+ 1258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:29.560982 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:29.560986 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:29.561227 (+ 241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:29.561777 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:29.561782 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:29.561785 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:29.562228 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:29.563902 (+ 1674us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:29.564165 (+ 263us) server_negotiation.cc:299] Negotiation successful
0811 18:53:29.564480 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3088,"thread_start_us":5835,"threads_started":1}
Aug 11 18:53:29 dist-test-slave-lgr5 krb5kdc[704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474409, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.60@KRBTEST.COM for kudu/127.25.25.61@KRBTEST.COM
I20260811 18:53:29.572445 974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d79436eddea44efadd93d4e8ee80b3c: No bootstrap required, opened a new log
I20260811 18:53:29.572433 847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f: No bootstrap required, opened a new log
I20260811 18:53:29.578614 1148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:29.554966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:37193 (local address 127.0.0.1:34680)
0811 18:53:29.555455 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:29.555476 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:29.555586 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:29.556789 (+ 1203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:29.556794 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:29.557375 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:29.557661 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:29.557677 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.559552 (+ 1875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.559558 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:29.561107 (+ 1549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:29.561127 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.562361 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.562369 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:29.562630 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:29.563366 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:29.563393 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:29.567536 (+ 4143us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:29.574804 (+ 7268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:29.574811 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:29.574815 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:29.575565 (+ 750us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:29.576215 (+ 650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:29.576220 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:29.576223 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:29.576531 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:29.577463 (+ 932us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:29.577469 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:29.577674 (+ 205us) client_negotiation.cc:769] Sending connection context
0811 18:53:29.577825 (+ 151us) client_negotiation.cc:240] Negotiation successful
0811 18:53:29.578194 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345}
I20260811 18:53:29.580214 1154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:29.555422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34680 (local address 127.25.25.61:37193)
0811 18:53:29.556323 (+ 901us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:29.556329 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:29.556350 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:53:29.556427 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:29.556432 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:29.556537 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:29.557827 (+ 1290us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:29.558050 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.559337 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.561342 (+ 2005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.562135 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.567774 (+ 5639us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:29.568111 (+ 337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:29.568121 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:29.568126 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:29.568164 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:29.574555 (+ 6391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:29.575767 (+ 1212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:29.575772 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:29.575776 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:29.575992 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:29.576735 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:29.576740 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:29.576744 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:29.577289 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:29.579096 (+ 1807us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:29.579271 (+ 175us) server_negotiation.cc:299] Negotiation successful
0811 18:53:29.579576 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":748,"thread_start_us":504,"threads_started":1}
I20260811 18:53:29.581518 1132 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:53:29 dist-test-slave-lgr5 krb5kdc[704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474407, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.61@KRBTEST.COM
I20260811 18:53:29.586671 847 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f77bbdfb8884913b27928dac8e5237f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45069 } } peers { permanent_uuid: "3d79436eddea44efadd93d4e8ee80b3c" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 37193 } } peers { permanent_uuid: "75d4d3b52b7743bcbc37b128f82a5bf4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } }
I20260811 18:53:29.587386 847 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f77bbdfb8884913b27928dac8e5237f, State: Initialized, Role: FOLLOWER
I20260811 18:53:29.588194 847 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f77bbdfb8884913b27928dac8e5237f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45069 } } peers { permanent_uuid: "3d79436eddea44efadd93d4e8ee80b3c" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 37193 } } peers { permanent_uuid: "75d4d3b52b7743bcbc37b128f82a5bf4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } }
I20260811 18:53:29.590409 974 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d79436eddea44efadd93d4e8ee80b3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f77bbdfb8884913b27928dac8e5237f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45069 } } peers { permanent_uuid: "3d79436eddea44efadd93d4e8ee80b3c" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 37193 } } peers { permanent_uuid: "75d4d3b52b7743bcbc37b128f82a5bf4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } }
I20260811 18:53:29.591059 974 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d79436eddea44efadd93d4e8ee80b3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d79436eddea44efadd93d4e8ee80b3c, State: Initialized, Role: FOLLOWER
I20260811 18:53:29.591840 974 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d79436eddea44efadd93d4e8ee80b3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f77bbdfb8884913b27928dac8e5237f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45069 } } peers { permanent_uuid: "3d79436eddea44efadd93d4e8ee80b3c" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 37193 } } peers { permanent_uuid: "75d4d3b52b7743bcbc37b128f82a5bf4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } }
Aug 11 18:53:29 dist-test-slave-lgr5 krb5kdc[704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474409, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.60@KRBTEST.COM for kudu/127.25.25.60@KRBTEST.COM
I20260811 18:53:29.595857 1161 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f77bbdfb8884913b27928dac8e5237f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45069 } } peers { permanent_uuid: "3d79436eddea44efadd93d4e8ee80b3c" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 37193 } } peers { permanent_uuid: "75d4d3b52b7743bcbc37b128f82a5bf4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } } }
I20260811 18:53:29.597121 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:29.568209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34692 (local address 127.25.25.61:37193)
0811 18:53:29.570230 (+ 2021us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:29.570237 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:29.570275 (+ 38us) server_negotiation.cc:407] Connection header received
0811 18:53:29.570350 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:29.570355 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:29.570440 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:29.573065 (+ 2625us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:29.573541 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.575895 (+ 2354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.578170 (+ 2275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.579105 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.586556 (+ 7451us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:29.587044 (+ 488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:29.587060 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:29.587070 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:29.587123 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:29.591779 (+ 4656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:29.592977 (+ 1198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:29.592982 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:29.592985 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:29.593197 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:29.593790 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:29.593796 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:29.593799 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:29.594247 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:29.595938 (+ 1691us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:29.596099 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 18:53:29.596386 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1852,"thread_start_us":1615,"threads_started":1}
I20260811 18:53:29.599098 1161 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:53:29.598909 847 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:29.600195 1163 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d79436eddea44efadd93d4e8ee80b3c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f77bbdfb8884913b27928dac8e5237f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45069 } } peers { permanent_uuid: "3d79436eddea44efadd93d4e8ee80b3c" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 37193 } } peers { permanent_uuid: "75d4d3b52b7743bcbc37b128f82a5bf4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } } }
I20260811 18:53:29.600957 1163 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d79436eddea44efadd93d4e8ee80b3c [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:53:29.602449 1148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:29.582449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:33239 (local address 127.0.0.1:60052)
0811 18:53:29.582870 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:29.582890 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:29.583025 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:29.583906 (+ 881us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:29.583911 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:29.584732 (+ 821us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:29.585082 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:29.585100 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.586559 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.586563 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:29.588187 (+ 1624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:29.588206 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.589531 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.589537 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:29.589785 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:29.590435 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:29.590459 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:29.593654 (+ 3195us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:29.598924 (+ 5270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:29.598929 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:29.598932 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:29.599654 (+ 722us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:29.600184 (+ 530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:29.600189 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:29.600192 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:29.600369 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:29.601167 (+ 798us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:29.601171 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:29.601333 (+ 162us) client_negotiation.cc:769] Sending connection context
0811 18:53:29.601500 (+ 167us) client_negotiation.cc:240] Negotiation successful
0811 18:53:29.601986 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283}
I20260811 18:53:29.603539 1150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:29.583232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60052 (local address 127.25.25.60:33239)
0811 18:53:29.583429 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:29.583435 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:29.583453 (+ 18us) server_negotiation.cc:407] Connection header received
0811 18:53:29.583517 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:29.583522 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:29.583600 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:29.583701 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:29.585262 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.586419 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.588361 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.589129 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.589257 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:29.593879 (+ 4622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:29.593886 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:29.593890 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:29.593929 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:29.598703 (+ 4774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:29.599815 (+ 1112us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:29.599820 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:29.599823 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:29.599997 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:29.600496 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:29.600501 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:29.600504 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:29.600957 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:29.601114 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:29.602919 (+ 1805us) server_negotiation.cc:299] Negotiation successful
0811 18:53:29.603170 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 18:53:29.604669 974 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d79436eddea44efadd93d4e8ee80b3c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:29.605141 25700 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:53:29.608886 804 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "7f77bbdfb8884913b27928dac8e5237f"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51320
I20260811 18:53:29.609586 804 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 18:53:29.609889 804 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:29.611562 1132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75d4d3b52b7743bcbc37b128f82a5bf4: Bootstrap starting.
I20260811 18:53:29.614662 804 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f77bbdfb8884913b27928dac8e5237f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45069 } } peers { permanent_uuid: "3d79436eddea44efadd93d4e8ee80b3c" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 37193 } } peers { permanent_uuid: "75d4d3b52b7743bcbc37b128f82a5bf4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } }
I20260811 18:53:29.617163 1132 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 75d4d3b52b7743bcbc37b128f82a5bf4: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:29.617870 935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7f77bbdfb8884913b27928dac8e5237f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3d79436eddea44efadd93d4e8ee80b3c"
I20260811 18:53:29.618520 935 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d79436eddea44efadd93d4e8ee80b3c [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:29.619092 1132 log.cc:824] T 00000000000000000000000000000000 P 75d4d3b52b7743bcbc37b128f82a5bf4: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:29.623121 935 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3d79436eddea44efadd93d4e8ee80b3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f77bbdfb8884913b27928dac8e5237f in term 1.
I20260811 18:53:29.625038 804 leader_election.cc:288] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f [CANDIDATE]: Term 1 election: Requested vote from peers 3d79436eddea44efadd93d4e8ee80b3c (127.25.25.61:37193), 75d4d3b52b7743bcbc37b128f82a5bf4 (127.25.25.60:33239)
I20260811 18:53:29.631392 759 leader_election.cc:302] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d79436eddea44efadd93d4e8ee80b3c, 7f77bbdfb8884913b27928dac8e5237f; no voters:
I20260811 18:53:29.632171 1161 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:29.654397 1161 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f [term 1 LEADER]: Becoming Leader. State: Replica: 7f77bbdfb8884913b27928dac8e5237f, State: Running, Role: LEADER
I20260811 18:53:29.656291 1161 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f77bbdfb8884913b27928dac8e5237f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45069 } } peers { permanent_uuid: "3d79436eddea44efadd93d4e8ee80b3c" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 37193 } } peers { permanent_uuid: "75d4d3b52b7743bcbc37b128f82a5bf4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } }
I20260811 18:53:29.668026 1132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75d4d3b52b7743bcbc37b128f82a5bf4: No bootstrap required, opened a new log
I20260811 18:53:29.669694 1187 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f77bbdfb8884913b27928dac8e5237f. Latest consensus state: current_term: 1 leader_uuid: "7f77bbdfb8884913b27928dac8e5237f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f77bbdfb8884913b27928dac8e5237f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45069 } } peers { permanent_uuid: "3d79436eddea44efadd93d4e8ee80b3c" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 37193 } } peers { permanent_uuid: "75d4d3b52b7743bcbc37b128f82a5bf4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } } }
I20260811 18:53:29.670429 1187 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:29.676177 1194 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:29.688302 1132 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75d4d3b52b7743bcbc37b128f82a5bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f77bbdfb8884913b27928dac8e5237f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45069 } } peers { permanent_uuid: "3d79436eddea44efadd93d4e8ee80b3c" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 37193 } } peers { permanent_uuid: "75d4d3b52b7743bcbc37b128f82a5bf4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } }
I20260811 18:53:29.689168 1132 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75d4d3b52b7743bcbc37b128f82a5bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75d4d3b52b7743bcbc37b128f82a5bf4, State: Initialized, Role: FOLLOWER
I20260811 18:53:29.690233 1132 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75d4d3b52b7743bcbc37b128f82a5bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f77bbdfb8884913b27928dac8e5237f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45069 } } peers { permanent_uuid: "3d79436eddea44efadd93d4e8ee80b3c" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 37193 } } peers { permanent_uuid: "75d4d3b52b7743bcbc37b128f82a5bf4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } }
I20260811 18:53:29.712050 1203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75d4d3b52b7743bcbc37b128f82a5bf4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f77bbdfb8884913b27928dac8e5237f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45069 } } peers { permanent_uuid: "3d79436eddea44efadd93d4e8ee80b3c" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 37193 } } peers { permanent_uuid: "75d4d3b52b7743bcbc37b128f82a5bf4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } } }
I20260811 18:53:29.712776 1203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75d4d3b52b7743bcbc37b128f82a5bf4 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:53:29.714097 1132 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75d4d3b52b7743bcbc37b128f82a5bf4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:29.714417 1081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7f77bbdfb8884913b27928dac8e5237f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "75d4d3b52b7743bcbc37b128f82a5bf4"
I20260811 18:53:29.715019 1081 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75d4d3b52b7743bcbc37b128f82a5bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:29.719529 1081 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 75d4d3b52b7743bcbc37b128f82a5bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f77bbdfb8884913b27928dac8e5237f in term 1.
I20260811 18:53:29.739959 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:29.674565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50544 (local address 127.25.25.61:37193)
0811 18:53:29.674833 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:29.674840 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:29.689562 (+ 14722us) server_negotiation.cc:407] Connection header received
0811 18:53:29.689864 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:29.689871 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:29.690038 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:29.690121 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:29.701696 (+ 11575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.702917 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.713073 (+ 10156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.713951 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.714067 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:29.723382 (+ 9315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:29.723389 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:29.723394 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:29.723448 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:29.735166 (+ 11718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:29.736452 (+ 1286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:29.736459 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:29.736463 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:29.736676 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:29.737221 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:29.737226 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:29.737230 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:29.737690 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:29.737982 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:29.739249 (+ 1267us) server_negotiation.cc:299] Negotiation successful
0811 18:53:29.739522 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 18:53:29.727857 858 master_runner.cc:186] Error getting master registration for 127.25.25.62:45069: OK, instance_id { permanent_uuid: "7f77bbdfb8884913b27928dac8e5237f" instance_seqno: 1786474408078591 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 18:53:29.740703 858 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 18:53:29.742892 899 tablet.cc:2369] T 00000000000000000000000000000000 P 3d79436eddea44efadd93d4e8ee80b3c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:53:29.759338 1153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:29.673103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48358 (local address 127.25.25.62:45069)
0811 18:53:29.673344 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:29.673352 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:29.683810 (+ 10458us) server_negotiation.cc:407] Connection header received
0811 18:53:29.684176 (+ 366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:29.684182 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:29.684305 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:29.684399 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:29.699487 (+ 15088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.701378 (+ 1891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.705068 (+ 3690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.710096 (+ 5028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.710259 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:29.722969 (+ 12710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:29.722979 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:29.722985 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:29.723046 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:29.754433 (+ 31387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:29.755664 (+ 1231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:29.755671 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:29.755675 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:29.755874 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:29.756484 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:29.756488 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:29.756492 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:29.756994 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:29.758442 (+ 1448us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:29.758630 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 18:53:29.758898 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 18:53:29.762281 1194 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260811 18:53:29.781876 1219 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3d79436eddea44efadd93d4e8ee80b3c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:53:29.782110 1219 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:53:29.793040 1150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:29.687983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60066 (local address 127.25.25.60:33239)
0811 18:53:29.688201 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:29.688208 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:29.692481 (+ 4273us) server_negotiation.cc:407] Connection header received
0811 18:53:29.692907 (+ 426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:29.692914 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:29.693002 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:29.693081 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:29.705510 (+ 12429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.706767 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.716057 (+ 9290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.716965 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.717078 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:29.773803 (+ 56725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:29.773812 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:29.773817 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:29.773871 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:29.778249 (+ 4378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:29.779518 (+ 1269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:29.779526 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:29.779529 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:29.779765 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:29.780335 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:29.780341 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:29.780344 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:29.780774 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:29.781198 (+ 424us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:29.792206 (+ 11008us) server_negotiation.cc:299] Negotiation successful
0811 18:53:29.792560 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 18:53:29.795252 1081 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 75d4d3b52b7743bcbc37b128f82a5bf4 [term 1 FOLLOWER]: Refusing update from remote peer 7f77bbdfb8884913b27928dac8e5237f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:29.796965 935 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3d79436eddea44efadd93d4e8ee80b3c [term 1 FOLLOWER]: Refusing update from remote peer 7f77bbdfb8884913b27928dac8e5237f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:29.798827 1161 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f [LEADER]: Connected to new peer: Peer: permanent_uuid: "75d4d3b52b7743bcbc37b128f82a5bf4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:29.799845 1161 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d79436eddea44efadd93d4e8ee80b3c" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 37193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 18:53:29.818532 764 tablet.cc:2369] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:53:29.838884 1163 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d79436eddea44efadd93d4e8ee80b3c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f77bbdfb8884913b27928dac8e5237f. Latest consensus state: current_term: 1 leader_uuid: "7f77bbdfb8884913b27928dac8e5237f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f77bbdfb8884913b27928dac8e5237f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45069 } } peers { permanent_uuid: "3d79436eddea44efadd93d4e8ee80b3c" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 37193 } } peers { permanent_uuid: "75d4d3b52b7743bcbc37b128f82a5bf4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } } }
I20260811 18:53:29.839365 1163 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d79436eddea44efadd93d4e8ee80b3c [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:53:29.845000 1203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75d4d3b52b7743bcbc37b128f82a5bf4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f77bbdfb8884913b27928dac8e5237f. Latest consensus state: current_term: 1 leader_uuid: "7f77bbdfb8884913b27928dac8e5237f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f77bbdfb8884913b27928dac8e5237f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45069 } } peers { permanent_uuid: "3d79436eddea44efadd93d4e8ee80b3c" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 37193 } } peers { permanent_uuid: "75d4d3b52b7743bcbc37b128f82a5bf4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } } }
I20260811 18:53:29.845459 1203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75d4d3b52b7743bcbc37b128f82a5bf4 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:53:29.861094 1163 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d79436eddea44efadd93d4e8ee80b3c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7f77bbdfb8884913b27928dac8e5237f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f77bbdfb8884913b27928dac8e5237f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45069 } } peers { permanent_uuid: "3d79436eddea44efadd93d4e8ee80b3c" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 37193 } } peers { permanent_uuid: "75d4d3b52b7743bcbc37b128f82a5bf4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } } }
I20260811 18:53:29.861428 1163 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d79436eddea44efadd93d4e8ee80b3c [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:53:29.861703 1233 mvcc.cc:205] Tried to move back new op lower bound from 7317399182503608320 to 7317399181966299136. Current Snapshot: MvccSnapshot[applied={T|T < 7317399182503608320}]
I20260811 18:53:29.867022 1235 mvcc.cc:205] Tried to move back new op lower bound from 7317399182503608320 to 7317399181966299136. Current Snapshot: MvccSnapshot[applied={T|T < 7317399182503608320 or (T in {7317399182503608320})}]
I20260811 18:53:29.871874 1203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75d4d3b52b7743bcbc37b128f82a5bf4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7f77bbdfb8884913b27928dac8e5237f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f77bbdfb8884913b27928dac8e5237f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45069 } } peers { permanent_uuid: "3d79436eddea44efadd93d4e8ee80b3c" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 37193 } } peers { permanent_uuid: "75d4d3b52b7743bcbc37b128f82a5bf4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } } }
I20260811 18:53:29.872331 1203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75d4d3b52b7743bcbc37b128f82a5bf4 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:53:29.848582 732 master_runner.cc:186] Error getting master registration for 127.25.25.60:33239: OK, instance_id { permanent_uuid: "75d4d3b52b7743bcbc37b128f82a5bf4" instance_seqno: 1786474409473175 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 18:53:29.874830 732 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 18:53:29.878418 1194 catalog_manager.cc:1347] Generated new cluster ID: 3be1695fa37040c08a9bd68c59320d17
I20260811 18:53:29.878583 1194 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:29.884583 1187 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7f77bbdfb8884913b27928dac8e5237f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f77bbdfb8884913b27928dac8e5237f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45069 } } peers { permanent_uuid: "3d79436eddea44efadd93d4e8ee80b3c" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 37193 } } peers { permanent_uuid: "75d4d3b52b7743bcbc37b128f82a5bf4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } } }
I20260811 18:53:29.884985 1187 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:29.885335 1187 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7f77bbdfb8884913b27928dac8e5237f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f77bbdfb8884913b27928dac8e5237f" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 45069 } } peers { permanent_uuid: "3d79436eddea44efadd93d4e8ee80b3c" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 37193 } } peers { permanent_uuid: "75d4d3b52b7743bcbc37b128f82a5bf4" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 33239 } } }
I20260811 18:53:29.885659 1187 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:29.902303 1269 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 18:53:29.921274 1194 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:29.923527 1194 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:29.941808 1194 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f77bbdfb8884913b27928dac8e5237f: Generated new TSK 0
I20260811 18:53:29.943302 1194 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 18:53:30.043249 1153 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:30.039389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48360 (local address 127.25.25.62:45069)
0811 18:53:30.039606 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:30.039614 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:30.040347 (+ 733us) server_negotiation.cc:407] Connection header received
0811 18:53:30.040725 (+ 378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:30.040731 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:30.040871 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:30.040962 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:30.042724 (+ 1762us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48360: BlockingRecv error: recv got EOF from 127.0.0.1:48360 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260811 18:53:30.046819 1160 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:30.040157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50546 (local address 127.25.25.61:37193)
0811 18:53:30.040371 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:30.040378 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:30.044743 (+ 4365us) server_negotiation.cc:407] Connection header received
0811 18:53:30.044957 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:30.044965 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:30.045070 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:30.045191 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:30.046468 (+ 1277us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50546: BlockingRecv error: recv got EOF from 127.0.0.1:50546 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
W20260811 18:53:30.047616 1150 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:30.040841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60074 (local address 127.25.25.60:33239)
0811 18:53:30.041081 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:30.041089 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:30.045504 (+ 4415us) server_negotiation.cc:407] Connection header received
0811 18:53:30.045674 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:30.045681 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:30.045774 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:30.045890 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:30.047383 (+ 1493us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60074: BlockingRecv error: recv got EOF from 127.0.0.1:60074 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260811 18:53:30.117663 1160 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:30.105059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50560 (local address 127.25.25.61:37193)
0811 18:53:30.105325 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:30.105332 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:30.115096 (+ 9764us) server_negotiation.cc:407] Connection header received
0811 18:53:30.115650 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:30.115657 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:30.115837 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:30.115932 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:30.117364 (+ 1432us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50560: BlockingRecv error: recv got EOF from 127.0.0.1:50560 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
W20260811 18:53:30.167713 1160 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:30.154454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50566 (local address 127.25.25.61:37193)
0811 18:53:30.154670 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:30.154677 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:30.165312 (+ 10635us) server_negotiation.cc:407] Connection header received
0811 18:53:30.165921 (+ 609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:30.165927 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:30.166039 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:30.166125 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:30.167367 (+ 1242us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50566: BlockingRecv error: recv got EOF from 127.0.0.1:50566 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
W20260811 18:53:30.217569 1160 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:30.207794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50568 (local address 127.25.25.61:37193)
0811 18:53:30.208018 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:30.208025 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:30.213845 (+ 5820us) server_negotiation.cc:407] Connection header received
0811 18:53:30.214121 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:30.214128 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:30.214235 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:30.214345 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:30.217239 (+ 2894us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50568: BlockingRecv error: recv got EOF from 127.0.0.1:50568 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
W20260811 18:53:30.278439 1160 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:30.263759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50570 (local address 127.25.25.61:37193)
0811 18:53:30.264019 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:30.264026 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:30.275732 (+ 11706us) server_negotiation.cc:407] Connection header received
0811 18:53:30.276179 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:30.276185 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:30.276298 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:30.276414 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:30.278004 (+ 1590us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50570: BlockingRecv error: recv got EOF from 127.0.0.1:50570 (error 108)
Metrics: {"server-negotiator.queue_time_us":109}
W20260811 18:53:30.330888 1160 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:30.316925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50578 (local address 127.25.25.61:37193)
0811 18:53:30.317157 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:30.317164 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:30.328398 (+ 11234us) server_negotiation.cc:407] Connection header received
0811 18:53:30.328957 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:30.328964 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:30.329125 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:30.329216 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:30.330609 (+ 1393us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50578: BlockingRecv error: recv got EOF from 127.0.0.1:50578 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
W20260811 18:53:30.399580 1160 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:30.384507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50594 (local address 127.25.25.61:37193)
0811 18:53:30.384746 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:30.384752 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:30.396963 (+ 12211us) server_negotiation.cc:407] Connection header received
0811 18:53:30.397623 (+ 660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:30.397634 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:30.397750 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:30.397844 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:30.399179 (+ 1335us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50594: BlockingRecv error: recv got EOF from 127.0.0.1:50594 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260811 18:53:30.446548 1160 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:30.443306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50606 (local address 127.25.25.61:37193)
0811 18:53:30.443534 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:30.443541 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:30.444679 (+ 1138us) server_negotiation.cc:407] Connection header received
0811 18:53:30.444948 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:30.444954 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:30.445061 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:30.445180 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:30.446259 (+ 1079us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50606: BlockingRecv error: recv got EOF from 127.0.0.1:50606 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260811 18:53:30.518829 1160 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:30.515534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50614 (local address 127.25.25.61:37193)
0811 18:53:30.515764 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:30.515772 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:30.516969 (+ 1197us) server_negotiation.cc:407] Connection header received
0811 18:53:30.517234 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:30.517241 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:30.517380 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:30.517495 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:30.518518 (+ 1023us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50614: BlockingRecv error: recv got EOF from 127.0.0.1:50614 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260811 18:53:30.653965 1160 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:30.651946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50620 (local address 127.25.25.61:37193)
0811 18:53:30.652185 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:30.652190 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:30.652578 (+ 388us) server_negotiation.cc:407] Connection header received
0811 18:53:30.652737 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:30.652741 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:30.652830 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:30.652936 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:30.653732 (+ 796us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50620: BlockingRecv error: recv got EOF from 127.0.0.1:50620 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 18:53:30.784579 1219 catalog_manager.cc:1259] Loaded cluster ID: 3be1695fa37040c08a9bd68c59320d17
I20260811 18:53:30.784723 1219 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3d79436eddea44efadd93d4e8ee80b3c: loading cluster ID for follower catalog manager: success
I20260811 18:53:30.787778 1219 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3d79436eddea44efadd93d4e8ee80b3c: acquiring CA information for follower catalog manager: success
I20260811 18:53:30.790143 1219 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3d79436eddea44efadd93d4e8ee80b3c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 18:53:30.907886 1269 catalog_manager.cc:1259] Loaded cluster ID: 3be1695fa37040c08a9bd68c59320d17
I20260811 18:53:30.908138 1269 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 75d4d3b52b7743bcbc37b128f82a5bf4: loading cluster ID for follower catalog manager: success
I20260811 18:53:30.912519 1269 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 75d4d3b52b7743bcbc37b128f82a5bf4: acquiring CA information for follower catalog manager: success
I20260811 18:53:30.917465 1269 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 75d4d3b52b7743bcbc37b128f82a5bf4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 18:53:30.923544 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:30.916789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50622 (local address 127.25.25.61:37193)
0811 18:53:30.917009 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:30.917015 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:30.917237 (+ 222us) server_negotiation.cc:407] Connection header received
0811 18:53:30.917493 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:30.917498 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:30.917652 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:30.917770 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:30.918387 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:30.919526 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:30.921096 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:30.921605 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:30.921722 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:30.922294 (+ 572us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:30.922847 (+ 553us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:30.922996 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:30.923100 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 18:53:30.923218 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 18:53:30.954898 1382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:30.945910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60090 (local address 127.25.25.60:33239)
0811 18:53:30.946599 (+ 689us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:30.946606 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:30.947219 (+ 613us) server_negotiation.cc:407] Connection header received
0811 18:53:30.947472 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:30.947476 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:30.947640 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:30.947862 (+ 222us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:30.948541 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:30.949622 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:30.951938 (+ 2316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:30.952617 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:30.952738 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:30.953502 (+ 764us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:30.954140 (+ 638us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:30.954258 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:30.954423 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 18:53:30.954507 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":550,"thread_start_us":312,"threads_started":1}
I20260811 18:53:30.984485 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:30.963851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50636 (local address 127.25.25.61:37193)
0811 18:53:30.964122 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:30.964129 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:30.976604 (+ 12475us) server_negotiation.cc:407] Connection header received
0811 18:53:30.976928 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:30.976933 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:30.977007 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:30.977081 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:30.977940 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:30.979084 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:30.981060 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:30.981766 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:30.981899 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:30.983278 (+ 1379us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:30.983440 (+ 162us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:30.983508 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:30.984044 (+ 536us) server_negotiation.cc:299] Negotiation successful
0811 18:53:30.984182 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 18:53:30.984848 1382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:30.975617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60106 (local address 127.25.25.60:33239)
0811 18:53:30.975798 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:30.975805 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:30.977343 (+ 1538us) server_negotiation.cc:407] Connection header received
0811 18:53:30.977636 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:30.977642 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:30.977731 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:30.977797 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:30.978682 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:30.979963 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:30.982517 (+ 2554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:30.983143 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:30.983281 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:30.983888 (+ 607us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:30.984036 (+ 148us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:30.984194 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:30.984366 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 18:53:30.984468 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 18:53:30.987208 1399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:30.963499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48376 (local address 127.25.25.62:45069)
0811 18:53:30.974209 (+ 10710us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:30.974219 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:30.975157 (+ 938us) server_negotiation.cc:407] Connection header received
0811 18:53:30.976054 (+ 897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:30.976062 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:30.976366 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:30.976598 (+ 232us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:30.977294 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:30.978612 (+ 1318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:30.982680 (+ 4068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:30.983437 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:30.983566 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:30.984421 (+ 855us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:30.985966 (+ 1545us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:30.986073 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:30.986854 (+ 781us) server_negotiation.cc:299] Negotiation successful
0811 18:53:30.986942 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10495,"thread_start_us":10736,"threads_started":1}
I20260811 18:53:30.998754 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 732
I20260811 18:53:31.000335 838 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:53:31.120733 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 732
I20260811 18:53:31.153970 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 858
I20260811 18:53:31.155151 966 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:53:31.267427 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 858
I20260811 18:53:31.301589 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 1002
I20260811 18:53:31.302991 1124 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:53:31.423602 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 1002
2026-08-11T18:53:31Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5520 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:53:31 dist-test-slave-lgr5 krb5kdc[1412](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:53:31 dist-test-slave-lgr5 krb5kdc[1412](info): set up 2 sockets
Aug 11 18:53:31 dist-test-slave-lgr5 krb5kdc[1412](info): commencing operation
krb5kdc: starting...
W20260811 18:53:32.760504 25700 mini_kdc.cc:121] Time spent starting KDC: real 1.285s user 0.006s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/krb5kdc/test-user.keytab.
Aug 11 18:53:32 dist-test-slave-lgr5 krb5kdc[1412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474412, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.25.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
Entry for principal kudu/127.25.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab.
I20260811 18:53:33.136528 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:40143
--webserver_interface=127.25.25.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:36285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:40143,127.25.25.61:46357,127.25.25.60:40447
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:33.510804 1429 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 18:53:33.511229 1429 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:33.511349 1429 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:33.511448 1429 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:33.519419 1429 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:33.519555 1429 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:33.519618 1429 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:33.519675 1429 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:33.519737 1429 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:33.530282 1429 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:36285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:40143,127.25.25.61:46357,127.25.25.60:40447
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.62.keytab
--principal=kudu/127.25.25.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.62:40143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.25.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:33.531718 1429 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:33.533205 1429 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:33.546123 1447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:33.546247 1441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:33.546233 1443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:33.547217 1429 server_base.cc:1034] running on GCE node
I20260811 18:53:33.548347 1429 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:33.550048 1429 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:33.551342 1429 hybrid_clock.cc:648] HybridClock initialized: now 1786474413551260 us; error 48 us; skew 500 ppm
I20260811 18:53:33.551748 1429 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:33 dist-test-slave-lgr5 krb5kdc[1412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474413, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:33.555218 1429 init.cc:377] Logged in from keytab as kudu/127.25.25.62@KRBTEST.COM (short username kudu)
I20260811 18:53:33.556878 1429 webserver.cc:460] Webserver started at http://127.25.25.62:36267/ using document root <none> and password file <none>
I20260811 18:53:33.557631 1429 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:33.557737 1429 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:33.558050 1429 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:33.561539 1429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-0/data/instance:
uuid: "45853ffb8e8f41d88f6cd46e37cdc797"
format_stamp: "Formatted at 2026-08-11 18:53:33 on dist-test-slave-lgr5"
server_key: "6465c764a364a01c6457ca6b8ae9f3aa"
server_key_iv: "623f15bc533f5b2a1ddcc0f61588ed67"
server_key_version: "encryptionkey@0"
I20260811 18:53:33.562561 1429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-0/wal/instance:
uuid: "45853ffb8e8f41d88f6cd46e37cdc797"
format_stamp: "Formatted at 2026-08-11 18:53:33 on dist-test-slave-lgr5"
server_key: "6465c764a364a01c6457ca6b8ae9f3aa"
server_key_iv: "623f15bc533f5b2a1ddcc0f61588ed67"
server_key_version: "encryptionkey@0"
I20260811 18:53:33.568893 1429 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 18:53:33.573348 1456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:33.575484 1429 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 18:53:33.575709 1429 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-0/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-0/wal
uuid: "45853ffb8e8f41d88f6cd46e37cdc797"
format_stamp: "Formatted at 2026-08-11 18:53:33 on dist-test-slave-lgr5"
server_key: "6465c764a364a01c6457ca6b8ae9f3aa"
server_key_iv: "623f15bc533f5b2a1ddcc0f61588ed67"
server_key_version: "encryptionkey@0"
I20260811 18:53:33.575982 1429 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:33.598307 1429 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:33.603770 1429 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:33.604066 1429 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:33.625836 1429 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.62:40143
I20260811 18:53:33.625859 1554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.62:40143 every 8 connection(s)
I20260811 18:53:33.627519 1429 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:33.632447 1559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:33.634301 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 1429
I20260811 18:53:33.634491 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-0/wal/instance
I20260811 18:53:33.634975 25700 external_mini_cluster.cc:1428] Setting key 4e4fed4e894e8a364e7de041a0c3d980
I20260811 18:53:33.640398 1559 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40143 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:53:33 dist-test-slave-lgr5 krb5kdc[1412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474413, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:53:33.665922 1564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:33.644393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40143 (local address 127.0.0.1:33646)
0811 18:53:33.645720 (+ 1327us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:33.645772 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:33.647742 (+ 1970us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:33.648785 (+ 1043us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:33.648792 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:33.649591 (+ 799us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:33.649970 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:33.649989 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:33.652225 (+ 2236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:33.652231 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:33.653350 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:33.653364 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:33.654345 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:33.654352 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:33.654571 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:33.655222 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:33.655247 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:33.657579 (+ 2332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:33.660912 (+ 3333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:33.660925 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:33.660939 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:33.661395 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:33.661838 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:33.661843 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:33.661847 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:33.662026 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:33.662879 (+ 853us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:33.662887 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:33.663124 (+ 237us) client_negotiation.cc:769] Sending connection context
0811 18:53:33.663372 (+ 248us) client_negotiation.cc:240] Negotiation successful
0811 18:53:33.664062 (+ 690us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1080,"mutex_wait_us":160,"thread_start_us":855,"threads_started":1}
I20260811 18:53:33.665958 1562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:33.644393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33646 (local address 127.25.25.62:40143)
0811 18:53:33.645353 (+ 960us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:33.645373 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:33.645940 (+ 567us) server_negotiation.cc:407] Connection header received
0811 18:53:33.648227 (+ 2287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:33.648233 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:33.648535 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:33.648739 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:33.650211 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:33.652040 (+ 1829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:33.653499 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:33.654093 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:33.654289 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:33.657828 (+ 3539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:33.657836 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:33.657851 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:33.657883 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:33.660770 (+ 2887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:33.661536 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:33.661543 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:33.661545 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:33.661713 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:33.662130 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:33.662134 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:33.662136 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:33.662715 (+ 579us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:33.662912 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:33.663521 (+ 609us) server_negotiation.cc:299] Negotiation successful
0811 18:53:33.663907 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":74,"server-negotiator.queue_time_us":686,"thread_start_us":414,"threads_started":1}
WARNING: no policy specified for kudu/127.25.25.61@KRBTEST.COM; defaulting to no policy
I20260811 18:53:33.669993 1559 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.61" port: 46357 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.61@KRBTEST.COM" created.
I20260811 18:53:33.671597 1564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:33.670975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:46357 (local address 127.0.0.1:51332)
0811 18:53:33.671247 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:33.671417 (+ 170us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:46357: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
W20260811 18:53:33.671875 1458 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.25.61:46357: connect: Connection refused (error 111)
I20260811 18:53:33.673884 1564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:33.673375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:46357 (local address 127.0.0.1:51340)
0811 18:53:33.673566 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:33.673668 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:46357: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260811 18:53:33.674156 1559 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.61:46357: Network error: Client connection negotiation failed: client connection to 127.25.25.61:46357: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.61.keytab.
Entry for principal kudu/127.25.25.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.61.keytab.
I20260811 18:53:33.713740 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.61:46357
--webserver_interface=127.25.25.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.61.keytab
--principal=kudu/127.25.25.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:36285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:40143,127.25.25.61:46357,127.25.25.60:40447
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:53:33.723628 1559 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.61" port: 46357 } attempt: 1
I20260811 18:53:33.725065 1564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:33.724523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:46357 (local address 127.0.0.1:51356)
0811 18:53:33.724754 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:33.724892 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:46357: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260811 18:53:33.726154 1564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:33.725744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:46357 (local address 127.0.0.1:51362)
0811 18:53:33.725894 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:33.725982 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:46357: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 18:53:33.726389 1559 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.61:46357: Network error: Client connection negotiation failed: client connection to 127.25.25.61:46357: connect: Connection refused (error 111)
I20260811 18:53:33.794683 1559 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.61" port: 46357 } attempt: 2
I20260811 18:53:33.796113 1564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:33.795527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:46357 (local address 127.0.0.1:51374)
0811 18:53:33.795826 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:33.795935 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:46357: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260811 18:53:33.797240 1564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:33.796825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:46357 (local address 127.0.0.1:51388)
0811 18:53:33.796990 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:33.797084 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:46357: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 18:53:33.797456 1559 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.61:46357: Network error: Client connection negotiation failed: client connection to 127.25.25.61:46357: connect: Connection refused (error 111)
I20260811 18:53:33.888717 1559 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.61" port: 46357 } attempt: 3
I20260811 18:53:33.889855 1564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:33.889392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:46357 (local address 127.0.0.1:51394)
0811 18:53:33.889599 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:33.889698 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:46357: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 18:53:33.891158 1564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:33.890745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:46357 (local address 127.0.0.1:51410)
0811 18:53:33.890912 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:33.890993 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:46357: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 18:53:33.891369 1559 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.61:46357: Network error: Client connection negotiation failed: client connection to 127.25.25.61:46357: connect: Connection refused (error 111)
I20260811 18:53:34.034655 1559 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.61" port: 46357 } attempt: 4
I20260811 18:53:34.036069 1564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.035468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:46357 (local address 127.0.0.1:51414)
0811 18:53:34.035809 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.035913 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:46357: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180}
I20260811 18:53:34.037201 1564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.036802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:46357 (local address 127.0.0.1:51422)
0811 18:53:34.036964 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.037058 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.61:46357: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 18:53:34.037408 1559 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.61:46357: Network error: Client connection negotiation failed: client connection to 127.25.25.61:46357: connect: Connection refused (error 111)
W20260811 18:53:34.088287 1575 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 18:53:34.088686 1575 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:34.088783 1575 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:34.088909 1575 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:34.096726 1575 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:34.096840 1575 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:34.096899 1575 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:34.096956 1575 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:34.097018 1575 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:34.107527 1575 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:36285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:40143,127.25.25.61:46357,127.25.25.60:40447
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.61.keytab
--principal=kudu/127.25.25.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.61:46357
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.25.25.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:34.108994 1575 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:34.110435 1575 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:34.123238 1584 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:34.123279 1588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:34.123124 1585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:34.123983 1575 server_base.cc:1034] running on GCE node
I20260811 18:53:34.124895 1575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:34.126458 1575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:34.127679 1575 hybrid_clock.cc:648] HybridClock initialized: now 1786474414127599 us; error 57 us; skew 500 ppm
I20260811 18:53:34.128017 1575 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:34 dist-test-slave-lgr5 krb5kdc[1412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474414, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:34.131424 1575 init.cc:377] Logged in from keytab as kudu/127.25.25.61@KRBTEST.COM (short username kudu)
I20260811 18:53:34.133047 1575 webserver.cc:460] Webserver started at http://127.25.25.61:41845/ using document root <none> and password file <none>
I20260811 18:53:34.133776 1575 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:34.133884 1575 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:34.134219 1575 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:34.137511 1575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-1/data/instance:
uuid: "c7d6c8d9f00c468d9b56c8e3a14e7763"
format_stamp: "Formatted at 2026-08-11 18:53:34 on dist-test-slave-lgr5"
server_key: "dffff3f9219412c21519cfc2f1a6327f"
server_key_iv: "514e202a1d5ca86f17d3dc3f3f42c3a9"
server_key_version: "encryptionkey@0"
I20260811 18:53:34.138366 1575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-1/wal/instance:
uuid: "c7d6c8d9f00c468d9b56c8e3a14e7763"
format_stamp: "Formatted at 2026-08-11 18:53:34 on dist-test-slave-lgr5"
server_key: "dffff3f9219412c21519cfc2f1a6327f"
server_key_iv: "514e202a1d5ca86f17d3dc3f3f42c3a9"
server_key_version: "encryptionkey@0"
I20260811 18:53:34.143889 1575 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 18:53:34.147563 1603 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:34.148932 1575 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:53:34.149102 1575 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-1/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-1/wal
uuid: "c7d6c8d9f00c468d9b56c8e3a14e7763"
format_stamp: "Formatted at 2026-08-11 18:53:34 on dist-test-slave-lgr5"
server_key: "dffff3f9219412c21519cfc2f1a6327f"
server_key_iv: "514e202a1d5ca86f17d3dc3f3f42c3a9"
server_key_version: "encryptionkey@0"
I20260811 18:53:34.149312 1575 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:34.161613 1575 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:34.166075 1575 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:34.166366 1575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:34.185685 1575 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.61:46357
I20260811 18:53:34.185719 1708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.61:46357 every 8 connection(s)
I20260811 18:53:34.187389 1575 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-1/data/info.pb
I20260811 18:53:34.191187 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 1575
I20260811 18:53:34.191402 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-1/wal/instance
I20260811 18:53:34.191679 1709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:34.191939 25700 external_mini_cluster.cc:1428] Setting key f5d5d9d30bbe38e83f33e5e8db8c1855
I20260811 18:53:34.199397 1709 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40143 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:53:34 dist-test-slave-lgr5 krb5kdc[1412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474414, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.61@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:53:34.222934 1711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.202547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33652 (local address 127.25.25.62:40143)
0811 18:53:34.203136 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:34.203142 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:34.204611 (+ 1469us) server_negotiation.cc:407] Connection header received
0811 18:53:34.206777 (+ 2166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:34.206783 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:34.206878 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:34.206986 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:34.208810 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.209580 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.211177 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.211607 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.211730 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.215952 (+ 4222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:34.215959 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:34.215962 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:34.216006 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:34.218830 (+ 2824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.219941 (+ 1111us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.219944 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.219947 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.220074 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.220681 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.220684 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.220686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.220987 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:34.221103 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:34.222306 (+ 1203us) server_negotiation.cc:299] Negotiation successful
0811 18:53:34.222543 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":346,"threads_started":1}
I20260811 18:53:34.224032 1714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.203404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40143 (local address 127.0.0.1:33652)
0811 18:53:34.204412 (+ 1008us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.204473 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:34.206410 (+ 1937us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:34.207294 (+ 884us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:34.207304 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:34.207894 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:34.208577 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:34.208596 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.209748 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.209752 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:34.211015 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:34.211031 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.211863 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.211872 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:34.212176 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.212876 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:34.212907 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:34.215592 (+ 2685us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:34.219047 (+ 3455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:34.219063 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:34.219088 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:34.219808 (+ 720us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:34.220229 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:34.220235 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:34.220239 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:34.220566 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:34.221129 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:34.221139 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:34.221823 (+ 684us) client_negotiation.cc:769] Sending connection context
0811 18:53:34.222204 (+ 381us) client_negotiation.cc:240] Negotiation successful
0811 18:53:34.222769 (+ 565us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":724,"thread_start_us":440,"threads_started":1}
WARNING: no policy specified for kudu/127.25.25.60@KRBTEST.COM; defaulting to no policy
I20260811 18:53:34.226176 1709 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.61" port: 46357 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.25.60@KRBTEST.COM" created.
Aug 11 18:53:34 dist-test-slave-lgr5 krb5kdc[1412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474414, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.61@KRBTEST.COM for kudu/127.25.25.61@KRBTEST.COM
I20260811 18:53:34.243667 1714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.227193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:46357 (local address 127.0.0.1:51436)
0811 18:53:34.227504 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.227538 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:34.227711 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:34.228985 (+ 1274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:34.228988 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:34.229527 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:34.229685 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:34.229695 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.231358 (+ 1663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.231364 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:34.232651 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:34.232670 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.233828 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.233845 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:34.234091 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.234748 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:34.234770 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:34.237231 (+ 2461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:34.241181 (+ 3950us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:34.241186 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:34.241189 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:34.241577 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:34.242052 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:34.242056 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:34.242058 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:34.242182 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:34.242905 (+ 723us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:34.242909 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:34.243058 (+ 149us) client_negotiation.cc:769] Sending connection context
0811 18:53:34.243165 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 18:53:34.243389 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107}
I20260811 18:53:34.244050 1718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.227555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51436 (local address 127.25.25.61:46357)
0811 18:53:34.228441 (+ 886us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:34.228448 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:34.228499 (+ 51us) server_negotiation.cc:407] Connection header received
0811 18:53:34.228578 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:34.228585 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:34.228802 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:34.228947 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:34.229880 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.231191 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.232834 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.233635 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.233744 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.237502 (+ 3758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:34.237522 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:34.237543 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:34.237586 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:34.241004 (+ 3418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.241727 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.241739 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.241742 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.241936 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.242282 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.242287 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.242290 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.242773 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:34.243001 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:34.243368 (+ 367us) server_negotiation.cc:299] Negotiation successful
0811 18:53:34.243651 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682,"thread_start_us":529,"threads_started":1}
I20260811 18:53:34.246897 1709 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:53:34.248245 1714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.247671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:40447 (local address 127.0.0.1:53304)
0811 18:53:34.247868 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.248012 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260811 18:53:34.248579 1611 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
I20260811 18:53:34.250358 1714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.249907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:40447 (local address 127.0.0.1:53306)
0811 18:53:34.250102 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.250213 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260811 18:53:34.250577 1709 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:40447: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.25.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.60.keytab.
Entry for principal kudu/127.25.25.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.60.keytab.
I20260811 18:53:34.274063 25700 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskse5jrw/build/asan/bin/kudu
/tmp/dist-test-taskse5jrw/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.60:40447
--webserver_interface=127.25.25.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.60.keytab
--principal=kudu/127.25.25.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.25.20:36285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.25.62:40143,127.25.25.61:46357,127.25.25.60:40447
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:53:34.299970 1709 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } attempt: 1
I20260811 18:53:34.301477 1714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.300876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:40447 (local address 127.0.0.1:53314)
0811 18:53:34.301138 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.301274 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260811 18:53:34.302716 1714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.302255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:40447 (local address 127.0.0.1:53324)
0811 18:53:34.302437 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.302560 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260811 18:53:34.302981 1709 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:40447: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
I20260811 18:53:34.336709 1559 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.61" port: 46357 } attempt: 5
Aug 11 18:53:34 dist-test-slave-lgr5 krb5kdc[1412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474413, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for kudu/127.25.25.61@KRBTEST.COM
I20260811 18:53:34.351364 1564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.337520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:46357 (local address 127.0.0.1:51444)
0811 18:53:34.337728 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.337747 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:34.337899 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:34.338307 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:34.338313 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:34.338721 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:34.338920 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:34.338930 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.339947 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.339951 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:34.340931 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:34.340945 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.341733 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.341739 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:34.341963 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.342667 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:34.342687 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:34.345111 (+ 2424us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:34.348633 (+ 3522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:34.348640 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:34.348643 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:34.349096 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:34.349571 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:34.349575 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:34.349578 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:34.349733 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:34.350319 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:34.350324 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:34.350494 (+ 170us) client_negotiation.cc:769] Sending connection context
0811 18:53:34.350625 (+ 131us) client_negotiation.cc:240] Negotiation successful
0811 18:53:34.351012 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 18:53:34.351373 1718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.337758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51444 (local address 127.25.25.61:46357)
0811 18:53:34.337969 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:34.337976 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:34.337998 (+ 22us) server_negotiation.cc:407] Connection header received
0811 18:53:34.338063 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:34.338066 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:34.338148 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:34.338233 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:34.339091 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.339799 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.341097 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.341570 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.341689 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.345412 (+ 3723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:34.345419 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:34.345422 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:34.345473 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:34.348441 (+ 2968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.349245 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.349250 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.349252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.349432 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.349854 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.349858 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.349860 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.350184 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:34.350333 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:34.350758 (+ 425us) server_negotiation.cc:299] Negotiation successful
0811 18:53:34.351011 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 18:53:34.352555 1559 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:53:34.353991 1564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.353532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:40447 (local address 127.0.0.1:53330)
0811 18:53:34.353718 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.353812 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 18:53:34.355065 1564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.354684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:40447 (local address 127.0.0.1:53338)
0811 18:53:34.354833 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.354933 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 18:53:34.355275 1559 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:40447: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
I20260811 18:53:34.371248 1709 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } attempt: 2
I20260811 18:53:34.372627 1714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.372028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:40447 (local address 127.0.0.1:53354)
0811 18:53:34.372282 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.372403 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260811 18:53:34.373796 1714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.373374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:40447 (local address 127.0.0.1:53368)
0811 18:53:34.373540 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.373637 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 18:53:34.374114 1709 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:40447: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
I20260811 18:53:34.406526 1559 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } attempt: 1
I20260811 18:53:34.407725 1564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.407239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:40447 (local address 127.0.0.1:53380)
0811 18:53:34.407454 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.407546 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260811 18:53:34.408773 1564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.408435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:40447 (local address 127.0.0.1:53390)
0811 18:53:34.408587 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.408661 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 18:53:34.409044 1559 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:40447: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
I20260811 18:53:34.465405 1709 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } attempt: 3
I20260811 18:53:34.466856 1714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.466207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:40447 (local address 127.0.0.1:53402)
0811 18:53:34.466493 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.466637 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260811 18:53:34.468535 1714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.467903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:40447 (local address 127.0.0.1:53414)
0811 18:53:34.468224 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.468340 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160}
W20260811 18:53:34.468830 1709 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:40447: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
I20260811 18:53:34.477267 1559 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } attempt: 2
I20260811 18:53:34.478688 1564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.478114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:40447 (local address 127.0.0.1:53420)
0811 18:53:34.478397 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.478511 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260811 18:53:34.479810 1564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.479414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:40447 (local address 127.0.0.1:53436)
0811 18:53:34.479599 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.479679 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 18:53:34.480038 1559 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:40447: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
I20260811 18:53:34.586318 1559 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } attempt: 3
I20260811 18:53:34.587574 1564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.587077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:40447 (local address 127.0.0.1:53448)
0811 18:53:34.587290 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.587389 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260811 18:53:34.588725 1564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.588304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:40447 (local address 127.0.0.1:53458)
0811 18:53:34.588531 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.588610 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
W20260811 18:53:34.588950 1559 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:40447: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
I20260811 18:53:34.612154 1709 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } attempt: 4
I20260811 18:53:34.613476 1714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.612851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:40447 (local address 127.0.0.1:53474)
0811 18:53:34.613138 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.613256 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260811 18:53:34.614756 1714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.614298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:40447 (local address 127.0.0.1:53476)
0811 18:53:34.614508 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.614605 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260811 18:53:34.615051 1709 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.25.60:40447: Network error: Client connection negotiation failed: client connection to 127.25.25.60:40447: connect: Connection refused (error 111)
W20260811 18:53:34.658157 1723 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 18:53:34.658536 1723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:34.658641 1723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:34.658751 1723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:34.666275 1723 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:34.666383 1723 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:34.666448 1723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:34.666520 1723 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:34.666612 1723 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:34.676932 1723 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.25.20:36285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.25.25.62:40143,127.25.25.61:46357,127.25.25.60:40447
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/krb5kdc/kudu_127.25.25.60.keytab
--principal=kudu/127.25.25.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.25.60:40447
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.25.25.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:34.678375 1723 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:34.679750 1723 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:34.692435 1738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:34.692669 1732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:34.692723 1734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:34.693825 1723 server_base.cc:1034] running on GCE node
I20260811 18:53:34.694747 1723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:34.696375 1723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:34.697623 1723 hybrid_clock.cc:648] HybridClock initialized: now 1786474414697539 us; error 61 us; skew 500 ppm
I20260811 18:53:34.698009 1723 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:34 dist-test-slave-lgr5 krb5kdc[1412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474414, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:34.701401 1723 init.cc:377] Logged in from keytab as kudu/127.25.25.60@KRBTEST.COM (short username kudu)
I20260811 18:53:34.703091 1723 webserver.cc:460] Webserver started at http://127.25.25.60:37519/ using document root <none> and password file <none>
I20260811 18:53:34.703830 1723 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:34.703938 1723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:34.704288 1723 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:34.707691 1723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-2/data/instance:
uuid: "0d6f012243a84289a954a89467024579"
format_stamp: "Formatted at 2026-08-11 18:53:34 on dist-test-slave-lgr5"
server_key: "25d555249925cc5d9480933400242323"
server_key_iv: "dd39f2519744b32f6a64eaf382a59b7a"
server_key_version: "encryptionkey@0"
I20260811 18:53:34.708714 1723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-2/wal/instance:
uuid: "0d6f012243a84289a954a89467024579"
format_stamp: "Formatted at 2026-08-11 18:53:34 on dist-test-slave-lgr5"
server_key: "25d555249925cc5d9480933400242323"
server_key_iv: "dd39f2519744b32f6a64eaf382a59b7a"
server_key_version: "encryptionkey@0"
I20260811 18:53:34.714637 1723 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 18:53:34.718662 1754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:34.720253 1723 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:53:34.720443 1723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-2/data,/tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-2/wal
uuid: "0d6f012243a84289a954a89467024579"
format_stamp: "Formatted at 2026-08-11 18:53:34 on dist-test-slave-lgr5"
server_key: "25d555249925cc5d9480933400242323"
server_key_iv: "dd39f2519744b32f6a64eaf382a59b7a"
server_key_version: "encryptionkey@0"
I20260811 18:53:34.720676 1723 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:34.735972 1723 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:34.740760 1723 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:34.741065 1723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:34.760202 1723 rpc_server.cc:307] RPC server started. Bound to: 127.25.25.60:40447
I20260811 18:53:34.760227 1856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.25.60:40447 every 8 connection(s)
I20260811 18:53:34.761686 1723 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-2/data/info.pb
I20260811 18:53:34.765569 1860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:34.766150 1559 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } attempt: 4
I20260811 18:53:34.771829 25700 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskse5jrw/build/asan/bin/kudu as pid 1723
I20260811 18:53:34.772044 25700 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskse5jrw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474012733352-25700-0/minicluster-data/master-2/wal/instance
I20260811 18:53:34.772680 25700 external_mini_cluster.cc:1428] Setting key 0fff7f0eb30fe677beaab91e2a0e0909
I20260811 18:53:34.777194 1860 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40143 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:53:34 dist-test-slave-lgr5 krb5kdc[1412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474413, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.62@KRBTEST.COM for kudu/127.25.25.60@KRBTEST.COM
I20260811 18:53:34.794404 1564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.766924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:40447 (local address 127.0.0.1:53482)
0811 18:53:34.767144 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.767165 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:34.767276 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:34.771675 (+ 4399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:34.771682 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:34.772298 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:34.772499 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:34.772511 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.775157 (+ 2646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.775166 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:34.776796 (+ 1630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:34.776823 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.778828 (+ 2005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.778836 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:34.779078 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.779974 (+ 896us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:34.780006 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:34.783261 (+ 3255us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:34.790810 (+ 7549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:34.790816 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:34.790819 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:34.791389 (+ 570us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:34.791938 (+ 549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:34.791943 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:34.791947 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:34.792178 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:34.793631 (+ 1453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:34.793637 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:34.793768 (+ 131us) client_negotiation.cc:769] Sending connection context
0811 18:53:34.793881 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 18:53:34.794135 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
Aug 11 18:53:34 dist-test-slave-lgr5 krb5kdc[1412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474412, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.60@KRBTEST.COM
I20260811 18:53:34.796063 1867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.767919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53482 (local address 127.25.25.60:40447)
0811 18:53:34.768996 (+ 1077us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:34.769011 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:34.769057 (+ 46us) server_negotiation.cc:407] Connection header received
0811 18:53:34.770740 (+ 1683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:34.770768 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:34.771216 (+ 448us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:34.771674 (+ 458us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:34.772696 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.774837 (+ 2141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.777094 (+ 2257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.778570 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.783629 (+ 5059us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.784125 (+ 496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:34.784138 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:34.784165 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:34.784219 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:34.790660 (+ 6441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.791547 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.791556 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.791564 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.791817 (+ 253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.792320 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.792325 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.792328 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.793488 (+ 1160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:34.793698 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:34.794220 (+ 522us) server_negotiation.cc:299] Negotiation successful
0811 18:53:34.794735 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":843,"thread_start_us":486,"threads_started":1}
Aug 11 18:53:34 dist-test-slave-lgr5 krb5kdc[1412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474414, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.60@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:53:34.804136 1871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.781748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.62:40143 (local address 127.0.0.1:33666)
0811 18:53:34.785917 (+ 4169us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.785962 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:34.787656 (+ 1694us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:34.788179 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:34.788188 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:34.789259 (+ 1071us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:34.789561 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:34.789571 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.790671 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.790675 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:34.792227 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:34.792242 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.792998 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.793005 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:34.793167 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.794861 (+ 1694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:34.794877 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:34.797552 (+ 2675us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:34.801192 (+ 3640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:34.801205 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:34.801213 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:34.801740 (+ 527us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:34.802125 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:34.802129 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:34.802131 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:34.802297 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:34.802937 (+ 640us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:34.802945 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:34.803121 (+ 176us) client_negotiation.cc:769] Sending connection context
0811 18:53:34.803283 (+ 162us) client_negotiation.cc:240] Negotiation successful
0811 18:53:34.803639 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3866,"thread_start_us":3710,"threads_started":1}
I20260811 18:53:34.804127 1873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.782394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33666 (local address 127.25.25.62:40143)
0811 18:53:34.783149 (+ 755us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:34.783155 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:34.787288 (+ 4133us) server_negotiation.cc:407] Connection header received
0811 18:53:34.787835 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:34.787841 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:34.787929 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:34.788043 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:34.789720 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.790478 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.792357 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.792799 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.792911 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.797836 (+ 4925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:34.797844 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:34.797849 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:34.797893 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:34.801009 (+ 3116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.801870 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.801876 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.801880 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.802011 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.802416 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.802421 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.802425 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.802745 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:34.802979 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:34.803435 (+ 456us) server_negotiation.cc:299] Negotiation successful
0811 18:53:34.803661 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":379,"threads_started":1}
I20260811 18:53:34.804801 1559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797: Bootstrap starting.
I20260811 18:53:34.806413 1860 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.61" port: 46357 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:53:34.807648 1868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.773621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53496 (local address 127.25.25.60:40447)
0811 18:53:34.785409 (+ 11788us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:34.785415 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:34.785445 (+ 30us) server_negotiation.cc:407] Connection header received
0811 18:53:34.785503 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:34.785508 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:34.785600 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:34.785735 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:34.787667 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.789096 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.790954 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.791422 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.791546 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.798399 (+ 6853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:34.798408 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:34.798411 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:34.798443 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:34.802838 (+ 4395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.803810 (+ 972us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.803816 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.803819 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.803996 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.804506 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.804512 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.804515 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.804887 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:34.805186 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:34.807003 (+ 1817us) server_negotiation.cc:299] Negotiation successful
0811 18:53:34.807283 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":11491,"spinlock_wait_cycles":21888,"thread_start_us":11088,"threads_started":1}
I20260811 18:53:34.808933 1559 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:34.810302 1559 log.cc:824] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:34.814061 1559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797: No bootstrap required, opened a new log
Aug 11 18:53:34 dist-test-slave-lgr5 krb5kdc[1412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474414, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.60@KRBTEST.COM for kudu/127.25.25.61@KRBTEST.COM
Aug 11 18:53:34 dist-test-slave-lgr5 krb5kdc[1412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474412, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.62@KRBTEST.COM
I20260811 18:53:34.822885 1871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.807249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.61:46357 (local address 127.0.0.1:51454)
0811 18:53:34.807930 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.807948 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:34.808074 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:34.808462 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:34.808466 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:34.808955 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:34.809151 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:34.809164 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.810516 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.810521 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:34.811667 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:34.811684 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.812478 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.812484 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:34.812680 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.813240 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:34.813259 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:34.815452 (+ 2193us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:34.819552 (+ 4100us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:34.819559 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:34.819564 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:34.820268 (+ 704us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:34.820801 (+ 533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:34.820807 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:34.820811 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:34.821045 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:34.821813 (+ 768us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:34.821818 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:34.822008 (+ 190us) client_negotiation.cc:769] Sending connection context
0811 18:53:34.822171 (+ 163us) client_negotiation.cc:240] Negotiation successful
0811 18:53:34.822504 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577}
I20260811 18:53:34.823236 1718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.807237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51454 (local address 127.25.25.61:46357)
0811 18:53:34.807428 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:34.807434 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:34.808038 (+ 604us) server_negotiation.cc:407] Connection header received
0811 18:53:34.808246 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:34.808252 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:34.808330 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:34.808411 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:34.809317 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.810329 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.811803 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.812311 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.812424 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.815707 (+ 3283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:34.815715 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:34.815720 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:34.815769 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:34.819315 (+ 3546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.820435 (+ 1120us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.820442 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.820447 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.820655 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.821169 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.821174 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.821178 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.821571 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:34.821736 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:34.822324 (+ 588us) server_negotiation.cc:299] Negotiation successful
0811 18:53:34.822857 (+ 533us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 18:53:34.824892 1559 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45853ffb8e8f41d88f6cd46e37cdc797" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40143 } } peers { permanent_uuid: "c7d6c8d9f00c468d9b56c8e3a14e7763" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 46357 } } peers { permanent_uuid: "0d6f012243a84289a954a89467024579" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } }
I20260811 18:53:34.825371 1559 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45853ffb8e8f41d88f6cd46e37cdc797, State: Initialized, Role: FOLLOWER
I20260811 18:53:34.825560 1860 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:53:34.825964 1559 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45853ffb8e8f41d88f6cd46e37cdc797" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40143 } } peers { permanent_uuid: "c7d6c8d9f00c468d9b56c8e3a14e7763" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 46357 } } peers { permanent_uuid: "0d6f012243a84289a954a89467024579" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } }
I20260811 18:53:34.827401 1873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.809972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33672 (local address 127.25.25.62:40143)
0811 18:53:34.810137 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:34.810143 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:34.810160 (+ 17us) server_negotiation.cc:407] Connection header received
0811 18:53:34.810213 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:34.810218 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:34.810319 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:34.810422 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:34.811981 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.813016 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.814881 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.815543 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.815664 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.820711 (+ 5047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:34.820717 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:34.820722 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:34.820773 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:34.824144 (+ 3371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.825040 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.825044 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.825047 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.825247 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.825731 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.825737 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.825741 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.826078 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:34.826364 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:34.826758 (+ 394us) server_negotiation.cc:299] Negotiation successful
0811 18:53:34.827036 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 18:53:34.827499 1876 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45853ffb8e8f41d88f6cd46e37cdc797" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40143 } } peers { permanent_uuid: "c7d6c8d9f00c468d9b56c8e3a14e7763" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 46357 } } peers { permanent_uuid: "0d6f012243a84289a954a89467024579" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } } }
I20260811 18:53:34.827963 1876 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:53:34.828979 1559 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797 [sys.catalog]: configured and running, proceeding with master startup.
Aug 11 18:53:34 dist-test-slave-lgr5 krb5kdc[1412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474414, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.60@KRBTEST.COM for kudu/127.25.25.60@KRBTEST.COM
Aug 11 18:53:34 dist-test-slave-lgr5 krb5kdc[1412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474412, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.25.61@KRBTEST.COM
I20260811 18:53:34.843041 1871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.826421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:40447 (local address 127.0.0.1:53506)
0811 18:53:34.826646 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.826668 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:34.826772 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:34.827562 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:34.827566 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:34.828054 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:34.828316 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:34.828331 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.829441 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.829447 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:34.830788 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:34.830810 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.832014 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.832021 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:34.832264 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.832993 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:34.833019 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:34.836203 (+ 3184us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:34.840242 (+ 4039us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:34.840248 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:34.840252 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:34.840782 (+ 530us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:34.841146 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:34.841151 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:34.841155 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:34.841319 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:34.842013 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:34.842018 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:34.842159 (+ 141us) client_negotiation.cc:769] Sending connection context
0811 18:53:34.842288 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 18:53:34.842606 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260811 18:53:34.843067 1868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.826978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53506 (local address 127.25.25.60:40447)
0811 18:53:34.827135 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:34.827141 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:34.827159 (+ 18us) server_negotiation.cc:407] Connection header received
0811 18:53:34.827211 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:34.827215 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:34.827287 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:34.827376 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:34.828489 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.829282 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.830985 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.831657 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.831791 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.836424 (+ 4633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:34.836431 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:34.836436 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:34.836487 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:34.840064 (+ 3577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.840894 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.840900 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.840904 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.841042 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.841563 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.841569 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.841573 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.841902 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:34.842036 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:34.842406 (+ 370us) server_negotiation.cc:299] Negotiation successful
0811 18:53:34.842758 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":140,"server-negotiator.queue_time_us":58}
I20260811 18:53:34.849272 1718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.831584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51466 (local address 127.25.25.61:46357)
0811 18:53:34.831756 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:34.831762 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:34.831782 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:53:34.831883 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:34.831888 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:34.831955 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:34.832035 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:34.833834 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.834962 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.836936 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.837484 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.837615 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.842869 (+ 5254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:34.842878 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:34.842884 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:34.842935 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:34.846116 (+ 3181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.846841 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.846846 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.846848 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.847013 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.847440 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.847445 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.847447 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.847874 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:34.848228 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:34.848561 (+ 333us) server_negotiation.cc:299] Negotiation successful
0811 18:53:34.848817 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 18:53:34.851600 1860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d6f012243a84289a954a89467024579: Bootstrap starting.
I20260811 18:53:34.854871 25700 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:53:34.856482 1860 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0d6f012243a84289a954a89467024579: Neither blocks nor log segments found. Creating new log.
W20260811 18:53:34.857621 1464 tablet.cc:2369] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:53:34.857928 1860 log.cc:824] T 00000000000000000000000000000000 P 0d6f012243a84289a954a89467024579: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:34.859264 1517 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "45853ffb8e8f41d88f6cd46e37cdc797"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33672
I20260811 18:53:34.859809 1517 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 18:53:34.860046 1517 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:34.864463 1517 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45853ffb8e8f41d88f6cd46e37cdc797" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40143 } } peers { permanent_uuid: "c7d6c8d9f00c468d9b56c8e3a14e7763" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 46357 } } peers { permanent_uuid: "0d6f012243a84289a954a89467024579" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } }
W20260811 18:53:34.865200 1899 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:53:34.865329 1899 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:53:34.866088 1860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d6f012243a84289a954a89467024579: No bootstrap required, opened a new log
I20260811 18:53:34.867055 1517 leader_election.cc:288] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797 [CANDIDATE]: Term 1 election: Requested vote from peers c7d6c8d9f00c468d9b56c8e3a14e7763 (127.25.25.61:46357), 0d6f012243a84289a954a89467024579 (127.25.25.60:40447)
I20260811 18:53:34.857697 1429 master_runner.cc:186] Error getting master registration for 127.25.25.61:46357: OK, instance_id { permanent_uuid: "c7d6c8d9f00c468d9b56c8e3a14e7763" instance_seqno: 1786474414180312 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 18:53:34.874876 1429 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 18:53:34.878639 1860 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0d6f012243a84289a954a89467024579 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45853ffb8e8f41d88f6cd46e37cdc797" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40143 } } peers { permanent_uuid: "c7d6c8d9f00c468d9b56c8e3a14e7763" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 46357 } } peers { permanent_uuid: "0d6f012243a84289a954a89467024579" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } }
I20260811 18:53:34.879194 1860 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0d6f012243a84289a954a89467024579 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d6f012243a84289a954a89467024579, State: Initialized, Role: FOLLOWER
I20260811 18:53:34.879806 1860 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0d6f012243a84289a954a89467024579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45853ffb8e8f41d88f6cd46e37cdc797" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40143 } } peers { permanent_uuid: "c7d6c8d9f00c468d9b56c8e3a14e7763" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 46357 } } peers { permanent_uuid: "0d6f012243a84289a954a89467024579" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } }
I20260811 18:53:34.881052 1911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d6f012243a84289a954a89467024579 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45853ffb8e8f41d88f6cd46e37cdc797" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40143 } } peers { permanent_uuid: "c7d6c8d9f00c468d9b56c8e3a14e7763" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 46357 } } peers { permanent_uuid: "0d6f012243a84289a954a89467024579" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } } }
I20260811 18:53:34.881493 1911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d6f012243a84289a954a89467024579 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:53:34.882701 1860 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0d6f012243a84289a954a89467024579 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:34.882777 1810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "45853ffb8e8f41d88f6cd46e37cdc797" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "0d6f012243a84289a954a89467024579"
I20260811 18:53:34.883360 1810 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0d6f012243a84289a954a89467024579 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:34.887220 1810 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0d6f012243a84289a954a89467024579 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45853ffb8e8f41d88f6cd46e37cdc797 in term 1.
I20260811 18:53:34.888156 1461 leader_election.cc:302] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d6f012243a84289a954a89467024579, 45853ffb8e8f41d88f6cd46e37cdc797; no voters:
I20260811 18:53:34.888725 1876 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:34.898576 1876 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797 [term 1 LEADER]: Becoming Leader. State: Replica: 45853ffb8e8f41d88f6cd46e37cdc797, State: Running, Role: LEADER
I20260811 18:53:34.899473 1876 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45853ffb8e8f41d88f6cd46e37cdc797" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40143 } } peers { permanent_uuid: "c7d6c8d9f00c468d9b56c8e3a14e7763" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 46357 } } peers { permanent_uuid: "0d6f012243a84289a954a89467024579" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } }
I20260811 18:53:34.911478 1920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45853ffb8e8f41d88f6cd46e37cdc797. Latest consensus state: current_term: 1 leader_uuid: "45853ffb8e8f41d88f6cd46e37cdc797" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45853ffb8e8f41d88f6cd46e37cdc797" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40143 } } peers { permanent_uuid: "c7d6c8d9f00c468d9b56c8e3a14e7763" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 46357 } } peers { permanent_uuid: "0d6f012243a84289a954a89467024579" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } } }
I20260811 18:53:34.912073 1920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797 [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:34.914986 1709 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } attempt: 5
Aug 11 18:53:34 dist-test-slave-lgr5 krb5kdc[1412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474414, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.25.61@KRBTEST.COM for kudu/127.25.25.60@KRBTEST.COM
I20260811 18:53:34.937134 1873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.892370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33682 (local address 127.25.25.62:40143)
0811 18:53:34.892622 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:34.892630 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:34.893895 (+ 1265us) server_negotiation.cc:407] Connection header received
0811 18:53:34.895328 (+ 1433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:34.895335 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:34.895426 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:34.895503 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:34.899271 (+ 3768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.900411 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.903830 (+ 3419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.904615 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.904732 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.926602 (+ 21870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:34.926611 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:34.926617 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:34.926671 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:34.930848 (+ 4177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.933731 (+ 2883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.933739 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.933744 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.934024 (+ 280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.934638 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.934689 (+ 51us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.934694 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.935232 (+ 538us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:34.935534 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:34.936314 (+ 780us) server_negotiation.cc:299] Negotiation successful
0811 18:53:34.936650 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 18:53:34.915172 1723 master_runner.cc:186] Error getting master registration for 127.25.25.61:46357: OK, instance_id { permanent_uuid: "c7d6c8d9f00c468d9b56c8e3a14e7763" instance_seqno: 1786474414180312 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 18:53:34.939368 1723 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 18:53:34.940028 1956 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:34.943478 1714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.915611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.25.60:40447 (local address 127.0.0.1:53528)
0811 18:53:34.916014 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.916033 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:34.916170 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:34.917130 (+ 960us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:34.917136 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:34.917651 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:34.917890 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:34.917905 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.919775 (+ 1870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.919781 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:34.921270 (+ 1489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:34.921292 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.924865 (+ 3573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.924874 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:34.925152 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.926043 (+ 891us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:34.926071 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:34.930193 (+ 4122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:34.935705 (+ 5512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:34.935712 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:34.935716 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:34.936794 (+ 1078us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:34.937797 (+ 1003us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:34.937822 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:34.937826 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:34.940200 (+ 2374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:34.941559 (+ 1359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:34.941566 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:34.941852 (+ 286us) client_negotiation.cc:769] Sending connection context
0811 18:53:34.942436 (+ 584us) client_negotiation.cc:240] Negotiation successful
0811 18:53:34.943036 (+ 600us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263}
I20260811 18:53:34.944348 1867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.916418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53528 (local address 127.25.25.60:40447)
0811 18:53:34.916614 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:34.916620 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:34.916641 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:53:34.916704 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:34.916709 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:34.916794 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:34.916923 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:34.918083 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.919265 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.923626 (+ 4361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.924366 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.924506 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.930604 (+ 6098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:34.930612 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:34.930617 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:34.930669 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:34.935427 (+ 4758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.937049 (+ 1622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.937057 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.937060 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.937514 (+ 454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.940399 (+ 2885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.940435 (+ 36us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.940439 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.941283 (+ 844us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:34.942237 (+ 954us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:34.943714 (+ 1477us) server_negotiation.cc:299] Negotiation successful
0811 18:53:34.943984 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260811 18:53:34.946300 1939 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0d6f012243a84289a954a89467024579: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:53:34.946420 1939 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:53:34.947315 1868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.894551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53520 (local address 127.25.25.60:40447)
0811 18:53:34.894779 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:34.894789 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:34.894808 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:53:34.894886 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:34.894892 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:34.895013 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:34.895139 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:34.898746 (+ 3607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.899889 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.902274 (+ 2385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.902940 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.903051 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.913009 (+ 9958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:34.913017 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:34.913023 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:34.913081 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:34.923428 (+ 10347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.943881 (+ 20453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.943887 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.943891 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.944075 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.945297 (+ 1222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.945303 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.945307 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.945754 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:34.946031 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:34.946708 (+ 677us) server_negotiation.cc:299] Negotiation successful
0811 18:53:34.947000 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 18:53:34.951057 1709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7d6c8d9f00c468d9b56c8e3a14e7763: Bootstrap starting.
I20260811 18:53:34.955592 1709 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7d6c8d9f00c468d9b56c8e3a14e7763: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:34.955984 1956 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:34.965415 1718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.895010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51480 (local address 127.25.25.61:46357)
0811 18:53:34.895206 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:34.895212 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:34.906537 (+ 11325us) server_negotiation.cc:407] Connection header received
0811 18:53:34.906704 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:34.906710 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:34.906820 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:34.906941 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:34.941223 (+ 34282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.942423 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.947425 (+ 5002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.948165 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.948273 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.952244 (+ 3971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:34.952253 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:34.952258 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:34.952309 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:34.956451 (+ 4142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.958024 (+ 1573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.958031 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.958035 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.958253 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:34.958972 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:34.958979 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:34.958983 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:34.959444 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:34.959738 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:34.964670 (+ 4932us) server_negotiation.cc:299] Negotiation successful
0811 18:53:34.965030 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 18:53:34.966326 1810 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0d6f012243a84289a954a89467024579 [term 1 FOLLOWER]: Refusing update from remote peer 45853ffb8e8f41d88f6cd46e37cdc797: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:34.967939 1920 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d6f012243a84289a954a89467024579" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:34.969846 1709 log.cc:824] T 00000000000000000000000000000000 P c7d6c8d9f00c468d9b56c8e3a14e7763: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:34.974743 1709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7d6c8d9f00c468d9b56c8e3a14e7763: No bootstrap required, opened a new log
W20260811 18:53:34.993615 1768 tablet.cc:2369] T 00000000000000000000000000000000 P 0d6f012243a84289a954a89467024579: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:53:34.996124 1709 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7d6c8d9f00c468d9b56c8e3a14e7763 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45853ffb8e8f41d88f6cd46e37cdc797" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40143 } } peers { permanent_uuid: "c7d6c8d9f00c468d9b56c8e3a14e7763" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 46357 } } peers { permanent_uuid: "0d6f012243a84289a954a89467024579" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } }
I20260811 18:53:34.996744 1709 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7d6c8d9f00c468d9b56c8e3a14e7763 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7d6c8d9f00c468d9b56c8e3a14e7763, State: Initialized, Role: FOLLOWER
I20260811 18:53:34.997432 1709 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7d6c8d9f00c468d9b56c8e3a14e7763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45853ffb8e8f41d88f6cd46e37cdc797" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40143 } } peers { permanent_uuid: "c7d6c8d9f00c468d9b56c8e3a14e7763" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 46357 } } peers { permanent_uuid: "0d6f012243a84289a954a89467024579" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } }
I20260811 18:53:34.998974 1961 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7d6c8d9f00c468d9b56c8e3a14e7763 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45853ffb8e8f41d88f6cd46e37cdc797" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40143 } } peers { permanent_uuid: "c7d6c8d9f00c468d9b56c8e3a14e7763" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 46357 } } peers { permanent_uuid: "0d6f012243a84289a954a89467024579" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } } }
I20260811 18:53:34.999840 1961 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7d6c8d9f00c468d9b56c8e3a14e7763 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:53:35.009908 1911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d6f012243a84289a954a89467024579 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45853ffb8e8f41d88f6cd46e37cdc797. Latest consensus state: current_term: 1 leader_uuid: "45853ffb8e8f41d88f6cd46e37cdc797" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45853ffb8e8f41d88f6cd46e37cdc797" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40143 } } peers { permanent_uuid: "c7d6c8d9f00c468d9b56c8e3a14e7763" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 46357 } } peers { permanent_uuid: "0d6f012243a84289a954a89467024579" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } } }
I20260811 18:53:35.010300 1911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d6f012243a84289a954a89467024579 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:53:35.012995 1709 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7d6c8d9f00c468d9b56c8e3a14e7763 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:35.013067 1654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "45853ffb8e8f41d88f6cd46e37cdc797" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c7d6c8d9f00c468d9b56c8e3a14e7763"
I20260811 18:53:35.013595 1654 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7d6c8d9f00c468d9b56c8e3a14e7763 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:35.014343 1957 mvcc.cc:205] Tried to move back new op lower bound from 7317399203688923136 to 7317399203435593728. Current Snapshot: MvccSnapshot[applied={T|T < 7317399203688923136}]
I20260811 18:53:35.018121 1654 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c7d6c8d9f00c468d9b56c8e3a14e7763 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45853ffb8e8f41d88f6cd46e37cdc797 in term 1.
I20260811 18:53:35.019342 1651 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c7d6c8d9f00c468d9b56c8e3a14e7763 [term 1 FOLLOWER]: Refusing update from remote peer 45853ffb8e8f41d88f6cd46e37cdc797: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:35.021636 1876 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7d6c8d9f00c468d9b56c8e3a14e7763" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 46357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:35.033274 1911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d6f012243a84289a954a89467024579 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "45853ffb8e8f41d88f6cd46e37cdc797" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45853ffb8e8f41d88f6cd46e37cdc797" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40143 } } peers { permanent_uuid: "c7d6c8d9f00c468d9b56c8e3a14e7763" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 46357 } } peers { permanent_uuid: "0d6f012243a84289a954a89467024579" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } } }
I20260811 18:53:35.033644 1911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d6f012243a84289a954a89467024579 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:53:35.034482 1920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "45853ffb8e8f41d88f6cd46e37cdc797" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45853ffb8e8f41d88f6cd46e37cdc797" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40143 } } peers { permanent_uuid: "c7d6c8d9f00c468d9b56c8e3a14e7763" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 46357 } } peers { permanent_uuid: "0d6f012243a84289a954a89467024579" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } } }
I20260811 18:53:35.034899 1920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797 [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:35.036680 1956 catalog_manager.cc:1347] Generated new cluster ID: d431b3ec661a4246b3da5ac770974f5b
I20260811 18:53:35.036800 1956 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:35.073005 1961 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7d6c8d9f00c468d9b56c8e3a14e7763 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45853ffb8e8f41d88f6cd46e37cdc797. Latest consensus state: current_term: 1 leader_uuid: "45853ffb8e8f41d88f6cd46e37cdc797" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45853ffb8e8f41d88f6cd46e37cdc797" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40143 } } peers { permanent_uuid: "c7d6c8d9f00c468d9b56c8e3a14e7763" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 46357 } } peers { permanent_uuid: "0d6f012243a84289a954a89467024579" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } } }
I20260811 18:53:35.073534 1961 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7d6c8d9f00c468d9b56c8e3a14e7763 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:53:35.075110 1988 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7d6c8d9f00c468d9b56c8e3a14e7763 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "45853ffb8e8f41d88f6cd46e37cdc797" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45853ffb8e8f41d88f6cd46e37cdc797" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40143 } } peers { permanent_uuid: "c7d6c8d9f00c468d9b56c8e3a14e7763" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 46357 } } peers { permanent_uuid: "0d6f012243a84289a954a89467024579" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } } }
I20260811 18:53:35.081697 1988 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7d6c8d9f00c468d9b56c8e3a14e7763 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:53:35.093381 1920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "45853ffb8e8f41d88f6cd46e37cdc797" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45853ffb8e8f41d88f6cd46e37cdc797" member_type: VOTER last_known_addr { host: "127.25.25.62" port: 40143 } } peers { permanent_uuid: "c7d6c8d9f00c468d9b56c8e3a14e7763" member_type: VOTER last_known_addr { host: "127.25.25.61" port: 46357 } } peers { permanent_uuid: "0d6f012243a84289a954a89467024579" member_type: VOTER last_known_addr { host: "127.25.25.60" port: 40447 } } }
I20260811 18:53:35.093709 1920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797 [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:35.107122 1956 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:35.109233 1956 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:35.111238 1990 catalog_manager.cc:1259] Loaded cluster ID: d431b3ec661a4246b3da5ac770974f5b
I20260811 18:53:35.111398 1990 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c7d6c8d9f00c468d9b56c8e3a14e7763: loading cluster ID for follower catalog manager: success
I20260811 18:53:35.122539 1990 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c7d6c8d9f00c468d9b56c8e3a14e7763: acquiring CA information for follower catalog manager: success
W20260811 18:53:35.124215 1990 catalog_manager.cc:873] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
I20260811 18:53:35.157903 1956 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 45853ffb8e8f41d88f6cd46e37cdc797: Generated new TSK 0
I20260811 18:53:35.159711 1956 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 18:53:35.320708 1873 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:35.298153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33688 (local address 127.25.25.62:40143)
0811 18:53:35.298376 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:35.298383 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:35.317357 (+ 18974us) server_negotiation.cc:407] Connection header received
0811 18:53:35.318790 (+ 1433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:35.318798 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:35.318907 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:35.318992 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:35.320417 (+ 1425us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33688: BlockingRecv error: recv got EOF from 127.0.0.1:33688 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
W20260811 18:53:35.323527 1718 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:35.300183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51492 (local address 127.25.25.61:46357)
0811 18:53:35.300387 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:35.300409 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:35.318129 (+ 17720us) server_negotiation.cc:407] Connection header received
0811 18:53:35.321630 (+ 3501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:35.321637 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:35.321763 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:35.321852 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:35.323245 (+ 1393us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51492: BlockingRecv error: recv got EOF from 127.0.0.1:51492 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260811 18:53:35.326746 1868 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:35.314506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53540 (local address 127.25.25.60:40447)
0811 18:53:35.314774 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:35.314781 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:35.324694 (+ 9913us) server_negotiation.cc:407] Connection header received
0811 18:53:35.325110 (+ 416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:35.325117 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:35.325226 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:35.325299 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:35.326446 (+ 1147us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53540: BlockingRecv error: recv got EOF from 127.0.0.1:53540 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260811 18:53:35.375905 1718 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:35.362297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51496 (local address 127.25.25.61:46357)
0811 18:53:35.362502 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:35.362508 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:35.373399 (+ 10891us) server_negotiation.cc:407] Connection header received
0811 18:53:35.374046 (+ 647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:35.374053 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:35.374202 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:35.374285 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:35.375531 (+ 1246us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51496: BlockingRecv error: recv got EOF from 127.0.0.1:51496 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260811 18:53:35.425895 1718 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:35.412479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51498 (local address 127.25.25.61:46357)
0811 18:53:35.412685 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:35.412691 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:35.423465 (+ 10774us) server_negotiation.cc:407] Connection header received
0811 18:53:35.424069 (+ 604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:35.424075 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:35.424206 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:35.424290 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:35.425608 (+ 1318us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51498: BlockingRecv error: recv got EOF from 127.0.0.1:51498 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260811 18:53:35.476709 1718 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:35.463571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51504 (local address 127.25.25.61:46357)
0811 18:53:35.463773 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:35.463779 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:35.474397 (+ 10618us) server_negotiation.cc:407] Connection header received
0811 18:53:35.474988 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:35.474995 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:35.475146 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:35.475233 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:35.476431 (+ 1198us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51504: BlockingRecv error: recv got EOF from 127.0.0.1:51504 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260811 18:53:35.530719 1718 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:35.516570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51508 (local address 127.25.25.61:46357)
0811 18:53:35.516858 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:35.516865 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:35.528198 (+ 11333us) server_negotiation.cc:407] Connection header received
0811 18:53:35.528826 (+ 628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:35.528832 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:35.528964 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:35.529061 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:35.530459 (+ 1398us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51508: BlockingRecv error: recv got EOF from 127.0.0.1:51508 (error 108)
Metrics: {"server-negotiator.queue_time_us":139}
W20260811 18:53:35.565130 1718 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:35.562486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51518 (local address 127.25.25.61:46357)
0811 18:53:35.562744 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:35.562752 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:35.563347 (+ 595us) server_negotiation.cc:407] Connection header received
0811 18:53:35.563591 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:35.563597 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:35.563708 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:35.563827 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:35.564812 (+ 985us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51518: BlockingRecv error: recv got EOF from 127.0.0.1:51518 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260811 18:53:35.587302 1718 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:35.585079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51534 (local address 127.25.25.61:46357)
0811 18:53:35.585303 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:35.585310 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:35.585725 (+ 415us) server_negotiation.cc:407] Connection header received
0811 18:53:35.585908 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:35.585915 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:35.586029 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:35.586167 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:35.587020 (+ 853us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51534: BlockingRecv error: recv got EOF from 127.0.0.1:51534 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260811 18:53:35.626545 1718 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:35.623974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51546 (local address 127.25.25.61:46357)
0811 18:53:35.624263 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:35.624274 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:35.624733 (+ 459us) server_negotiation.cc:407] Connection header received
0811 18:53:35.624991 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:35.624998 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:35.625111 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:35.625232 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:35.626254 (+ 1022us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51546: BlockingRecv error: recv got EOF from 127.0.0.1:51546 (error 108)
Metrics: {"server-negotiator.queue_time_us":121}
W20260811 18:53:35.696440 1718 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:35.694587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51558 (local address 127.25.25.61:46357)
0811 18:53:35.694824 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:35.694832 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:35.695138 (+ 306us) server_negotiation.cc:407] Connection header received
0811 18:53:35.695313 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:35.695317 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:35.695404 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:35.695500 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:35.696216 (+ 716us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51558: BlockingRecv error: recv got EOF from 127.0.0.1:51558 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260811 18:53:35.831116 1718 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:35.829169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51562 (local address 127.25.25.61:46357)
0811 18:53:35.829407 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:35.829415 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:35.829688 (+ 273us) server_negotiation.cc:407] Connection header received
0811 18:53:35.829918 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:35.829922 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:35.830005 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:35.830107 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:35.830922 (+ 815us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51562: BlockingRecv error: recv got EOF from 127.0.0.1:51562 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 18:53:35.948635 1939 catalog_manager.cc:1259] Loaded cluster ID: d431b3ec661a4246b3da5ac770974f5b
I20260811 18:53:35.948771 1939 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0d6f012243a84289a954a89467024579: loading cluster ID for follower catalog manager: success
I20260811 18:53:35.951412 1939 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0d6f012243a84289a954a89467024579: acquiring CA information for follower catalog manager: success
I20260811 18:53:35.953881 1939 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0d6f012243a84289a954a89467024579: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 18:53:36.093564 1718 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:36.091603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51566 (local address 127.25.25.61:46357)
0811 18:53:36.091827 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:36.091834 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:36.092029 (+ 195us) server_negotiation.cc:407] Connection header received
0811 18:53:36.092292 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:36.092296 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:36.092415 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:36.092512 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:36.093388 (+ 876us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51566: BlockingRecv error: recv got EOF from 127.0.0.1:51566 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 18:53:36.127496 1990 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c7d6c8d9f00c468d9b56c8e3a14e7763: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 18:53:36.620837 2105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:36.613450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51574 (local address 127.25.25.61:46357)
0811 18:53:36.614224 (+ 774us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:36.614228 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:36.614256 (+ 28us) server_negotiation.cc:407] Connection header received
0811 18:53:36.614385 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:36.614389 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:36.614561 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:36.614680 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:36.615299 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:36.616219 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:36.618008 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:36.618598 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:36.618721 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:36.619413 (+ 692us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:36.620018 (+ 605us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:36.620206 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:36.620422 (+ 216us) server_negotiation.cc:299] Negotiation successful
0811 18:53:36.620552 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":658,"thread_start_us":551,"threads_started":1}
I20260811 18:53:36.638157 2112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:36.630618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53546 (local address 127.25.25.60:40447)
0811 18:53:36.631247 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:36.631252 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:36.631333 (+ 81us) server_negotiation.cc:407] Connection header received
0811 18:53:36.631553 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:36.631558 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:36.631753 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:36.631952 (+ 199us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:36.632686 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:36.633588 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:36.635404 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:36.635928 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:36.636053 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:36.636830 (+ 777us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:36.637423 (+ 593us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:36.637606 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:36.637709 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 18:53:36.637795 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":510,"thread_start_us":378,"threads_started":1}
I20260811 18:53:36.657810 2112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:36.645239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53562 (local address 127.25.25.60:40447)
0811 18:53:36.645529 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:36.645536 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:36.649500 (+ 3964us) server_negotiation.cc:407] Connection header received
0811 18:53:36.649849 (+ 349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:36.649856 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:36.649965 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:36.650064 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:36.650994 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:36.652268 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:36.655204 (+ 2936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:36.655709 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:36.655845 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:36.656606 (+ 761us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:36.656746 (+ 140us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:36.656827 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:36.657361 (+ 534us) server_negotiation.cc:299] Negotiation successful
0811 18:53:36.657462 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 18:53:36.658175 2105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:36.645572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51586 (local address 127.25.25.61:46357)
0811 18:53:36.647845 (+ 2273us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:36.647851 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:36.650534 (+ 2683us) server_negotiation.cc:407] Connection header received
0811 18:53:36.650718 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:36.650723 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:36.650815 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:36.650923 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:36.651686 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:36.652879 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:36.655984 (+ 3105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:36.656728 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:36.656859 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:36.657312 (+ 453us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:36.657452 (+ 140us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:36.657530 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:36.657729 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 18:53:36.657823 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2127}
I20260811 18:53:36.658548 2131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:36.645216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33704 (local address 127.25.25.62:40143)
0811 18:53:36.648778 (+ 3562us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:36.648784 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:36.650136 (+ 1352us) server_negotiation.cc:407] Connection header received
0811 18:53:36.650280 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:36.650287 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:36.650499 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:36.650694 (+ 195us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:36.651553 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:36.652462 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:36.655213 (+ 2751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:36.655711 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:36.655840 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:36.656715 (+ 875us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:36.657158 (+ 443us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:36.657261 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:36.657951 (+ 690us) server_negotiation.cc:299] Negotiation successful
0811 18:53:36.658164 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3437,"thread_start_us":3320,"threads_started":1}
I20260811 18:53:36.669512 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 1429
I20260811 18:53:36.670615 1548 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:53:36.811962 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 1429
I20260811 18:53:36.847209 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 1575
I20260811 18:53:36.848455 1699 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:53:36.957753 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 1575
I20260811 18:53:36.990535 25700 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskse5jrw/build/asan/bin/kudu pid 1723
I20260811 18:53:36.991824 1846 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:53:37.104364 25700 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskse5jrw/build/asan/bin/kudu with pid 1723
2026-08-11T18:53:37Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5679 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (11200 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (404342 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST